Play with Rhythms:
Group work By:
- Kan Feng: Processing visualization, Arduino, TouchOsc
- Di Yang: MaxMsp visualization
- Shuyan Chen: MaxMsp sound
-JiXiang Jiang: Documentation
Introduction:
In our group, we want to realize that graphics and physics can be outputs which perform the synchro feedback of visualization and sound reacting to the same controls in mobile way. And creating a performance that combines the visualization with the sound which will be rhythms that generated in sound card in laptops, physicals in arduino side and the recording of environmental sound.
We were using TouchOsc as an input to send data of controls to Processing through osc messages, once received and analyzed by processing, then the data continues to be sent to Maxmsp in others' computer to control the visualization and sound in computers and also Arduino side to control different physicals which can generate different sounds. Hence, we can use the same controls in our mobile phones to achieve the same parameters which create the visual and audio interaction in both graphical and physical way.
Diagram:
Implementation:
1.Input
As the main input interface, the layout of TouchOsc was designed to control three key elements: RGB color, Position and Speed. And the layout, color, value range, ID etc. of all these controls can be modified in TouchOsc Editor in computers
RGB color(Rotary): value range from 0 to 255; rotation controlling; responsible for the color of visualization in Processing and RGB Led in Arduino.
Position(Multi-xy pad): x, y value range from 0 to 900 which matches the window size in processing; multi-touch controlling; responsible for the position and amounts of visualization in processing and the sound effect in Maxmsp visualization.
Speed(Fader): value range from 0 to 0.15 which matches the algorithm in processing; slide controlling; responsible for the rotation speed of Processing visualization, Arduino servo and audio of Arduino buzzer.
2. Message Communication