GMU:Digital Puppetry Lab/Group Ben & Luca: Difference between revisions

From Medien Wiki
Line 20: Line 20:


===Grabbing the Audio Input===
===Grabbing the Audio Input===
<gallery>
[[File:Max01.png|thumb|left]]
[[File:Max01.png|thumb|left]]
</gallery>


In Max you can grab any audio input. In our case we use a microphone connected to an audio interface. <br> The audio signal is then converted into a float value stream. With a threshold patch, we can set the minimum of input to trigger a bang. The bang from the threshold we then send to a message box, containing a predefined OSC message string ( /goOnBang $1 ).
In Max you can grab any audio input. In our case we use a microphone connected to an audio interface. <br> The audio signal is then converted into a float value stream. With a threshold patch, we can set the minimum of input to trigger a bang. The bang from the threshold we then send to a message box, containing a predefined OSC message string ( /goOnBang $1 ).

Revision as of 13:26, 31 May 2016

Ben & Lucas OSC Game Documentation

"Give It To Me Baby"

We did a little game, where you can control a dancefloor in a Unity Scene, with microphone input. The player is requested to shout, beatbox or clap in front of the microphone, to move the dancers on the screen.

An audio signal is grabbed in Max/Msp and then sent to Unity via OSC. In Unity the signal is used to control an object, which serves as the dance-floor for some SpriteAnimation of Dancers. When the floor moves the dancers get kicked around.

When you start the game, there is music but no beat. You have the control over the beat. When you start using the mic, the beat is un-muted. When you stop interacting, the message - "Give It To Me Baby!" - appears, which forces you to go on.


- -

Max/Msp

Grabbing the Audio Input

In Max you can grab any audio input. In our case we use a microphone connected to an audio interface.
The audio signal is then converted into a float value stream. With a threshold patch, we can set the minimum of input to trigger a bang. The bang from the threshold we then send to a message box, containing a predefined OSC message string ( /goOnBang $1 ).

Setting the threshold

To use a constant audiostream, and trigger things with it, you need something called "Envelope Follower". Therefore we used a sub-patch which comes with to standard max-externals. This patch detects peaks in the audio-signal, if you want to use a peak above a certain level you have to look at the gain and set the threshold then.

Unity

Sprite.jpg
Unity2.png
Unity3.png
Unity4.png
Unity5.png
Unity6.png
Unity7.png
Unity8.png
Unity9.png
Unity10.png
Unity11.png
Unity12.png
Unity13.png
Unity14.png
Unity15.png
Unity16.png
Unity17.png