GMU:Home Made Bioelectronics/Marah Doleh/Docummentation of progress

From Medien Wiki


What has been done so far:

  • Testing receiving data from Arduino to Touchdesigner using Ultrasonic Distance Sensor (only for this test)

/Code on arduino

  • Manipulating 3D object using data received from Arduino

Links used for this step: Feedback in Touchdesigner, TOUCHDESIGNER & ARDUINO

  • Audio-reactive 3D model

Links used for this step: Instancing in Touchdesigner, Touchdesigner audio analysis

What's next?

Arduino

  • Send pulse data to TD
  • Send to Emotion recognition code

Python | Emotion recognition

  • Emotion recognition
  • Send data to TD

Touchdesinger

  • test other forms of 3D (point clouds/ more complex instancing/....)
  • try other sets of reactions to music
  • create multiple scenes for different emotions
  • intersection with Arduino: reaction to the pulse input
  • intersection with python: trigger change in scenes by the emotional input