We are constantly surrounded by electronic interfaces: elevators, automatic doors, ticket machines, remote controls, voice recognition systems, etc. With a high degree of networking between our devices, interfaces must seamlessly integrate into ecosystems of information acquisition and processing. Information acquisition and processing are becoming increasingly spatially separated. Thus, ergonomic sensor placement, which integrates discreetly into our accustomed environment, is gaining ground.
The course explores the possibilities of this ergonomic, embedded interaction using the example of acoustic interfaces. We will develop electronic sensor systems for the detection of vibrations (structure-borne sound) in integrated surfaces and experiment with machine learning methods to differentiate between vibration gestures (e.g. knocking noises, friction noises, etc.).
The Course will be taught in video sessions and regular assignments every two weeks.
If you are interested, please send a letter of motivation and portfolio to clemens.wegener ( at ) uni-weimar (dot) de.
We will use either the Teensy 4.0 hardware platform or the Raspberry Pi to classify sounds in the environment. Therefore, a budget of (30-40€) should be planned for the Teensy and other components. Knowledge of programming is a requirement!
Successful completion of 50% of the assignments. Realization and documentation of a completed semester prototype and a final video presentation. Please refer to the Evaluation Rubric for more details.
Zamborlin, Bruno. 2015. Studies on customisation-driven digital music instruments. Doctoral thesis, Goldsmiths, University of London.
Murray-Smith, Roderick & Williamson, John & Hughes, Stephen & Quaade, Torben. (2008). Stane: Synthesized surfaces for tactile input. Conference on Human Factors in Computing Systems - Proceedings. 1299-1302. 10.1145/1357054.1357257.
Rasamimanana, N.H., Bevilacqua, F., Schnell, N., Guédy, F., Fléty, E., Maestracci, C., Zamborlin, B., Frechin, J., & Petrevski, U. (2010). Modular musical objects towards embodied control of digital music. Tangible and Embedded Interaction.