Bauhaus-Universität Weimar
PureData Convention 2011

PDCON:Conference/A Pd framework for the Xth Sense: enabling computers to sense human kinetic behaviour

A Pd[[Pure Data]] a dataflow programming environment framework for the Xth Sense: enabling computers to sense human kinetic behaviour

Author: Marco Donnarumma

Download full paper: Media:A Pd framework for the Xth Sense-enabling computers to sense human kinetic behaviour.pdf

The Xth Sense is an interactive system for the biophysical generation and control of music. It makes use of muscle sounds (MMG[1]) produced by a performer as both raw sonic material and control data. Presently the Xth Sense (XS) technology consists of low-cost, wearable biosensors and a Pure Data based application for capture, analysis, real time processing and playback of human muscle sounds. The technical implementation of the XS biosensors has been recently illustrated[2].

This paper describes the design of the XS software; it is a program that enables a computer to “listen” to the MMG signals transduced by the XS biosensors, to understand the performance main features, and therefore to interact with the performer. After a brief introduction on the nature of the interaction fostered by the XS technology, I focus on the framework main features such as: the XS library, a tabbed dynamic interface (TDI), a MMG features extraction unit, and a graph-on-parent (GOP) routing system for dynamic mapping of gesture to sound.

Music for Flesh II, is a solo sound piece for the Xth Sense.



References

  1. wikipedia:Mechanomyogram
  2. M. Donnarumma: “Xth Sense: researching muscle sounds for an experimental paradigm of musical performance” Proceedings of the Linux Audio Conference (LAC'11), 2011



Kreativfonds Bauhaus-Univeristät Weimar Electronic Arts Blog für digitale Spielkultur The Mozilla Foundation Allied Vision Technologies Reality Jockey Ltd. Freistaat Thüringen Bauhaus-Universität Weimar Hochschule für Musik Franz Liszt Weimar Fraunhofer Institute for Digital Media Technology IDMT Stadt Weimar Klassik Stiftung Weimar NK Faculty of Media Studio for electro-acoustic Music KulturTragWerk e.V. Elektronisches Studio der TU Berlin Maschinenraum Hackerspace Weimar Parlomar5 e.V. Lab for Electronic Arts and Performance Radio Lotte WeimarSponsors and partners of the 4th internationals Pure Data Convention in Weimar 2011

4th international Pure Data Convention 2011 Weimar ~ Berlin