A Pd[[Pure Data]] a dataflow programming environment framework for the Xth Sense: enabling computers to sense human kinetic behaviour

Author: Marco Donnarumma

Download full paper: Media:A Pd framework for the Xth Sense-enabling computers to sense human kinetic behaviour.pdf

The Xth Sense is an interactive system for the biophysical generation and control of music. It makes use of muscle sounds (MMG[1]) produced by a performer as both raw sonic material and control data. Presently the Xth Sense (XS) technology consists of low-cost, wearable biosensors and a Pure Data based application for capture, analysis, real time processing and playback of human muscle sounds. The technical implementation of the XS biosensors has been recently illustrated[2].

This paper describes the design of the XS software; it is a program that enables a computer to “listen” to the MMG signals transduced by the XS biosensors, to understand the performance main features, and therefore to interact with the performer. After a brief introduction on the nature of the interaction fostered by the XS technology, I focus on the framework main features such as: the XS library, a tabbed dynamic interface (TDI), a MMG features extraction unit, and a graph-on-parent (GOP) routing system for dynamic mapping of gesture to sound.

Music for Flesh II, is a solo sound piece for the Xth Sense.


  1. wikipedia:Mechanomyogram
  2. M. Donnarumma: “Xth Sense: researching muscle sounds for an experimental paradigm of musical performance” Proceedings of the Linux Audio Conference (LAC'11), 2011

Kreativfonds Bauhaus-Univeristät WeimarElectronic Arts Blog für digitale SpielkulturThe Mozilla FoundationAllied Vision TechnologiesReality Jockey Ltd.Freistaat ThüringenBauhaus-Universität WeimarHochschule für Musik Franz Liszt WeimarFraunhofer Institute for Digital Media Technology IDMTStadt WeimarKlassik Stiftung WeimarNKFaculty of MediaStudio for electro-acoustic MusicKulturTragWerk e.V.Elektronisches Studio der TU BerlinMaschinenraum Hackerspace WeimarParlomar5 e.V.Lab for Electronic Arts and PerformanceRadio Lotte WeimarSponsors and partners of the 4th internationals Pure Data Convention in Weimar 2011

4th international Pure Data Convention 2011 Weimar ~ Berlin