PDCON:Conference/A Pd framework for the Xth Sense: enabling computers to sense human kinetic behaviour: Difference between revisions

From Medien Wiki
No edit summary
Line 5: Line 5:
The [http://res.marcodonnarumma.com/ Xth Sense] is an interactive system for the biophysical generation and control of music. It makes use of muscle sounds (namely, mechanical myography or MMG) produced by a performer as both raw sonic material and control data. Presently the Xth Sense (XS) technology consists of low-cost, wearable biosensors and a [[Pure Data]] based application for capture, analysis, real time processing and playback of human muscle sounds. The technical implementation of the XS biosensors has been recently illustrated in <ref>M. Donnarumma: “Xth Sense: researching muscle sounds for an experimental paradigm of musical performance” Proceedings of the Linux Audio Conference (LAC'11), 2011</ref>.
The [http://res.marcodonnarumma.com/ Xth Sense] is an interactive system for the biophysical generation and control of music. It makes use of muscle sounds (namely, mechanical myography or MMG) produced by a performer as both raw sonic material and control data. Presently the Xth Sense (XS) technology consists of low-cost, wearable biosensors and a [[Pure Data]] based application for capture, analysis, real time processing and playback of human muscle sounds. The technical implementation of the XS biosensors has been recently illustrated in <ref>M. Donnarumma: “Xth Sense: researching muscle sounds for an experimental paradigm of musical performance” Proceedings of the Linux Audio Conference (LAC'11), 2011</ref>.


This paper describes the design of the XS software; it is a program that enables a computer to “listen” to the MMG signals transduced transduced by the XS biosensors, to understand the performance main features, and therefore to interact with the performer. After a brief introduction on the nature of the interaction fostered by the XS technology, I focus on the framework main features such as: the XS library, a tabbed dynamic interface (TDI), a MMG features extraction unit, and a graph-on-parent (GOP) routing system for dynamic mapping of gesture to sound.
This paper describes the design of the XS software; it is a program that enables a computer to “listen” to the MMG signals transduced by the XS biosensors, to understand the performance main features, and therefore to interact with the performer. After a brief introduction on the nature of the interaction fostered by the XS technology, I focus on the framework main features such as: the XS library, a tabbed dynamic interface (TDI), a MMG features extraction unit, and a graph-on-parent (GOP) routing system for dynamic mapping of gesture to sound.


[http://marcodonnarumma.com/works/music-for-flesh-ii/ Music for Flesh II], is a solo sound piece for the Xth Sense.
[http://marcodonnarumma.com/works/music-for-flesh-ii/ Music for Flesh II], is a solo sound piece for the Xth Sense.

Revision as of 09:18, 2 August 2011

A Pd framework for the Xth Sense: enabling computers to sense human kinetic behaviour

Author: Marco Donnarumma

The Xth Sense is an interactive system for the biophysical generation and control of music. It makes use of muscle sounds (namely, mechanical myography or MMG) produced by a performer as both raw sonic material and control data. Presently the Xth Sense (XS) technology consists of low-cost, wearable biosensors and a Pure Data based application for capture, analysis, real time processing and playback of human muscle sounds. The technical implementation of the XS biosensors has been recently illustrated in [1].

This paper describes the design of the XS software; it is a program that enables a computer to “listen” to the MMG signals transduced by the XS biosensors, to understand the performance main features, and therefore to interact with the performer. After a brief introduction on the nature of the interaction fostered by the XS technology, I focus on the framework main features such as: the XS library, a tabbed dynamic interface (TDI), a MMG features extraction unit, and a graph-on-parent (GOP) routing system for dynamic mapping of gesture to sound.

Music for Flesh II, is a solo sound piece for the Xth Sense.

References

  1. M. Donnarumma: “Xth Sense: researching muscle sounds for an experimental paradigm of musical performance” Proceedings of the Linux Audio Conference (LAC'11), 2011



Kreativfonds Bauhaus-Univeristät WeimarElectronic Arts Blog für digitale SpielkulturThe Mozilla FoundationAllied Vision TechnologiesFreistaat ThüringenBauhaus-Universität WeimarHochschule für Musik Franz Liszt WeimarFraunhofer Institute for Digital Media Technology IDMTStadt WeimarKlassik Stiftung WeimarNKFaculty of MediaStudio for electro-acoustic MusicKulturTragWerk e.V.Elektronisches Studio der TU BerlinMaschinenraum Hackerspace WeimarRadio Lotte WeimarSponsors and partners of the 4th internationals Pure Data Convention in Weimar 2011

4th international Pure Data Convention 2011 Weimar ~ Berlin