Medien Wiki - User contributions [en]

EKK:LoFi Sounds in HiFi Spaces/Working with language

2013-05-06T16:17:09Z

Cwegener:

==Working with language==

This is more of a proposal of an explorative working topic than a sketch of a project.

I was getting interested into the impracticabilities that were introduced by the technical aspects of the medium that we used to speak to each other.

Designing a medium of communication in between two spaces by constraints in language, could be one topic of work. In particular, when using speech recognition software, a small and insufficient dictionary could come in place to recognize just some hundred words out of a pre-given story. Those words could then be used to trigger audio and video events, or even mechanical devices.

There is some speech recognition software API, that I managed to run on my computer

[http://www.speech-recognition.de/matlab-examples2.html Speech recognition for Matlab]

[http://cmusphinx.sourceforge.net/sphinx4/ Sphinx4 (java based)] (this is also available in C++)

As a starting point, I experimented with a small chat program that I manipulated. It now displays google keywords instead of the text that the user enters.

Please feel free to try it: [http://www.headphonica.com/OTHER/TPJO/suggestive_chat/chat.php Suggestive chat]

===Workers===
[[/Clemens/]]

EKK:LoFi Sounds in HiFi Spaces/Working with language

2013-05-06T16:15:46Z

Cwegener: Created page with "==Working with language== This is more of a proposal of an explorative working topic than a sketch of a project. I was getting interested into the impracticabilities that were..."

==Working with language==

This is more of a proposal of an explorative working topic than a sketch of a project.

I was getting interested into the impracticabilities that were introduced by the technical aspects of the medium that we used to speak to each other.

Designing a medium of communication in between two spaces by constraints in language, could be one topic of work. In particular, when using speech recognition software, a small and insufficient dictionary could come in place to recognize just some hundred words out of a pre-given story. Those words could then be used to trigger audio and video events, or even mechanical devices.

There is some speech recognition software API, that I managed to run on my computer

[http://www.speech-recognition.de/matlab-examples2.html Speech recognition for Matlab]

[http://cmusphinx.sourceforge.net/sphinx4/ Sphinx4 (java based)] (this is also available in C++)

As a starting point, I experimented with a small chat program that I manipulated. It now displays google keywords related to the text that the user enters.

Please feel free to try it: [http://www.headphonica.com/OTHER/TPJO/suggestive_chat/chat.php Suggestive chat]

===Workers===
[[/Clemens/]]

EKK:LoFi Sounds in HiFi Spaces

2013-05-06T16:15:24Z

Cwegener:

[[:Category:Projektmodul|Projektmodul]] 
''Lecturers:'' [[Robin Minard]], [[/miller|Miller Puckette]], Katharina Rosenberger, [[/Shahrokh|Shahrokh Yadegari]], [[Ludger Hennig]], [[Max Neupert]] 
''Credits:'' 18 [[ECTS]], 16 [[SWS]] 
''Date:'' Monday, 18:00 until 21:30 h (due to the time difference to San Diego) 
''Venue:'' [[Coudraystraße 13a]], SeaM Werkstattstudio 
''First meeting:'' 15.04.2013

==Description==
The sensation of space through spatialized sound may be influenced by sources that differ in their quality and quantity. Within this project, we will investigate ways to modify, expand or augment how space can be experienced through sound. The outcome may be, for instance, an electroacoustic composition, a simulation of spatial perception, sonic architecture or a set-design as a virtual or performative environment.

This project is the beginning of a long-term cooperation between the Bauhaus-Universität Weimar and the University of California in San Diego. Partners in Weimar are Prof. Robin Minard and Ludger Hennig from the Studio for Electroacoustic Music (SeaM) and Max Neupert (Medial Environments). Partners in San Diego are Prof. Miller Puckette (Computer Music), Prof. Katharina Rosenberger (Music) and Prof. Shahrokh Yadegari (Theatre and Dance). Telematic classes will allow students from both faculties to work together. Classes will take place in Weimar in the evening, mid-morning in San Diego. The cooperation is funded by the German Academic Exchange Service (DAAD).

===German description===
Die Wahrnehmung von Raum durch verräumlichten Klang, kann durch Klangquellen beeinflusst werden, welche sich in ihrer Qualität und Quantität unterscheiden. In diesem Projekt werden wir untersuchen, auf welche Art wir die Erfahrung von Raum durch den Klang verändern, erweitern oder verbessern können. Das Ergebnis kann beispielsweise eine elektroakustische Komposition, eine Simulation einer räumlichen Wahrnehmung, klangliche Architektur oder ein Bühnenbild als virtuelle oder performative Umgebung sein.

Dieses Projekt ist der Beginn einer langfristigen Zusammenarbeit zwischen der Bauhaus-Universität und der Universität von Kalifornien in San Diego. Partner aus Weimar sind Prof. Robin Minard und Ludger Hennig vom Studio für Elektoakustische Musik (SeaM) und Max Neupert (Gestaltung medialer Umgebungen). Partner aus San Diego sind Prof. Miller Puckette (Computermusik), Prof. Katharina Rosenberger (Musik) und Prof. Shahrokh Yadegari (Theater und Tanz). Gemeinsamer Unterricht mit einer Videoverbindung wird es den Studierenden beider Universitäten ermöglichen, zusammen zu arbeiten. Der Unterricht wird in Weimar am Abend und vormittags in San Diego stattfinden. Die Zusammenarbeit wird vom Deutschen Akademischen Austauschdienst (DAAD) gefördert.

===Werk/Fachmodule===
We recommend the Werk/Fachmodul [[GMU:Dataflow II]] and/or Ludger Hennigs soundscapes class along with this Project module.

==Assignments==
# [[/Making connection/]] due 04-22
# [[/Mingling sounds/]] due 04-29
# [[/Textualize ideas/]] due 05-06
# [[/Proposing concepts/]] due 05-13

==Evaluation==
Active participation, presentation, artistic examination, documentation, edits in the wiki.

==Participants==
===Weimar===
* [[/Rico/]]
* [[/Alex/]]
* [[/Alice/]]
* [[/Jonas/]]
* [[/Andre/]]
* [[/Paul/]]
* [[/Ben/]]
* [[/Ludwigberger/]]
* [[/TimH/]]
* [[/Dorian/]]
* [[/Clemens/]]
* [[/Ives/]]
* [[/Cornelio/]]
* [[/Johannes/]]

* [[/Max/]] (you may use this as a template for your self-introduction)

===San Diego===
* [[/Brendan Bernhardt Gaffney/]]
* [[/Kevin/]]
* [[/Melanie/]]
* [[/Jeffrey/]]
* [[/Bo/]]
* [[/Andy/]]
* [[/Jamilah/]]
* [[/Marcelo/]]
* [[/Ryan Welsh/]]
* [[/ElisabetCurbelo/]]
* [[/Joe Cantrell/]]
* [[/czyskows/]]
* [[/NickDrashner/]]

* [[/miller/]]
* [[/Shahrokh/]]
* [[/CarolineMiller/]]

==Collaborative Projects==
* [[/Convergence/]]
* [[/Wind stream/]]
* [[/Body Instrument/]]
* [[/The Working System/]]
* [[/Expedition/]]
* [[/Immersive Collage/]]
* [[/Voice Matter/]]
* [[/Working with language/]]

==Syllabus==
ISO Standard: MONTH/DAY
# 04/01 Only in San Diego (Easter Monday is holiday in Germany; Robin, Ludger and Max join via Skype/Google+ Hangout) faculty presentations about technical means and/or artistic issues. Introduction to the wiki.
# 04/08 Only in San Diego – faculty presentations continued. Miller - Rasberry Pi as an audio and video platform. Shahrokh - Mugic protocol; video walls
# 04/15 First joint class
# 04/22 Robin, Ludger and Max are in San Diego
# 04/29
# 05/06
# 05/13
# 05/20
# 05/27 Only in Weimar (Memorial day in the U.S.)
# 06/03
# 06/10
# 06/17
# 06/24
# 07/01

==SAM connection==
We have two dedicated machines to facilitate the connection between the two places. In Weimar it is remote@141.54.193.23 (Linux Mint), in San Diego it is ideas@ideas-mac.ucsd.edu (OS X)

==Literature==
* Föllmer, Golo: Netzmusik, Wolke Verlag ISBN 3936000336
* LaBelle, Brandon: Background Noise ISBN 9780826418456
* LaBelle, Brandon: Site of Sound: Or Architecture and the Ear ISBN 978-0982743904
* Minard, Robin: Silent Music ISBN 978-3933257130
* Minard, Robin: Sound Installation Art
* Leitner, Bernard: Sound:Space ISBN 978-3893224449

Pd books:
{{Template:PdBooks}}

==Links==
* [https://groups.google.com/forum/#!forum/buw-ucsd-class Google Group BUW-UCSD-class]
* [https://puredata.info/docs/raspberry-pi Pure Data on the Raspberry Pi]

===Sending data over the network===
* [[OSC]]
* netsend/netreceive, netserver/netclient. In Pd look at <tt>mrpeach</tt> and <tt>iemnet libraries</tt>
* [http://ivl.calit2.net/wiki/index.php/StreamingGraphics Mugic]

===Sending Audio and Video over the Internet===
* [[wikipedia:Audio Video Bridging]] AVB is a set of standards for audio and video transmission by the IEEE

====Intended for Communcation====
* [http://www.skype.com Skype] [[File:Icon newtux 16x16.png]] [[File:Icon android 16x16.png]] [[File:Icon apple 16x16.png]] [[File:Icon windows8 16x16.png]]
* [https://tools.google.com/dlpage/hangoutplugin Google+ Hangout] [[File:Icon newtux 16x16.png]] [[File:Icon android 16x16.png]] [[File:Icon apple 16x16.png]] [[File:Icon windows8 16x16.png]] (Seems to work best in Chome/Chromium)
* [http://www.oovoo.com ooVoo] [[File:Icon android 16x16.png]] [[File:Icon apple 16x16.png]] [[File:Icon windows8 16x16.png]]
* [http://www.voxox.com voxox] [[File:Icon apple 16x16.png]] [[File:Icon windows8 16x16.png]]
* [http://line.naver.jp/en LINE] [[File:Icon android 16x16.png]] [[File:Icon apple 16x16.png]] [[File:Icon windows8 16x16.png]]
* [http://www.teamviewer.com TeamViewer] [[File:Icon newtux 16x16.png]] [[File:Icon android 16x16.png]] [[File:Icon apple 16x16.png]] [[File:Icon windows8 16x16.png]]
* [http://www.teamspeak.com TeamSpeak] [[File:Icon newtux 16x16.png]] [[File:Icon android 16x16.png]] [[File:Icon apple 16x16.png]] [[File:Icon windows8 16x16.png]]

Teleconferencing
* [http://www.polycom.com Polycom] [[File:Icon windows8 16x16.png]] System available in Weimar
* [http://www.radvision.com/Products/Video-Conference-Systems Radvision Scopia] [[File:Icon windows8 16x16.png]]
* [http://www.lifesize.com Livesize] [[File:Icon apple 16x16.png]] [[File:Icon windows8 16x16.png]] System available in San Diego

Unidirectional only (aka streaming)
* [http://giss.tv Global Independent Streaming Support], [http://giss.tv/wiki/index.php/Main_Page G.I.S.S wiki]
* [http://www.ustream.tv Ustream]
* [http://www.justin.tv justin.tv]
* [http://www.shoutcast.com/ shoutcast] also as vst plugin availlable

====Intended for Performance/Creative Use====
* [http://code.sat.qc.ca/redmine/projects/scenic/wiki/Scenic_fr Scenic] Audio and video in high quality, as well as MIDI [[File:Icon newtux 16x16.png]]
* [http://code.google.com/p/jacktrip JackTrip] [[File:Icon newtux 16x16.png]] [[File:Icon apple 16x16.png]] a network extension for [http://jackaudio.org/ Jack Audio Connection Kit] [[File:Icon newtux 16x16.png]] [[File:Icon apple 16x16.png]] [[File:Icon windows8 16x16.png]]
* [http://gstreamer.freedesktop.org GStreamer] and bindings for Pd: [http://umlaeute.mur.at/Members/zmoelnig/projects/pdgst PdGst] [[File:Icon newtux 16x16.png]]
* netsend~ for Max/MSP and Pd: [http://www.nullmedium.de/dev/netsend~ Olaf Matthes' Original Version] [[File:Icon newtux 16x16.png]] [[File:Icon apple 16x16.png]] [[File:Icon windows8 16x16.png]], [http://www.olivierguillerminet.com/portfolio/netsend Olivier Guillerminet's/Remu's Fork] [[File:Icon apple 16x16.png]] [[File:Icon windows8 16x16.png]]
* [http://code.google.com/p/streaming-audio Streaming Audio Manager (SAM)] by [https://ccrma.stanford.edu/~danielsm/research.html Michelle Daniels] [[File:Icon newtux 16x16.png]] [[File:Icon apple 16x16.png]] [[File:Icon windows8 16x16.png]]

===Performing Remotely===
* [http://www.netpd.org NetPd]
* [http://at.or.at/serendipd SerendiPd] collaborative patching

[[Category:SS13]]
[[Category:Projektmodul]]
[[Category:Robin Minard]]
[[Category:Miller Puckette]]
[[Category:Katharina Rosenberger]]
[[Category:Shahrokh Yadegari]]
[[Category:Ludger Hennig]]
[[Category:Max Neupert]]
[[Category:Pure Data]]
[[Category:Performance]]
[[Category:Community]]
[[Category:Max/MSP]]
[[Category:Telematic]]
[[Category:Coorperation]]

EKK:LoFi Sounds in HiFi Spaces/Working with Language

2013-05-06T16:12:41Z

==Working with language==

This is more of a proposal of an explorative working topic than a sketch of a project.

I was getting interested into the impracticabilities that were introduced by the technical aspects of the medium that we used to speak to each other.

Designing a medium of communication in between two spaces by constraints in language, could be one topic of work. In particular, when using speech recognition software, a small and insufficient dictionary could come in place to recognize just some hundred words out of a pre-given story. Those words could then be used to trigger audio and video events, or even mechanical devices.

There is some speech recognition software API, that I managed to run on my computer

[http://www.speech-recognition.de/matlab-examples2.html Speech recognition for Matlab]

[http://cmusphinx.sourceforge.net/sphinx4/ Sphinx4 (java based)] (this is also available in C++)

As a starting point, I experimented with a small chat program that I manipulated. It now displays google keywords related to the text that the user enters.

Please feel free to try it: [http://www.headphonica.com/OTHER/TPJO/suggestive_chat/chat.php Suggestive chat]

===Workers===
[[/Clemens/]]

File:Dictionary.png

2013-05-06T16:07:27Z

Cwegener:

== Summary ==

== Copyright status: ==

== Licensing ==
{{cc-by-sa-3.0}}
== Source: ==

EKK:LoFi Sounds in HiFi Spaces/Clemens

2013-05-06T00:49:54Z

Cwegener:

After finishing my bachelor degree in musicology, I'm now a student of Computer Science and Media at Bauhaus-Universität Weimar. I have been working in many different music related contexts, such as taking music history, classical music training, programming, djing, playing electronic live music and producing music for theater and dance.

<videoflash type=vimeo>17474435|500|280</videoflash>
This is an audio-video live performance in collaboration with Tommy Neuwirth and Max Neupert, where video samples of theater attendants were taken and played back in realtime.

<flashmp3>http://ia600303.us.archive.org/21/items/headphonica.hplive011/THE__Ruben_DHers__Confetti_live_at_Fusion_Festival_2010__07.mp3</flashmp3> 
Live recording with my band THE! at fusion festival 2010.
 
 

<videoflash type=vimeo>13094934|500|280</videoflash>
Music video of Manuel Birnbacher for my electronic music project "the plastic jazz orchestra".

==Platforms==
OS X, Pure Data, Matlab, Ableton Live, Max for Live

==Contact==
skype: clemens.wegener
mail: clemens.wegener a_t uni-weimar.de

==Project Ideas==
I'm was thinking a little about manipulating communication. I 'hacked' a small chat program, so that it would display related google search terms instead of the orignal messages:

feel free to try: [http://www.headphonica.com/OTHER/TPJO/suggestive_chat/chat.php Suggestive chat]

I think it would be more impressive to use audio data, so that microphones and speech recognition software comes in place.

A slightly different idea is communicating through small dictionaries – meaning that the computer only recognizes a small amount of words, but uses them for triggering some action within an installation.

EKK:LoFi Sounds in HiFi Spaces/Clemens

2013-05-06T00:48:53Z

Cwegener:

After finishing my bachelor degree in musicology, I'm now a student of Computer Science and Media at Bauhaus-Universität Weimar. I have been working in many different music related contexts, such as taking music history, classical music training, programming, djing, playing electronic live music and producing music for theater and dance.

<videoflash type=vimeo>17474435|500|280</videoflash>
This is an audio-video live performance in collaboration with Tommy Neuwirth and Max Neupert, where video samples of theater attendants were taken and played back in realtime.

<flashmp3>http://ia600303.us.archive.org/21/items/headphonica.hplive011/THE__Ruben_DHers__Confetti_live_at_Fusion_Festival_2010__07.mp3</flashmp3> 
Live recording with my band THE! at fusion festival 2010.
 
 

<videoflash type=vimeo>13094934|500|280</videoflash>
Music video of Manuel Birnbacher for my electronic music project "the plastic jazz orchestra".

==Platforms==
OS X, Pure Data, Matlab, Ableton Live, Max for Live

==Contact==
skype: clemens.wegener
mail: clemens.wegener a_t uni-weimar.de

==Project Ideas==
I'm was thinking a little about manipulating communication. I 'hacked' a small chat program, so that it would display related google search terms instead of the orignal messages:

[http://www.headphonica.com/OTHER/TPJO/suggestive_chat/chat.php Suggestive chat]

I think it would be more impressive to use audio data, so that microphones and speech recognition software comes in place.

A slightly different idea is communicating through small dictionaries – meaning that the computer only recognizes a small amount of words, but uses them for triggering some action within an installation.

EKK:LoFi Sounds in HiFi Spaces/Clemens

2013-04-20T18:29:29Z

Cwegener:

EKK:LoFi Sounds in HiFi Spaces/Clemens

2013-04-20T18:27:59Z

Cwegener: