GMU:Breaking the Timeline/projects

Projects from the course Breaking the Timeline, a Fachmodul by Max Neupert, Gestaltung medialer Umgebungen Summer Semester 2010:

Kyd Campbell:

concept

I'm interested in exploring time-related breaks between the senses of sight and hearing. I believe there is a sensory gap when one moves in perception between the spaces of micro and macro. In this instance, time and sound are stretched, as the body adjusts to receiving intense macro detail. A journey/passage from one time/space environment to another is an overwhelming experience, a momentary loss of one's self into an aesthetic space, which may be considered cathartic.

In my work I wish to turn this phenomena into a public experience. It is my goal to produce the conditions, in a performance/screening setting for the audience to feel lost in the aesthetic space between micro and macro. I will use HD video images in micro and macro visions and unique techniques for recording motion. In the final work I will move rapidly between different image positions and search to bring and then hold the audience into a hyper-sensory experience.

I will take a minimal approach to sound, reminiscent of breath and focusing on silence to imply motion and change, remaining abstract.

The imagery will be taken from very textured manufactured objects and from nature, outdoors and animals in very high resolution.

process

UPDATE: 20 June.2010 <flashmp3 id="Tape_sounds8.mp3">Tape_sounds8.mp3|parameter=value|...</flashmp3>
I have recorded the numen/foruse team building up a large installation of plastic packing tape in the Tempelhof airport in Berlin, for the Design fair. I am now using this footage (very short clips) and the sound from them. I will create tape sounds myself in front of my computer microphone, with a projection behind. and a PD patch will relate the sounds made to the sounds in small video clips, creating visuals which jump between different clips of my recorded footage of the designers making their tape sculpture. It will be a loud, noisy performance. I used PureData to analyze the volume of sounds from a microphone and call up pre-numbered audio and video files.

Tape Pic 1

<videoflash type=vimeo>12737337|300|230</videoflash>

<videoflash type=vimeo>12737800|300|230</videoflash>

• 
• 
• 

  Still

video documentation video on the way

progress

On September 25th I will perform TAPE at TodaysArt festival in Den Haag. I will continue to develop the interface and AV materials until then.

Andreas Beyer: Prosody

the keyword for this projekt is "prosody", that means the science about rhythm, stress and intonation of speech. I'll try to manipulate any given speech with a specific overlay to generate a new meaning or a strange combination of content and meaning e.g. reading the telephonbook like a holy speech and so on. The "overlayed" "structure" is given by the performer and the imput will be live. I want to realize this with a pd patch that i have to write or build till the semester. The background is a theorie that any kind of speech independent from the cultural background could be identified by anybody because of the intonation, the speech, the pitch (political, religious, news, sport, and so on) - this instrument could be used as a "translater" of the cultural melody of the voice or just to play with different meaning. It is the other way around how an anchorman works, he is trying to speak any typ of news in any combination more or less neutral - this is more difficult than it sounds.

Anja Erdmann:

- in this class i will get to work on "Schatten→Klang"

• GMU:Audio+Video/projekte/Schatten→Klang

Dominique Wollniok:

Skizze

Idee

In einem Raum kann man durch Bewegung Geräusche auslösen. Von einem Bild ausgehend, liegen die Geräusche in verschiedenen Ebenen. Durch mehrere Lautsprecher entsteht eine räumliche Klanglandschaft. Der Besucher erfühlt die akustische Umwelt und kann sie durch seine Bewegungen beeinflussen.

Ziel

Ziel ist es eine akustische Topographie einer Landschaft auf ein sich im Raum befindliches Raster zu übertragen. Der Körper des Besuchers ist Auslöser der Geräusche. Inhalt ist das Zusammenspiel von akustischem Raum und dem Körper darin. Durch Reproduktion der Klanglandschaft in detailreiche Einzelgeräusche erlebt man eine Landschaft anders. Es entsteht ein anderer, interaktiver Zugang zur Landschaft.

Ton

Die Soundscape besteht aus der gesamten Geräusche-Umwelt und ihre Einzelheiten. Die Einzelgeräusche sollen so konstruiert werden, dass sie im Kontext zur gesamten Soundscape bestehen bleiben. Die Ton-Ausgabe geschieht über eine 5.1 Anlage.

Tracking

Ausgehend von einem nicht sichtbaren Raster auf dem Boden, werden bestimmte Sounds ausgelöst. Ist man weit vom Bild entfernt, nimmt man die Soundscape als Gesamtes wahr. Je näher man an das Bild herantritt, desto mehr bekommt man den räumlichen Eindruck vom Bild. Man geht sozusagen in das Bild hinein. Einzelne Geräusche werden durch entsprechende Positionen ausgelöst. Das geschieht über ein Tracking in x-y-Ausrichtung. Außerdem soll die Geschwindigkeit getrackt werden. Je langsamer eine Bewegung geschieht, desto länger soll der Übergang von einem Geräusch ins andere sein.

• 
• 

Anstehende Tests:

• Geräusch-Selektion einer Soundscape
• Lautsprecher-Aufstellung
• Foto oder Video der Ausgangslandschaft
• Rasterform (Drei- oder Viereck) für Tracking

Hyun Ju Song: a emotion switcher

1. Abstract
   Everyone has emotions. Though emotions are easily influenced by the circumstance, who governs emotions is the person himself.
   
2. Principle
   There are 4 monitors(or digitalframes). Each monitor shows a same person’s expressionless face. In front of monitors 4 interfaces are located and have own emotional expression(joy, sorrow, pleasure, pain). By controlling the interfaces, the emotions of human in monitors are changed.

• 

  idea sketch

• 

  test - anger

Jeffers Egan:

Theory

Viewing Live AV as a platform for experimentation, my live sets explore the inscription of visual culture in time. By utilizing custom algorithms and animation software and without the use of prerecorded video or still footage, these works result in a hyperreal fluidity of visual mutations, ranging from tightly synchronized passages, to moments of free improvisation. Developing the concepts of digital as organism and software as ecosystem, my sets create a focused, personal aesthetic, finding commonalities in tone, texture and movement between audio and visual elements.

Practice

I have been invited to perform Live Visuals with vidderna, at ROJO/NOVA, a multimedia event this July in São Paulo, Brazil. We will play a 1 hour show together at an event alongside other AV acts.

Technically I am building a visual instrument in Touch Designer, . For the performance with vidderna, I plan to add a HD multi-movie stream compositing system(with alpha), a 3D timeline, and build/consolidate some GLSL shaders into 2D filters I can use in the compositing system.

I will also create new artwork specifically for this performance.

Matthias Breuer: Deconstructing the truth

The project focuses on the truth and reality of the images we see. Taking any kind of video source as input, the stream's audio channel is continously played back. The corresponding frame is calculated from similarity to all previous frames. The most similar frame will be displayed. Each new frame is then placed in a database for comparison with forthcoming frames. This creates a steadily growing and learning mass which—after some time—can replace reality with frames from the past. At that point no clear distinction between reality and fiction can be made anymore.

Similarity between frames depend on an amount of chosen factors. Most commmon are histogram, structure etc. but always depend on the features one sees as important in an image. It's not important to match the look of a frame as close as possible but to match a frame in a given set of interests.

Progress

Searching the most similar frame to the current frame in the same source doesn't work so well. In a movie the next or previous frame to the current frame is almost always the most similar one. This results in the same video delayed oen frame. Using two sources and matching source1 to source2 works better.

Two different sources. Images are from source2, audio is from source1. Images are selected from source2 not only from similarity to the current frame of source1, but also from the overall difference to the previous frame, resulting in smoother image sequences that somtimes might be reversed. (source1 is Ger vs Aus, source2 is Ger vs Srb) <videoflash type=vimeo>12747037|430|236</videoflash>

This is the Tagesschau (tagesschau.de/download/podcast/). Source1 (Tagesschau 25.06.2010 20:00) is compared with Source2 (Tagesschau 24.06.2010 20:00). Audio is from Source1, images from Source2. Again this is similarity by distance to the previous frame. <videoflash type=vimeo>12887221|430|236</videoflash>

More/older videos

References:

• Bernhard Hopfengärtner: Tanzmaschine
• Sven König: sCrAmBlEd?HaCkZ!
• Perry Bard: global remake project
• Beom Kim: Untitled (News), 2002
• Harun Farocki: Deep Play, 2007, Deep Play on Rhizome
• Purgand/Neumaier/Neupert: Tipp-Kick Spiel, 2004

Maureen Anderson: Ulysses

The Starting Point

James Joyce spent 7 years writing a story that takes place on June 16, 1904, the day he met his future wife. It is the product of his attempt to depict the haphazrdness of thought and action of Leopold Bloom as they occur in their own separate and distinctive versions of "real time" in turn of the 20th century Dublin. Though Ulysses depicts a kind of disorder of what has come to be called "stream of consciousness," a concept of real time as something already broken and fractured for which it can depict in its wholeness by means of depicting its fractured nature, it is one of the most rigorously structured works of modern fiction, but one which does not exist in a "definitive edition."

The Experiment

I will be working with speech-to-text dictation software to re-write Joyce's Ulysses. Though current speech-to-text software has acchieved a high level of accuracy over the years, interesting mistakes happen in relation to Joyce's text.

Due to problems of censorship in the US and UK, and the publication and dissemination of the text in pieces, an accurate or authentic edition of Ulysses has never existed. It was changed and manipulated by it's first editor, by Joyce's inability to be a faithful transcriber of his own work due to failing eyesight and a writer's inclination to re-write complete sections 3 or 4 times. The first German translator of Ulysses went beyond mere translation or even interpretation when he ended up changing and adding his own material to a text that can be impossible to translate in the first place. I will start by using the 1922 first edition and the academic standard 1962 edition. In the future, it would be interesting to work with translations of Ulysses. The speech-to-text dictation software I've been using has given similar results.

James Joyce was very concerned with the spoken and the aural, and their relation to the written form. Joyce is often considered and discussed as having the largest lexicon of any writer known. Ulysses alone consists of 265,000 words and a lexicon of 30,030 words covering a broad range of English, foreign, and invented words and sounds. But it was his attention to the auditory, that might explain such an expansive search through the written form of many languages that drove him to develop such a large vocabulary. With this in mind, it was the open language and way of oral expression of Dublin at the turn of the last century that Joyce attempted to acurately depict: its slang, its grunts, its unfinished sentences. In the development of speech-to-text dictation software at the turn of the 21 century there is an odd Joycean understanding of languages. Voice recognition software has been developed to recognize quite a number of individual languages that can be recognized in separate vocabulary databanks or dictionary files, but they are often further broken down by specialization, accent or region including a separate category for "American teen."

While running tests it has often occurred that many words and phrases from Ulysses were matched with those from a contemporary American lexicon:

answered through the calm...answered.com

come up, Kinch...cut low jeans

Buck Mulligan...black militant

Introibo ad altare Dei...NGO well at all that day

and made...MAO (as in Monoamine Oxidase inhibitor)

This seems to reafirm, in a disassociated way, Joyce's account of himself as a "scissors and paste man" of writing and that our words are hardly ever our own.

Suggestions

• Peter Dittmer: Die Amme
• Applescript

--max 17:39, 10 June 2010 (UTC)

There is this reproduction of the first edition by Orchises Press which looks similar [1]. Maybe you can ask them about the typeface, it looks the same as the original. --Matthias.breuer 08:30, 1 July 2010 (UTC)

Natercia Chang: Mutually Intelligible

Background

1. I remember the first few meetings and classes when I got here last semester, they were all in German. And without any knowledge in the German language, it sounded like noises to me and I started making up the content when they talked. The initial idea that I came up was to film some of the lectures and edit subtiles on the images, which would be totally unrelated to the acutal content that they were discussing.
2. I have been attending lectures and workshops that are held almost entirely in German. To me, sitting in a classroom for more than 6 hours and listening to something not comprehensible at all is kind of a torture. Similarily, I am also interested to find out how would a person feels when he/she is forced to listen to something not in his/her first language.
3. The expereince of watching movies here in Germany is pretty hard because most of the movies, they are synchronised with German language instead of screening the original audio version.

Concept

1. Select a (or some) German movies and extract some of the scenes and/or shots without the audio
2. Select a collection of foreign movies and extract the audio (dialogue) from some of the scenes and/or shots
3. Synchronise the extracted images and audio and export it as a short video
4. Create a booth that contains monitor and keyboard buttons that one can select languages (no German available) for viewing the video.

(I do not know the technical parts to build a booth with sensory buttons...)