Medien Wiki - User contributions [en]

GMU:Critical VR Lab I - Unity Introduction/Konrad Behr

2021-03-30T18:54:29Z

Krnd: /* Project 3 */

== Project 1 ==

'''Preview of "Radio Dance 3D"'''

"Radio Dance 3D" is an invisible dance performance, acousmatic composition and live radio performance. The basis of "Radio Dance 3D" is a score developed by Konrad Behr with the dancer Emelie Bardon in the winter of 2018 at the Studio For Electroacoustic Music Weimar (seam.hfm-weimar.de). With the focus of the sounds a human body causes while performing a modern dance piece, both artists co-created a composition for one dancer.

'''Recommended for headphones!'''

<embedvideo service="youtube">https://www.youtube.com/watch?v=73BU_Y8e3S0</embedvideo>

===details===
# I places several sound sources and video material at the virtual performance place
# 4 sources with the recording of the live performance at seam
# 2 descriptions (english/swedish)
# video of "behind the stage" documentation
# graphical score with marker following in time

More about the project in general: [https://konrad-behr.de/projekt-radio-dance www.konrad-behr.de/projekt-radio-dance]

== Project 2 ==

'''Project sound particles'''

For my music electronic/dub project “bad comfort” I wanted to create a new way of spatialization of the sound sources. To have a new experience in listening to my music, I tried to map parts of my composition to objects at the virtual Unity world. I general, my way of producing music under my moniker “bad comfort” is marked by randomizing of almost all musical parameters. For this kind of organic sound aesthetic I wanted to create a immersive stage where all sounds are able to move in space to have a binaural experience by listening to headphones.

[[File:Screenshot jeskola buzz 1.jpeg]]

Two channel stereo version of the song "150309-05":

[[File:Bad comfort - 150309-05-scetch.ogg]]

To extract all sound of my pre existing song, I had to rearrange my sound patch which I created with the software [http://jeskola.net/buzz/ Jeskola Buzz]. Therefore I had to reconnect all sound sources to the master output to create mono sound files of each sound.

[[File:Screenshot jeskola buzz 2.jpeg]]

I had to decide which sound effect I want to render into this mono file and which “room” effect will be created from the Unity reverb effect. I decided to use the Unity reverb effect only. All glitch and delay effects where baked into the mono file. To have a visual control to the sound I imported the files at the DAW Reaper.

[[File:Screentshots-reaper-sound-particals.jpg]]

Now I had to connect all this mono files to virtual sound sources in my Unity project. To have also an optical experience I also connected some simple objects to the sound sources. To visualize the path of the “flying sounds” I used the component “Tail Renderer”. So every sound hat some kind of tail behind the sound. To create a immersive experience in sound I had to move now all the sounds with the Animator function of Unity. I also created objects like a huge movable ball at which I connected to some basic sounds. Those objects could also collide to the border of the stage, on to each other and to the virtual visitor. The camera was connected to a FPS controller which made the visitor possible to walk around in sound.

[[File:Screentshots-unity-sound-praticals-scetch.jpg]]

In a early stage the colour of the “sound objects” were different in a later version I decided to make everything in black and white because it simply looked somehow too childish.

[[File:Screentshots-unity-sound-praticals-minimal.jpg]]

In this stage of the project I have to say especial the visual component of the experience is not very innovative. I hoped that the spatialization of the sound in connection to the visual objects a new way of listening could happened.

Unitiy version of the song "150309-05"

<embedvideo service="youtube">https://youtu.be/UWNMgUPRjXU </embedvideo>

At the moment it looks like a screen saver of an operation system from 1995. May be using VR-Glasses and a head tracking audio system makes a new immersive moment. Until now I see more aesthetic problems the new artistic horizons.

More music from bad comfort: [https://soundcloud.com/knrd/sets/bad-comfort soundcloud.com/knrd]

== Project 3 ==

A non-Unitiy, but somehow VR-related project I worked on this semester was a 360-degree guided tour through the vacant building "Lehngericht" in Augsburg Saxony. Motivated and inspired by the input from the Critical VR Lab course, I borrowed a 306° camera and tried to photograph all the rooms. Challenging was the fact of no electricity - especially in the basement. After creating this guide, I placed a QR code with the URL to this website at the main entrance. I hope that the people of Augustusburg will take advantage of this chance to see the building from the inside and use it again for cultural purposes. For embedding of the VR-Pictures I used the [https://wordpress.org/plugins/ipanorama-360-virtual-tour-builder-lite iPanorama 360 WordPress Virtual Tour Builder] plug-in.

[[File:Vr-gericht.jpg ]]

[https://augustusburg.blog/ipanorama/virtualtour/1 https://augustusburg.blog/ipanorama/virtualtour/1]

GMU:Critical VR Lab I - Unity Introduction/Konrad Behr

2021-03-30T18:53:40Z

Krnd:

GMU:Critical VR Lab I - Unity Introduction/Konrad Behr

2021-03-30T18:52:00Z

Krnd:

== Project 1 ==

'''Preview of "Radio Dance 3D"'''

"Radio Dance 3D" is an invisible dance performance, acousmatic composition and live radio performance. The basis of "Radio Dance 3D" is a score developed by Konrad Behr with the dancer Emelie Bardon in the winter of 2018 at the Studio For Electroacoustic Music Weimar (seam.hfm-weimar.de). With the focus of the sounds a human body causes while performing a modern dance piece, both artists co-created a composition for one dancer.

'''Recommended for headphones!'''

<embedvideo service="youtube">https://www.youtube.com/watch?v=73BU_Y8e3S0</embedvideo>

===details===
# I places several sound sources and video material at the virtual performance place
# 4 sources with the recording of the live performance at seam
# 2 descriptions (english/swedish)
# video of "behind the stage" documentation
# graphical score with marker following in time

More about the project in general: [https://konrad-behr.de/projekt-radio-dance www.konrad-behr.de/projekt-radio-dance]

== Project 2 ==

'''Project sound particles'''

For my music electronic/dub project “bad comfort” I wanted to create a new way of spatialization of the sound sources. To have a new experience in listening to my music, I tried to map parts of my composition to objects at the virtual Unity world. I general, my way of producing music under my moniker “bad comfort” is marked by randomizing of almost all musical parameters. For this kind of organic sound aesthetic I wanted to create a immersive stage where all sounds are able to move in space to have a binaural experience by listening to headphones.

[[File:Screenshot jeskola buzz 1.jpeg]]

Two channel stereo version of the song "150309-05":

[[File:Bad comfort - 150309-05-scetch.ogg]]

To extract all sound of my pre existing song, I had to rearrange my sound patch which I created with the software [http://jeskola.net/buzz/ Jeskola Buzz]. Therefore I had to reconnect all sound sources to the master output to create mono sound files of each sound.

[[File:Screenshot jeskola buzz 2.jpeg]]

I had to decide which sound effect I want to render into this mono file and which “room” effect will be created from the Unity reverb effect. I decided to use the Unity reverb effect only. All glitch and delay effects where baked into the mono file. To have a visual control to the sound I imported the files at the DAW Reaper.

[[File:Screentshots-reaper-sound-particals.jpg]]

Now I had to connect all this mono files to virtual sound sources in my Unity project. To have also an optical experience I also connected some simple objects to the sound sources. To visualize the path of the “flying sounds” I used the component “Tail Renderer”. So every sound hat some kind of tail behind the sound. To create a immersive experience in sound I had to move now all the sounds with the Animator function of Unity. I also created objects like a huge movable ball at which I connected to some basic sounds. Those objects could also collide to the border of the stage, on to each other and to the virtual visitor. The camera was connected to a FPS controller which made the visitor possible to walk around in sound.

[[File:Screentshots-unity-sound-praticals-scetch.jpg]]

In a early stage the colour of the “sound objects” were different in a later version I decided to make everything in black and white because it simply looked somehow too childish.

[[File:Screentshots-unity-sound-praticals-minimal.jpg]]

In this stage of the project I have to say especial the visual component of the experience is not very innovative. I hoped that the spatialization of the sound in connection to the visual objects a new way of listening could happened.

Unitiy version of the song "150309-05"

<embedvideo service="youtube">https://youtu.be/UWNMgUPRjXU </embedvideo>

At the moment it looks like a screen saver of an operation system from 1995. May be using VR-Glasses and a head tracking audio system makes a new immersive moment. Until now I see more aesthetic problems the new artistic horizons.

More music from bad comfort: [https://soundcloud.com/knrd/sets/bad-comfort soundcloud.com/knrd]

== Project 3 ==

A non-Unitiy, but somehow VR-related project I worked on this semester was a 360-degree guided tour through the vacant building "Lehngericht" in Augsburg Saxony. Motivated and inspired by the input from the Critical VR Lab course, I borrowed a 306° camera and tried to photograph all the rooms. Challenging was the fact of no electricity - especially in the basement. After creating this guide, I placed a QR code with the URL to this website at the main entrance. I hope that the people of Augustusburg will take advantage of this chance to see the building from the inside and use it again for cultural purposes. For embedding of the VR-Pictures I used the [https://wordpress.org/plugins/ipanorama-360-virtual-tour-builder-lite iPanorama 360 WordPress Virtual Tour Builder] plug-in.

[https://augustusburg.blog/ipanorama/virtualtour/1 [File:Vr-gericht.jpg ]]

File:Vr-gericht.jpg

2021-03-30T18:49:00Z

Krnd:

== Summary ==

== Copyright status: ==

== Source: ==

2020-12-22T13:46:30Z

Krnd:

2020-03-12T19:32:19Z

Krnd:

== "Car chase" by Konrad Behr ==

<embedvideo service="vimeo">https://vimeo.com/392177952</embedvideo>

„Car chase“ is a Super Cut of footage of Police pursuits broadcast by US-American television stations. The editing is based on search words and phrases of the original live comments of the helicopter pilots and news reporters at the studio. To make the workflow more efficient I used the automatic subtitle function the YouTube footage. Scanning for search terms like “dangerous”, “you see ...” and emotional reactions like “Wow” or “Ohh” of the commentators presorted the material. To lead the viewers focus in to the material I organized the editing starting from silent watching to a peak of accidents back to the top view.

The video shows the morally questionable live description between "Attention, there is danger there" to "We'll stay on until the end". The high probability of a violent end of the chase combined with the hint "viewer description is advised" and the expectant reactions of news reporters in case of a "close call" produces a dubious media event.

Work process:

#YouTube research for car chase videos.
# Download YouTube video file using command tool “youtube-dl”
[https://github.com/ytdl-org/youtube-dl]
3. extract srt subtitle file using web service downsub
https://downsub.com
4. Importing video file and srt file using DAW Reaper and Reaper extension software package SWS
http://reaper.fm/
https://www.sws-extension.org/
5. Filter timeline regions after keywords (e.g. “dangerous”) using filter function of Reaper
6. Select IN and OUT points of wanted phrase or word as Region and mark them
7. Export filtered marked sections as mp4 video with useful names (all files with “dangerous” as ‘dangerous_[regionnumber].mp4’
8. Import all the new created clips into video editing software
9. combine clips with certain keywords randomly or after visual aesthetically or word content
10. render final video as master file

2020-01-20T11:36:33Z

Krnd: /* Links */

''Lecturer:'' [[GMU:Max Neupert|Max Neupert]] 
''Credits:'' 6 [[ECTS]], 4 [[SWS]] 
''Date:'' Mondays, 09:15-12:30 
''Venue:'' [[Marienstraße 7b]], [[Marienstraße 7b/204|Raum 204]] 
''First meeting:'' Monday, 14th of October 09:15-12:30 
Course language is English

==Procedural Cut: Algorithmic Micro-editing==
Micro-editing is a technique of rearranging tiny fragments of media to form a new work. In the context of music, [[wikipedia:Microhouse|microhouse]] is a subgenre of house which employs this technique. [[wikipedia:Akufen|Akufen]]'s ''Deck the House'' from 2002 may serve as an example. In the context of experimental film, [[wikipedia:Martin Arnold|Martin Arnold]] compiled his 1989 montage “Pièce Touchée” entirely from found-footage by copying frames in a specific order with an [[wikipedia:Optical printer|optical printer]], emphasizing and amplifying gestures from the original movie. [[wikipedia:Steina und Woody Vasulka|Steina Vasulka]], [[wikipedia:Kurt Hentschlager#Granular-Synthesis|Granular Synthesis]] and many other artists followed in exploring an aesthetic of deconstruction and reassembly of the timeline in moving images. In pop culture this “audiovisual cut-up” was used to expand the visual language of music clips and to have the audiences of live performances spellbound. Micro-edits are used in different contexts ranging from media art, experimental film-making to music clips and advertising.

Digital video has become an almost infinite source of to-be-found-footage which is accessible to anyone, anytime through platforms like YouTube, which are essentially databases for moving images of almost any kind. They enabled pop culture phenomenons like [[wikipedia:Supercut|supercuts]]: compilations of short shots of the same action, or [[wikipedia:YouTube Poop|YouTube Poop]] mashups of videos with a comical and at times immature humour:

Today, meta information, close captions, machine learning analysis and music information retrieval can provide the means to generate automated edits. Real-time reassembly of media fragments based on databases, feature extraction or meta-information has become entirely feasible.

In the class ''Procedural Cut: Algorithmic Micro-editing'' we will learn to let algorithms cut and edit.

This class builds upon two previous classes: [[GMU:Breaking the Timeline]] and [[GMU:Bits, Beats & Pieces]].
No previous knowledge is required.

==Syllabus==
# 2019-10-21 [[/Early Montages and Flicker/]]
# 2019-10-28 [[/Supercuts/]]
# 2019-11-04 Lecture Joachim Goßmann
# 2019-11-11
# 2019-11-18
# 2019-11-25
# 2019-12-02
# 2019-12-09 [[/Musical recombinations/]]
# 2019-12-16
# 2020-01-06
# 2020-01-13
# 2020-01-20
# 2020-01-27
# 2020-02-03 Presentation
# 2020-02-10 Possible extra meeting to make up for the late start

==Assignments==
# [[/Assignment Supercut/]]
# [[/Assignment Sequence/]]
# [[/Assignment Object Recognition/]]
# [[/Assignment Subtitle Automate/]]

== Files==
* [https://github.com/BauhausUniversity/cuttlefish/tree/master Cuttlefish] Python scripts and tools
* [[Audiovideo]] Pure Data Workshop

== Links ==
* [https://medium.com/janbot/a-brief-history-of-algorithmic-editing-732c3e19884b Clint Enns: A Brief History of Algorithmic Editing]
* http://thisunruly.com
* http://reorder.tv
* https://www.reclaimingremix.com
* [https://journal.transformativeworks.org/index.php/twc/article/view/371/299 A history of subversive remix video before YouTube: Thirty political video mashups made between World War II and 2005]
* [[wikipedia:Edit decision list]] EDL
* [[wikipedia:Regular expression]] Online regex tester: [https://regex101.com RegEx101]
* David Claerbout - The pure necessity
https://www.instagram.com/p/B3nHj-MgEyj/
https://davidclaerbout.com/The-pure-necessity-2016

== Software ==
* [[Audio tools]]
* [[Video tools]]

* [https://code.visualstudio.com Microsoft Visual Studio Code] Editor (open source)
** [https://vscodium.com VSCodium] Visual Studio Code without the Microsoft telemetry (open source)

* [https://www.videolan.org VLC] Media Player (helps you downloading YouTube videos: copy YouTube URL, open in VLC as network stream, then go to Tools -> Media Information, copy the Location and paste back into the Browser from where you can save it) (open source)
* [https://downsub.com downsub.com] Web service to get the subtitles from a YouTube video (web-service)
* [http://www.aegisub.org Aegisub] Subtitle Editor (open source)
* [https://www.praxislive.org Praxis Live] (open source)
* [https://python.org Python] (great [https://www.youtube.com/watch?v=_uQrJ0TkZlc video tutorial] for beginners) (open source)
** [https://pyscenedetect.readthedocs.io PySceneDetect] can autonatically detect scene changes in video and segment footage into clips (open source)
** [https://jupyter.org Jupyter Notebook] (open source)

* [https://pjreddie.com/darknet/yolo/ YOLO: Real-Time Object Detection] (open source)
* [https://github.com/deepfakes/faceswap Deepfakes Faceswap] (open source)
* [https://github.com/apreshill/bakeoff apreshill/bakeoff] (open source)
* [https://github.com/NVlabs/few-shot-vid2vid NVlabs/few-shot-vid2vid] (open source)

==See also==
* [[Open Frameworks]]
* [[Processing]]
* [[Pure Data - Getting started]]

[[Category:Max Neupert]]
[[Category:WS19]]
[[Category:Fachmodul]]

GMU:Procedural Cut

2020-01-20T11:34:56Z

Krnd: /* Links */

''Lecturer:'' [[GMU:Max Neupert|Max Neupert]] 
''Credits:'' 6 [[ECTS]], 4 [[SWS]] 
''Date:'' Mondays, 09:15-12:30 
''Venue:'' [[Marienstraße 7b]], [[Marienstraße 7b/204|Raum 204]] 
''First meeting:'' Monday, 14th of October 09:15-12:30 
Course language is English

==Procedural Cut: Algorithmic Micro-editing==
Micro-editing is a technique of rearranging tiny fragments of media to form a new work. In the context of music, [[wikipedia:Microhouse|microhouse]] is a subgenre of house which employs this technique. [[wikipedia:Akufen|Akufen]]'s ''Deck the House'' from 2002 may serve as an example. In the context of experimental film, [[wikipedia:Martin Arnold|Martin Arnold]] compiled his 1989 montage “Pièce Touchée” entirely from found-footage by copying frames in a specific order with an [[wikipedia:Optical printer|optical printer]], emphasizing and amplifying gestures from the original movie. [[wikipedia:Steina und Woody Vasulka|Steina Vasulka]], [[wikipedia:Kurt Hentschlager#Granular-Synthesis|Granular Synthesis]] and many other artists followed in exploring an aesthetic of deconstruction and reassembly of the timeline in moving images. In pop culture this “audiovisual cut-up” was used to expand the visual language of music clips and to have the audiences of live performances spellbound. Micro-edits are used in different contexts ranging from media art, experimental film-making to music clips and advertising.

Digital video has become an almost infinite source of to-be-found-footage which is accessible to anyone, anytime through platforms like YouTube, which are essentially databases for moving images of almost any kind. They enabled pop culture phenomenons like [[wikipedia:Supercut|supercuts]]: compilations of short shots of the same action, or [[wikipedia:YouTube Poop|YouTube Poop]] mashups of videos with a comical and at times immature humour:

Today, meta information, close captions, machine learning analysis and music information retrieval can provide the means to generate automated edits. Real-time reassembly of media fragments based on databases, feature extraction or meta-information has become entirely feasible.

In the class ''Procedural Cut: Algorithmic Micro-editing'' we will learn to let algorithms cut and edit.

This class builds upon two previous classes: [[GMU:Breaking the Timeline]] and [[GMU:Bits, Beats & Pieces]].
No previous knowledge is required.

==Syllabus==
# 2019-10-21 [[/Early Montages and Flicker/]]
# 2019-10-28 [[/Supercuts/]]
# 2019-11-04 Lecture Joachim Goßmann
# 2019-11-11
# 2019-11-18
# 2019-11-25
# 2019-12-02
# 2019-12-09 [[/Musical recombinations/]]
# 2019-12-16
# 2020-01-06
# 2020-01-13
# 2020-01-20
# 2020-01-27
# 2020-02-03 Presentation
# 2020-02-10 Possible extra meeting to make up for the late start

==Assignments==
# [[/Assignment Supercut/]]
# [[/Assignment Sequence/]]
# [[/Assignment Object Recognition/]]
# [[/Assignment Subtitle Automate/]]

== Files==
* [https://github.com/BauhausUniversity/cuttlefish/tree/master Cuttlefish] Python scripts and tools
* [[Audiovideo]] Pure Data Workshop

== Links ==
* [https://medium.com/janbot/a-brief-history-of-algorithmic-editing-732c3e19884b Clint Enns: A Brief History of Algorithmic Editing]
* http://thisunruly.com
* http://reorder.tv
* https://www.reclaimingremix.com
* [https://journal.transformativeworks.org/index.php/twc/article/view/371/299 A history of subversive remix video before YouTube: Thirty political video mashups made between World War II and 2005]
* [[wikipedia:Edit decision list]] EDL
* [[wikipedia:Regular expression]] Online regex tester: [https://regex101.com RegEx101]
* David Claerbout - The pure necessity https://www.instagram.com/p/B3nHj-MgEyj/ + https://davidclaerbout.com/The-pure-necessity-2016

== Software ==
* [[Audio tools]]
* [[Video tools]]

* [https://code.visualstudio.com Microsoft Visual Studio Code] Editor (open source)
** [https://vscodium.com VSCodium] Visual Studio Code without the Microsoft telemetry (open source)

* [https://www.videolan.org VLC] Media Player (helps you downloading YouTube videos: copy YouTube URL, open in VLC as network stream, then go to Tools -> Media Information, copy the Location and paste back into the Browser from where you can save it) (open source)
* [https://downsub.com downsub.com] Web service to get the subtitles from a YouTube video (web-service)
* [http://www.aegisub.org Aegisub] Subtitle Editor (open source)
* [https://www.praxislive.org Praxis Live] (open source)
* [https://python.org Python] (great [https://www.youtube.com/watch?v=_uQrJ0TkZlc video tutorial] for beginners) (open source)
** [https://pyscenedetect.readthedocs.io PySceneDetect] can autonatically detect scene changes in video and segment footage into clips (open source)
** [https://jupyter.org Jupyter Notebook] (open source)

* [https://pjreddie.com/darknet/yolo/ YOLO: Real-Time Object Detection] (open source)
* [https://github.com/deepfakes/faceswap Deepfakes Faceswap] (open source)
* [https://github.com/apreshill/bakeoff apreshill/bakeoff] (open source)
* [https://github.com/NVlabs/few-shot-vid2vid NVlabs/few-shot-vid2vid] (open source)

==See also==
* [[Open Frameworks]]
* [[Processing]]
* [[Pure Data - Getting started]]

[[Category:Max Neupert]]
[[Category:WS19]]
[[Category:Fachmodul]]