GMU:VR Experience Designers/Lefteris Krysalis

From Medien Wiki

FugueStateVR

App for android built in Unity.

Screenshot 20190330-160059.jpg Screenshot 20190330-160108.jpg

You can download the app from my uni cloud. [1] password: FugueStateVR

Concept

Coming from the field of experimental radio, I was thinking how expensive could it be some times to experience a sound piece or a radio play in 3D sound considering the present technology.

So, FugueStateVR is a little experiment of how platforms like Unity and generally tools created for visual works with devices that everyone has got nowadays, like smartphones, can be used for pieces that are mainly focused on sound in order to live a 3D sound experience.

Visual design

Scene.jpg

The design of the scene is on purpose really simple due to the meaning of the sound in this piece. Its purpose mainly is to give some orientation to the listener/player and because of the use of the cardboard to isolate him/her into the piece. In order to develop the app for android with the use of the Cardboard, I used the GoogleVR package.

Sound and sound design

The sound in this scene has been take from my binaural radio piece “Fugue State”. The 3 voices (mono files) and the piano (stereo file) are exported directly from the Reaper Session by-passed the spatialisation plug-ins and place them into the scene in 4 opposite points. In the contrary, the sound textures of the piece are places into two spheres that they are rotated around the virtual camera in order to make more effective the illusion of a 3D space.

SphereRotateScript.jpg sound texture on a sphere, with rotate script and 3D sound Transparent shaders.jpg transparent shader


Conclusion and further steps

FugueStateVR it was the first experiment in my work of how tools mainly built for Visual works can be used to extend the abilities of a sound artist. At this stage my piece is consisted from only one space without giving any choice to the listener, but for the next steps it could be developed into interactive 3D audio plays, easily accessible to everyone by using the gyroscope in smartphones and the VR cardboards

Vimeo, preview by screen recording on the laptop: [2] password: FugueStateVR