Music Performances in Virtual Reality
Music performances offer a vast design space that has historically evolved according to interactive multimedia systems. Artists and consumers alike appreciate a live music performance not only for auditory stimuli but for the sum of all aspects that can be found at a venue. Desktop systems, tablets and smartphones can only address this demand to a limited extent. That is why an increasing number of applications target VR technology to deliver compelling immersive experiences for both artists and audiences.
Our vision for a VR live concert experience includes an artistic representation for the performance, channels for communication of artist to crowd, crowd to artist and crowd to crowd as well as a suitable degree of agency for all participants. Tools and systems supporting such a concert experience require suitable integrations into the creative workflows of artists.
In this project, we will take first steps towards the aforementioned vision. Our investigations will begin by reviewing available applications and related work for VR performances and music-based creation of dynamic virtual environments. We will then evaluate the benefits and drawbacks of the various approaches. Finally, we will implement a set of promising techniques towards a system that enables music performances in VR.
Hardware
Due to the covid-19 pandemic, working from our lab may only be possible to a limited extent. Nevertheless, we want to supply you with state-of-the-art hardware and boost your journey into immersive virtual worlds.
For the duration of the project, each participant will be supplied with an Oculus Quest 2 HMD. We will also hand out desktop workstations to meet any additional hardware requirements, which your own machine cannot handle.
Depending on the scope of your contribution, we will consider acquiring a multi-channel audio interface to integrate your own instruments or vocals.
Apart from deploying your applications using this hardware, we strongly encourage you to explore related VR applications in the wild! |
