GMU:Digital Puppetry Lab/Group A Midsummer Night's Dream

A Midsummer Night's Dream

Group work by Liu Yun & Li Qianqian & Fan Xiangzhen & Wu Junyuan & Tan Yuxin

Introduction

Have you ever looked at the moon with the breeze at night? Have you ever heard the harmony of the birds and frogs? Do you remember the wonderful summer nights? We just want to give you a midsummer night's dream. This project is based on processing with the face detection and data collection, and then send the data message into the MaxMsp. We divide four regions in MaxMsp. The various sounds you hear will change according to your different position. In addition, in the unity we tried to establish a vivid picture of summer. Imagine that grass is moving with the wind in a beautiful moonlight accompanied by bursts of sounds of insects. Let`s enjoy a summer dream together.

Diagram

Demonstration

Demonstration Viedo

Appendix

Data Input:
· Getting data (the position X and Y of the center of face and the size of face) by face detection
· Sending data from processing to Max/Msp by OSC
· Another processing file sending the same data to Unity by using different port

Data Transfer:
· Receiving data from processing by OSC
· Only keeping number from the message by using 'zl slice'
· Dividing number into three usable data by using 'unpack'
· Sending data separately from Yun's laptop to Xiangzhen's laptop in Max/Msp by OSC

Audio Output:
·

Data Using in Unity:
· Receiving data from processing by OSC
· Dealing with function call between js and C# file
· Using 'x' and 'y' data sent by Yun's laptop to control the quaternion of the camera
· Connect TUIO app with Laptop

Data Getting by phone:
· Using the app TuioPad to get screen touch data by phone

Terrain Creation and Particular System in Unity:
· Build a terrain -- tree (5 styles) --build grass --adjust parameters
· Create skybox, light environment, windzone
· Create glow warm and falling leaves particle system