GMU:I and my Max/Chanitnanth Phadungnanonth

Semester Project: My Other Half

This piece is a collaborative work created by Chanitnanth Phadungnanonth and Defne Isikli. “My Other Half” is an interactive semester project for 2 users. This interactive manner of the project results in a game-like situation, that is why they are called players. The project offers a visual experience for Player 1 and an auditory experience for Player 2. Players are also able to realize how they change each other’s experiences.

Player 1 has 2 window screens in front of her: one with her normal Webcam and the second with her Webcam with effects. These effects are created and constantly changing by the numbers provided by Player 2.

Player 2 has Left and Right Headphone icons in front of her and she has her own melody on her right ear and the melody on her left ear modified by the number data sent by Player 2.

I am only Player 1, so, if you want to learn more go check Defne Isikli’s page (https://www.uni-weimar.de/kunst-und-gestaltung/wiki/GMU:I_and_my_Max/Defne_Isikli) to find out about Player 2.

INSTRUCTIONS: Welcome to My Other Half

1- In order to interact, it is required to have 2 players with 2 computers. One player should have a computer with a Webcam and the other should have a headphone.

2- To set the connection between 2 computers, all players should be aware of their IP addresses and should be connected to the Internet through the same WIFI. Since the communication between 2 computers are both ways, each Player has their own “jit.net.send” and “jit.net.recv” objects. Therefore, they are both the sender and the receiver. How to open patch, how to deal with port numbers, and how to insert IP address will be explained in the following paragraph:

3- Player 1 should follow the instructions on how to connect her Webcam to the patch. After each Player opens their patches, they both should enter each other's IP addresses to their own “jit.net.send” objects and make sure the port numbers are the same.

HINT: Make sure your PC security programs/firewalls are enabling MAX to send and receive messages

4- My Other Half starts with Player 1. She should move her hands facing the Webcam and which will create data numbers.

5- These numbers will be delivered to the patch of Player 2. On the Left Ear of Player 2, the modified melody(the melody modifies within some aspects from the numbers received from Player 1) will be played.

6- Player 2 then needs to open her Right Ear, to her own designed melody. According to the patch of Player 2, some data numbers will be ready to be sent to the patch of Player 1.

7- The received data numbers start to change the Webcam screen of Player 1.

8- Player 1 can see how Player 2 modified her Webcam attributes and how her appearance is changed. (saturation, brightness, contrast, hue angle, theta, gain, and speed(qmetro))

9- My Other Half is now set as an interactive experience. Each player forwards their data consecutively. ENJOY!

P.S.: Both patches are worked together and the final outcome is a collaborative work of 2 people who had no idea about MAX before this class!

To see how our patches working you can check our video: https://www.youtube.com/watch?v=mNh5NgpX4BI

Check our patches here( player 1): File:Our other half-player1 patches.zip

Assignment ; 09.12.2020

Here are our patches; you can try with your own camera

File:video-webcam.maxpat

File:piano-webcam-music-defneandmint.maxpat

We find some tutorials about how to use frame difference to create a melody with your movement. So, we tried it out and got the idea to make it a 2 player game:

We (Me and Defne) thought about making a game with two players: The game will start when Player 1 makes some movement and through webcam, he/she creates a melody. When it is recorded, Player 2 tries to make the same melody by making similar movements (not necessarily the same movements as well). The game evaluates the melodies to each other, if they are similar, Player 2 wins a point. The first one to reach 10 points wins!

The Structure of the Game Start:

Round 1:

PLAYER 1:

Movement --> Melody of player 1 --> Melody Stored

then, PLAYER 2:

The movement to make same as Melody 1 --> Melody of Player 2 --> Melody Stored

then,

Melodies will be compared if they are the same/similar (pitch, amplitude, or frequency???) --> Play 2 gets 1 point.

then,

if the melody is not the same, no one gets a point.

Round 2:

The game will be repeated as Round 1 by starting with PLAYER 2.

Points are stored until 5 points.

The game ends if one of the players reaches 5 Points.

if Player 1: Winner, then Player 2: Loser

if Player 2: Winner, then player 1: Loser

GAME OVER! (maybe we can add a rematch button to make it restart)

Assignment ; 06.01.2021

For this week, we explore color tracking and turn them to sound. From this step, we want to combine color tracking with movement tracking, so that we can have a game where they can compete with each other.

OUR Tutorials link; 16.12.2020

Frame Differencing (Motion) to MIDI Sequencer Max MSP tutorial

https://www.youtube.com/watch?v=BhgVt3I5ALc&t=834s

-Motion Tracking Sound - Kinect, Max and Ableton Live to Create Music From Movement

https://www.youtube.com/watch?v=2GoAk79I44Y&list=PLQnPjiU2CsJQnX2rEAwAS_EQRnQWboJaS&index=17&t=56s

Drawing sound

https://www.youtube.com/watch?v=jHVIAWJmcdc&list=PLQnPjiU2CsJQnX2rEAwAS_EQRnQWboJaS&index=7

another drawing sound

https://www.youtube.com/watch?v=BybK9CQFy-w&list=PLQnPjiU2CsJQnX2rEAwAS_EQRnQWboJaS&index=10&t=129s

Assignment

File:Untitled3.maxpat

Artist, Dave&Gabe an interactive installation studio that unites sound, light, and tactility into immersive experiences.

https://vimeo.com/200682960