Medien Wiki - User contributions [en]

GMU:Human and Nonhuman Performances II SS16/Yuxin Tan

2016-10-07T09:32:57Z

Hito3218: /* Working flow */

== Idea introduction ==

'''1.Meanings of balance''' 
- Balance of life 
God is fair to everyone. For instance, the snail has a strong shell, but it moves slowly. the fish can swim free in the water, but it will die when it is exposed to the air. Only so, the life would reach a level of balance, and the nature would reach the state of balance as well. 

- Balance with body 
Live in a city, every lamp can light up a story, but not every story can enrich a period of life. A sort of protagonist in the story keeps working day and night. They know how to type computer quickly，how to work effectively, how to smile to colleague accurately, but maybe they never try to understand their body. As a individual, the more integrated into society, the more our body posture tend to social cognition. So the relationship between body and soul is a widespread question in the world. Rather than treating body as the obstacle to the soul, people should treat the body as a bridge to their soul. According to having the conversion with bodies, individual can learn more about themselves, then achieve a state of balance in their own life. 

- Balance with environment 
The only constant in the world is change. How to find the balance in the changeable world is one of the most important subject in our life. It is a process which from finding the change of environment to reacting to it. And the process is also can be renamed as study. From a balance status to another balance status, it shows the most notable features: live, dynamic, energetic. It means there are a number of external factors affect the balance ,instead of in a isolate scene. 
 

'''2.Put the concept of balance in our game''' 
- the basic scene 
- the object in the scene 
- as players,how to interactive with the game 

 

== Working flow ==

- Motion capture system get users’ movement data 
- The model of players and scene were built in blender 
- Unity 
[[Image:software.png|software]] 
 

== Visual theme ==

Firstly, we want to use dots, line and face as the basic pattern, like the geometrical form. Then we want to do some transform to the basic pattern such as repetition, superimposed, offset and so on. 
[[Image:visual_1.png|visual]]

Secondly, for color matching, we want to use fluorescence color as the main color, like pink, blue and purple. We also want to use grey and yellow and other colors as the complementary color. 
Thirdly， for the color pallet, we want to create something that people wouldn’t believe it is real, like a dream, or a psychedelic trip. 
[[Image:visual_2.png|visual]]
[[Image:visual_3.png|visual]] 

But after we put these style in game we found we can't control the movement of texture, it didn't reach our expectation so we chose a simple way to express it. The background is red and the player are light yellow cube. The texture looks like mottled printed paper 
[[Image:visual_4.png|visual]] 
 

== Coding part ==

This program has two main parts. One is to connect the Unity and theCaptury, and send the position data of each bone to the game object. The other is to control the environment parameters and generate a plain and a ball. 

These are all game objects in this project. Including all the models and scripts and other setting like camera and UI. This concept is based on object-oriented programming so that users can add components to each object based on their needs. 
[[Image:unity_1.png|unity]] 

'''1.Connecting Unity and theCaputry.''' 
TheCaputry provides API for Unity applications. It uses UDP as its Internet protocol suite. In “Osc_Receive_tutorial” this script we should set remoteIP or local host if tested locally, listening port and sending port. Taking into account the stability of the system the listening and sending port should be 1065. 
[[Image:unity_2.png|unity]] 

In this project we have at least two or three players on stage. To define every bone in every player and put them in an array. These are all bones that can be recognized by theCaputry. 
[[Image:unity_3.png|unity]] 

Unity has its own humanoid system to recognize the bones in model and match it. Users need to define animation type and avatar definition. Next step is to initialize on start up to listen for messages make sure this game object has both UDPPackIO and OSC script attached. Subscribing for the position data from theCaputry with a certain format. 

[[''"/subscribe/name of the model/blender/Root/vector 50.0 0.0 20.0"'']] 

Then the position of xyz axis is obtained and stored in a variable and transfer to a game object. 
<source lang="c#">
case "/Fiona_fit/blender/Root/vector":
hip[0] = values[0];
hip[1] = values[1];
hip[2] = values[2];
transHip.transform.position = Vector3(hip[0], -hip[2], hip[1]);
</source>
Because Unity is go up on the Y axis and theCaptury is go up on the Z axis, so pay attention to the location of the array when an game object is assigned to the position data. 

'''2.Generating plain''' 
In the second part complete three tasks. Selecting one bone on each player randomly then make up a plain or a line then generating a ball above it, the position of each player will change by the movement of each participants. 
[[Image:unity_4.png|unity]]
At first we should define every bone of players and put them in an array. We classify these bones and delete three spine bone because if they were selected player were not easy to adjust their gesture. 
<source lang="c#">
private string[] points1 = new string[17]{"Cube_hip1","Cube_LeftShoulder1","Cube_LeftForeArm1",
"Cube_LeftArm1","Cube_LeftHand1","Cube_RightShoulder1","Cube_RightForeArm1",
"Cube_RightArm1","Cube_RightHand1","Cube_LeftUpLeg1","Cube_LeftLeg1","Cube_LeftFoot1",
"Cube_RightUpLeg1","Cube_RightLeg1","Cube_RightFoot1","Cube_Neck1","Cube_Head1"};
</source>

Secondly, get a random number range from 0 to 17 then corresponding to the bone. 
<source lang="c#">
a = Random.Range (0, 17);
b = Random.Range (0, 17);
c = Random.Range (0, 17);

cube1 = GameObject.Find(points1[a]);
cube2 = GameObject.Find(points2[b]);
cube3 = GameObject.Find(points3[c]);
</source>

Thirdly, by adding MeshRenderer component to three bones to make up a plain and giving them material. Three points are combined with each other can get three vectors and using these vectors to make up a triangle mesh plain. 
<source lang="c#">
MeshRenderer mr1,mr2,mr3;
mr1 = cube1.GetComponent<MeshRenderer> ();
mr1.material = select;
mr2 = cube2.GetComponent<MeshRenderer> ();
mr2.material = select;
mr3 = cube3.GetComponent<MeshRenderer> ();
mr3.material = select;

if (sphere.activeSelf != true)
sphere.SetActive (true);

face.AddComponent<MeshCollider> ();

// Obtain the mesh renderer component through the name of gameobject (face)
MeshFilter meshFilter =face.GetComponent<MeshFilter>();
MeshRenderer mr_face = face.GetComponent<MeshRenderer>();

mr_face.material = select;

//Obtain the mesh object by mesh filter object
Mesh mesh = meshFilter.mesh;

//Create three vector objects to make up a triangle mesh
Vector3 e,f,g;
e = cube1.transform.position;
f = cube2.transform.position;
g = cube3.transform.position;
mesh.vertices = new Vector3[] {g,f,e};

Vector2 v1, v2, v3;
v1 = new Vector2 (cube1.transform.position.x, cube1.transform.position.z);
v2 = new Vector2 (cube2.transform.position.x, cube2.transform.position.z);
v3 = new Vector2 (cube3.transform.position.x, cube3.transform.position.z);

mesh.uv = new Vector2[] {v1,v2,v3};
mesh.triangles= new int []{0,1,2};
</source>

'''3.Setting environment parameters''' 
We chose to control the environment parameter manually that is to press key to change it. There are force coming from four directions up,down,left and right. There is a function in Unity which can change gravity. Using a a vector to represent force. In this case we add a upward force. When we press the key the ball will flow up. 
<source lang="c#">
if (Input.GetKeyDown (KeyCode.A))
{
Physics.gravity = new Vector3(2, -9.8f,0);
wind.SetActive (true);
up.SetActive (false);
left.SetActive (true);
right.SetActive (false);
}
</source>

File:Visual 1.png

2016-10-07T09:31:18Z

Hito3218: Hito3218 uploaded a new version of File:Visual 1.png

== Summary ==

== Copyright status: ==

== Source: ==

GMU:Human and Nonhuman Performances II SS16/Yuxin Tan

2016-10-07T09:29:17Z

Hito3218: /* Working flow */

== Idea introduction ==

'''1.Meanings of balance''' 
- Balance of life 
God is fair to everyone. For instance, the snail has a strong shell, but it moves slowly. the fish can swim free in the water, but it will die when it is exposed to the air. Only so, the life would reach a level of balance, and the nature would reach the state of balance as well. 

- Balance with body 
Live in a city, every lamp can light up a story, but not every story can enrich a period of life. A sort of protagonist in the story keeps working day and night. They know how to type computer quickly，how to work effectively, how to smile to colleague accurately, but maybe they never try to understand their body. As a individual, the more integrated into society, the more our body posture tend to social cognition. So the relationship between body and soul is a widespread question in the world. Rather than treating body as the obstacle to the soul, people should treat the body as a bridge to their soul. According to having the conversion with bodies, individual can learn more about themselves, then achieve a state of balance in their own life. 

- Balance with environment 
The only constant in the world is change. How to find the balance in the changeable world is one of the most important subject in our life. It is a process which from finding the change of environment to reacting to it. And the process is also can be renamed as study. From a balance status to another balance status, it shows the most notable features: live, dynamic, energetic. It means there are a number of external factors affect the balance ,instead of in a isolate scene. 
 

'''2.Put the concept of balance in our game''' 
- the basic scene 
- the object in the scene 
- as players,how to interactive with the game 

 

== Working flow ==

- Motion capture system get users’ movement data 
- The model of players and scene were built in blender 
- Unity 
[[Image:software.png|software]] 
 
'''Visual theme''' 
Firstly, we want to use dots, line and face as the basic pattern, like the geometrical form. Then we want to do some transform to the basic pattern such as repetition, superimposed, offset and so on. 
[[Image:visual_1.png|visual]]

Secondly, for color matching, we want to use fluorescence color as the main color, like pink, blue and purple. We also want to use grey and yellow and other colors as the complementary color. 
Thirdly， for the color pallet, we want to create something that people wouldn’t believe it is real, like a dream, or a psychedelic trip. 
[[Image:visual_2.png|visual]]
[[Image:visual_3.png|visual]] 

But after we put these style in game we found we can't control the movement of texture, it didn't reach our expectation so we chose a simple way to express it. The background is red and the player are light yellow cube. The texture looks like mottled printed paper 
[[Image:visual_4.png|visual]] 
 
'''Coding part''' 

This program has two main parts. One is to connect the Unity and theCaptury, and send the position data of each bone to the game object. The other is to control the environment parameters and generate a plain and a ball. 

These are all game objects in this project. Including all the models and scripts and other setting like camera and UI. This concept is based on object-oriented programming so that users can add components to each object based on their needs. 
[[Image:unity_1.png|unity]] 

'''1.Connecting Unity and theCaputry.''' 
TheCaputry provides API for Unity applications. It uses UDP as its Internet protocol suite. In “Osc_Receive_tutorial” this script we should set remoteIP or local host if tested locally, listening port and sending port. Taking into account the stability of the system the listening and sending port should be 1065. 
[[Image:unity_2.png|unity]] 

In this project we have at least two or three players on stage. To define every bone in every player and put them in an array. These are all bones that can be recognized by theCaputry. 
[[Image:unity_3.png|unity]] 

Unity has its own humanoid system to recognize the bones in model and match it. Users need to define animation type and avatar definition. Next step is to initialize on start up to listen for messages make sure this game object has both UDPPackIO and OSC script attached. Subscribing for the position data from theCaputry with a certain format. 

[[''"/subscribe/name of the model/blender/Root/vector 50.0 0.0 20.0"'']] 

Then the position of xyz axis is obtained and stored in a variable and transfer to a game object. 
<source lang="c#">
case "/Fiona_fit/blender/Root/vector":
hip[0] = values[0];
hip[1] = values[1];
hip[2] = values[2];
transHip.transform.position = Vector3(hip[0], -hip[2], hip[1]);
</source>
Because Unity is go up on the Y axis and theCaptury is go up on the Z axis, so pay attention to the location of the array when an game object is assigned to the position data. 

'''2.Generating plain''' 
In the second part complete three tasks. Selecting one bone on each player randomly then make up a plain or a line then generating a ball above it, the position of each player will change by the movement of each participants. 
[[Image:unity_4.png|unity]]
At first we should define every bone of players and put them in an array. We classify these bones and delete three spine bone because if they were selected player were not easy to adjust their gesture. 
<source lang="c#">
private string[] points1 = new string[17]{"Cube_hip1","Cube_LeftShoulder1","Cube_LeftForeArm1",
"Cube_LeftArm1","Cube_LeftHand1","Cube_RightShoulder1","Cube_RightForeArm1",
"Cube_RightArm1","Cube_RightHand1","Cube_LeftUpLeg1","Cube_LeftLeg1","Cube_LeftFoot1",
"Cube_RightUpLeg1","Cube_RightLeg1","Cube_RightFoot1","Cube_Neck1","Cube_Head1"};
</source>

Secondly, get a random number range from 0 to 17 then corresponding to the bone. 
<source lang="c#">
a = Random.Range (0, 17);
b = Random.Range (0, 17);
c = Random.Range (0, 17);

cube1 = GameObject.Find(points1[a]);
cube2 = GameObject.Find(points2[b]);
cube3 = GameObject.Find(points3[c]);
</source>

Thirdly, by adding MeshRenderer component to three bones to make up a plain and giving them material. Three points are combined with each other can get three vectors and using these vectors to make up a triangle mesh plain. 
<source lang="c#">
MeshRenderer mr1,mr2,mr3;
mr1 = cube1.GetComponent<MeshRenderer> ();
mr1.material = select;
mr2 = cube2.GetComponent<MeshRenderer> ();
mr2.material = select;
mr3 = cube3.GetComponent<MeshRenderer> ();
mr3.material = select;

if (sphere.activeSelf != true)
sphere.SetActive (true);

face.AddComponent<MeshCollider> ();

// Obtain the mesh renderer component through the name of gameobject (face)
MeshFilter meshFilter =face.GetComponent<MeshFilter>();
MeshRenderer mr_face = face.GetComponent<MeshRenderer>();

mr_face.material = select;

//Obtain the mesh object by mesh filter object
Mesh mesh = meshFilter.mesh;

//Create three vector objects to make up a triangle mesh
Vector3 e,f,g;
e = cube1.transform.position;
f = cube2.transform.position;
g = cube3.transform.position;
mesh.vertices = new Vector3[] {g,f,e};

Vector2 v1, v2, v3;
v1 = new Vector2 (cube1.transform.position.x, cube1.transform.position.z);
v2 = new Vector2 (cube2.transform.position.x, cube2.transform.position.z);
v3 = new Vector2 (cube3.transform.position.x, cube3.transform.position.z);

mesh.uv = new Vector2[] {v1,v2,v3};
mesh.triangles= new int []{0,1,2};
</source>

'''3.Setting environment parameters''' 
We chose to control the environment parameter manually that is to press key to change it. There are force coming from four directions up,down,left and right. There is a function in Unity which can change gravity. Using a a vector to represent force. In this case we add a upward force. When we press the key the ball will flow up. 
<source lang="c#">
if (Input.GetKeyDown (KeyCode.A))
{
Physics.gravity = new Vector3(2, -9.8f,0);
wind.SetActive (true);
up.SetActive (false);
left.SetActive (true);
right.SetActive (false);
}
</source>

GMU:Human and Nonhuman Performances II SS16/Yuxin Tan

2016-10-07T09:27:34Z

Hito3218: /* Idea introduction */

== Idea introduction ==

'''1.Meanings of balance''' 
- Balance of life 
God is fair to everyone. For instance, the snail has a strong shell, but it moves slowly. the fish can swim free in the water, but it will die when it is exposed to the air. Only so, the life would reach a level of balance, and the nature would reach the state of balance as well. 

- Balance with body 
Live in a city, every lamp can light up a story, but not every story can enrich a period of life. A sort of protagonist in the story keeps working day and night. They know how to type computer quickly，how to work effectively, how to smile to colleague accurately, but maybe they never try to understand their body. As a individual, the more integrated into society, the more our body posture tend to social cognition. So the relationship between body and soul is a widespread question in the world. Rather than treating body as the obstacle to the soul, people should treat the body as a bridge to their soul. According to having the conversion with bodies, individual can learn more about themselves, then achieve a state of balance in their own life. 

- Balance with environment 
The only constant in the world is change. How to find the balance in the changeable world is one of the most important subject in our life. It is a process which from finding the change of environment to reacting to it. And the process is also can be renamed as study. From a balance status to another balance status, it shows the most notable features: live, dynamic, energetic. It means there are a number of external factors affect the balance ,instead of in a isolate scene. 
 

'''2.Put the concept of balance in our game''' 
- the basic scene 
- the object in the scene 
- as players,how to interactive with the game 

 

== Working flow ==
 
- Motion capture system get users’ movement data 
- The model of players and scene were built in blender 
- Unity 
 
[[Image:software.png|software]] 
 
'''Visual theme''' 

Firstly, we want to use dots, line and face as the basic pattern, like the geometrical form. Then we want to do some transform to the basic pattern such as repetition, superimposed, offset and so on. 
[[Image:visual_1.png|visual]]

Secondly, for color matching, we want to use fluorescence color as the main color, like pink, blue and purple. We also want to use grey and yellow and other colors as the complementary color. 
Thirdly， for the color pallet, we want to create something that people wouldn’t believe it is real, like a dream, or a psychedelic trip. 
[[Image:visual_2.png|visual]]
[[Image:visual_3.png|visual]] 

But after we put these style in game we found we can't control the movement of texture, it didn't reach our expectation so we chose a simple way to express it. The background is red and the player are light yellow cube. The texture looks like mottled printed paper 
[[Image:visual_4.png|visual]] 
 
'''Coding part''' 

This program has two main parts. One is to connect the Unity and theCaptury, and send the position data of each bone to the game object. The other is to control the environment parameters and generate a plain and a ball. 

These are all game objects in this project. Including all the models and scripts and other setting like camera and UI. This concept is based on object-oriented programming so that users can add components to each object based on their needs. 
[[Image:unity_1.png|unity]] 

'''1.Connecting Unity and theCaputry.''' 
TheCaputry provides API for Unity applications. It uses UDP as its Internet protocol suite. In “Osc_Receive_tutorial” this script we should set remoteIP or local host if tested locally, listening port and sending port. Taking into account the stability of the system the listening and sending port should be 1065. 
[[Image:unity_2.png|unity]] 

In this project we have at least two or three players on stage. To define every bone in every player and put them in an array. These are all bones that can be recognized by theCaputry. 
[[Image:unity_3.png|unity]] 

Unity has its own humanoid system to recognize the bones in model and match it. Users need to define animation type and avatar definition. Next step is to initialize on start up to listen for messages make sure this game object has both UDPPackIO and OSC script attached. Subscribing for the position data from theCaputry with a certain format. 

[[''"/subscribe/name of the model/blender/Root/vector 50.0 0.0 20.0"'']] 

Then the position of xyz axis is obtained and stored in a variable and transfer to a game object. 
<source lang="c#">
case "/Fiona_fit/blender/Root/vector":
hip[0] = values[0];
hip[1] = values[1];
hip[2] = values[2];
transHip.transform.position = Vector3(hip[0], -hip[2], hip[1]);
</source>
Because Unity is go up on the Y axis and theCaptury is go up on the Z axis, so pay attention to the location of the array when an game object is assigned to the position data. 

'''2.Generating plain''' 
In the second part complete three tasks. Selecting one bone on each player randomly then make up a plain or a line then generating a ball above it, the position of each player will change by the movement of each participants. 
[[Image:unity_4.png|unity]]
At first we should define every bone of players and put them in an array. We classify these bones and delete three spine bone because if they were selected player were not easy to adjust their gesture. 
<source lang="c#">
private string[] points1 = new string[17]{"Cube_hip1","Cube_LeftShoulder1","Cube_LeftForeArm1",
"Cube_LeftArm1","Cube_LeftHand1","Cube_RightShoulder1","Cube_RightForeArm1",
"Cube_RightArm1","Cube_RightHand1","Cube_LeftUpLeg1","Cube_LeftLeg1","Cube_LeftFoot1",
"Cube_RightUpLeg1","Cube_RightLeg1","Cube_RightFoot1","Cube_Neck1","Cube_Head1"};
</source>

Secondly, get a random number range from 0 to 17 then corresponding to the bone. 
<source lang="c#">
a = Random.Range (0, 17);
b = Random.Range (0, 17);
c = Random.Range (0, 17);

cube1 = GameObject.Find(points1[a]);
cube2 = GameObject.Find(points2[b]);
cube3 = GameObject.Find(points3[c]);
</source>

Thirdly, by adding MeshRenderer component to three bones to make up a plain and giving them material. Three points are combined with each other can get three vectors and using these vectors to make up a triangle mesh plain. 
<source lang="c#">
MeshRenderer mr1,mr2,mr3;
mr1 = cube1.GetComponent<MeshRenderer> ();
mr1.material = select;
mr2 = cube2.GetComponent<MeshRenderer> ();
mr2.material = select;
mr3 = cube3.GetComponent<MeshRenderer> ();
mr3.material = select;

if (sphere.activeSelf != true)
sphere.SetActive (true);

face.AddComponent<MeshCollider> ();

// Obtain the mesh renderer component through the name of gameobject (face)
MeshFilter meshFilter =face.GetComponent<MeshFilter>();
MeshRenderer mr_face = face.GetComponent<MeshRenderer>();

mr_face.material = select;

//Obtain the mesh object by mesh filter object
Mesh mesh = meshFilter.mesh;

//Create three vector objects to make up a triangle mesh
Vector3 e,f,g;
e = cube1.transform.position;
f = cube2.transform.position;
g = cube3.transform.position;
mesh.vertices = new Vector3[] {g,f,e};

Vector2 v1, v2, v3;
v1 = new Vector2 (cube1.transform.position.x, cube1.transform.position.z);
v2 = new Vector2 (cube2.transform.position.x, cube2.transform.position.z);
v3 = new Vector2 (cube3.transform.position.x, cube3.transform.position.z);

mesh.uv = new Vector2[] {v1,v2,v3};
mesh.triangles= new int []{0,1,2};
</source>

'''3.Setting environment parameters''' 
We chose to control the environment parameter manually that is to press key to change it. There are force coming from four directions up,down,left and right. There is a function in Unity which can change gravity. Using a a vector to represent force. In this case we add a upward force. When we press the key the ball will flow up. 
<source lang="c#">
if (Input.GetKeyDown (KeyCode.A))
{
Physics.gravity = new Vector3(2, -9.8f,0);
wind.SetActive (true);
up.SetActive (false);
left.SetActive (true);
right.SetActive (false);
}
</source>

GMU:Human and Nonhuman Performances II SS16/Yuxin Tan

2016-10-07T09:27:04Z

Hito3218: /* Idea introduction */

== Idea introduction ==

'''1.Meanings of balance''' 
- Balance of life 
God is fair to everyone. For instance, the snail has a strong shell, but it moves slowly. the fish can swim free in the water, but it will die when it is exposed to the air. Only so, the life would reach a level of balance, and the nature would reach the state of balance as well. 

- Balance with body 
Live in a city, every lamp can light up a story, but not every story can enrich a period of life. A sort of protagonist in the story keeps working day and night. They know how to type computer quickly，how to work effectively, how to smile to colleague accurately, but maybe they never try to understand their body. As a individual, the more integrated into society, the more our body posture tend to social cognition. So the relationship between body and soul is a widespread question in the world. Rather than treating body as the obstacle to the soul, people should treat the body as a bridge to their soul. According to having the conversion with bodies, individual can learn more about themselves, then achieve a state of balance in their own life. 

- Balance with environment 
The only constant in the world is change. How to find the balance in the changeable world is one of the most important subject in our life. It is a process which from finding the change of environment to reacting to it. And the process is also can be renamed as study. From a balance status to another balance status, it shows the most notable features: live, dynamic, energetic. It means there are a number of external factors affect the balance ,instead of in a isolate scene. 
 

'''2.Put the concept of balance in our game''' 
- the basic scene 
- the object in the scene 
- as players,how to interactive with the game 
 
 

== Working flow ==
 
- Motion capture system get users’ movement data 
- The model of players and scene were built in blender 
- Unity 
 
[[Image:software.png|software]] 
 
'''Visual theme''' 

Firstly, we want to use dots, line and face as the basic pattern, like the geometrical form. Then we want to do some transform to the basic pattern such as repetition, superimposed, offset and so on. 
[[Image:visual_1.png|visual]]

Secondly, for color matching, we want to use fluorescence color as the main color, like pink, blue and purple. We also want to use grey and yellow and other colors as the complementary color. 
Thirdly， for the color pallet, we want to create something that people wouldn’t believe it is real, like a dream, or a psychedelic trip. 
[[Image:visual_2.png|visual]]
[[Image:visual_3.png|visual]] 

But after we put these style in game we found we can't control the movement of texture, it didn't reach our expectation so we chose a simple way to express it. The background is red and the player are light yellow cube. The texture looks like mottled printed paper 
[[Image:visual_4.png|visual]] 
 
'''Coding part''' 

This program has two main parts. One is to connect the Unity and theCaptury, and send the position data of each bone to the game object. The other is to control the environment parameters and generate a plain and a ball. 

These are all game objects in this project. Including all the models and scripts and other setting like camera and UI. This concept is based on object-oriented programming so that users can add components to each object based on their needs. 
[[Image:unity_1.png|unity]] 

'''1.Connecting Unity and theCaputry.''' 
TheCaputry provides API for Unity applications. It uses UDP as its Internet protocol suite. In “Osc_Receive_tutorial” this script we should set remoteIP or local host if tested locally, listening port and sending port. Taking into account the stability of the system the listening and sending port should be 1065. 
[[Image:unity_2.png|unity]] 

In this project we have at least two or three players on stage. To define every bone in every player and put them in an array. These are all bones that can be recognized by theCaputry. 
[[Image:unity_3.png|unity]] 

Unity has its own humanoid system to recognize the bones in model and match it. Users need to define animation type and avatar definition. Next step is to initialize on start up to listen for messages make sure this game object has both UDPPackIO and OSC script attached. Subscribing for the position data from theCaputry with a certain format. 

[[''"/subscribe/name of the model/blender/Root/vector 50.0 0.0 20.0"'']] 

Then the position of xyz axis is obtained and stored in a variable and transfer to a game object. 
<source lang="c#">
case "/Fiona_fit/blender/Root/vector":
hip[0] = values[0];
hip[1] = values[1];
hip[2] = values[2];
transHip.transform.position = Vector3(hip[0], -hip[2], hip[1]);
</source>
Because Unity is go up on the Y axis and theCaptury is go up on the Z axis, so pay attention to the location of the array when an game object is assigned to the position data. 

'''2.Generating plain''' 
In the second part complete three tasks. Selecting one bone on each player randomly then make up a plain or a line then generating a ball above it, the position of each player will change by the movement of each participants. 
[[Image:unity_4.png|unity]]
At first we should define every bone of players and put them in an array. We classify these bones and delete three spine bone because if they were selected player were not easy to adjust their gesture. 
<source lang="c#">
private string[] points1 = new string[17]{"Cube_hip1","Cube_LeftShoulder1","Cube_LeftForeArm1",
"Cube_LeftArm1","Cube_LeftHand1","Cube_RightShoulder1","Cube_RightForeArm1",
"Cube_RightArm1","Cube_RightHand1","Cube_LeftUpLeg1","Cube_LeftLeg1","Cube_LeftFoot1",
"Cube_RightUpLeg1","Cube_RightLeg1","Cube_RightFoot1","Cube_Neck1","Cube_Head1"};
</source>

Secondly, get a random number range from 0 to 17 then corresponding to the bone. 
<source lang="c#">
a = Random.Range (0, 17);
b = Random.Range (0, 17);
c = Random.Range (0, 17);

cube1 = GameObject.Find(points1[a]);
cube2 = GameObject.Find(points2[b]);
cube3 = GameObject.Find(points3[c]);
</source>

Thirdly, by adding MeshRenderer component to three bones to make up a plain and giving them material. Three points are combined with each other can get three vectors and using these vectors to make up a triangle mesh plain. 
<source lang="c#">
MeshRenderer mr1,mr2,mr3;
mr1 = cube1.GetComponent<MeshRenderer> ();
mr1.material = select;
mr2 = cube2.GetComponent<MeshRenderer> ();
mr2.material = select;
mr3 = cube3.GetComponent<MeshRenderer> ();
mr3.material = select;

if (sphere.activeSelf != true)
sphere.SetActive (true);

face.AddComponent<MeshCollider> ();

// Obtain the mesh renderer component through the name of gameobject (face)
MeshFilter meshFilter =face.GetComponent<MeshFilter>();
MeshRenderer mr_face = face.GetComponent<MeshRenderer>();

mr_face.material = select;

//Obtain the mesh object by mesh filter object
Mesh mesh = meshFilter.mesh;

//Create three vector objects to make up a triangle mesh
Vector3 e,f,g;
e = cube1.transform.position;
f = cube2.transform.position;
g = cube3.transform.position;
mesh.vertices = new Vector3[] {g,f,e};

Vector2 v1, v2, v3;
v1 = new Vector2 (cube1.transform.position.x, cube1.transform.position.z);
v2 = new Vector2 (cube2.transform.position.x, cube2.transform.position.z);
v3 = new Vector2 (cube3.transform.position.x, cube3.transform.position.z);

mesh.uv = new Vector2[] {v1,v2,v3};
mesh.triangles= new int []{0,1,2};
</source>

'''3.Setting environment parameters''' 
We chose to control the environment parameter manually that is to press key to change it. There are force coming from four directions up,down,left and right. There is a function in Unity which can change gravity. Using a a vector to represent force. In this case we add a upward force. When we press the key the ball will flow up. 
<source lang="c#">
if (Input.GetKeyDown (KeyCode.A))
{
Physics.gravity = new Vector3(2, -9.8f,0);
wind.SetActive (true);
up.SetActive (false);
left.SetActive (true);
right.SetActive (false);
}
</source>

GMU:Human and Nonhuman Performances II SS16/Yuxin Tan

2016-10-07T09:24:29Z

Hito3218:

== Idea introduction ==
 
'''Meanings of balance''' 

- Balance of life 
God is fair to everyone. For instance, the snail has a strong shell, but it moves slowly. the fish can swim free in the water, but it will die when it is exposed to the air. Only so, the life would reach a level of balance, and the nature would reach the state of balance as well. 

- Balance with body 
Live in a city, every lamp can light up a story, but not every story can enrich a period of life. A sort of protagonist in the story keeps working day and night. They know how to type computer quickly，how to work effectively, how to smile to colleague accurately, but maybe they never try to understand their body. As a individual, the more integrated into society, the more our body posture tend to social cognition. So the relationship between body and soul is a widespread question in the world. Rather than treating body as the obstacle to the soul, people should treat the body as a bridge to their soul. According to having the conversion with bodies, individual can learn more about themselves, then achieve a state of balance in their own life. 

- Balance with environment 
The only constant in the world is change. How to find the balance in the changeable world is one of the most important subject in our life. It is a process which from finding the change of environment to reacting to it. And the process is also can be renamed as study. From a balance status to another balance status, it shows the most notable features: live, dynamic, energetic. It means there are a number of external factors affect the balance ,instead of in a isolate scene. 
 

'''Put the concept of balance in our game''' 
- the basic scene 
- the object in the scene 
- as players,how to interactive with the game 
 
 

== Working flow ==
 
- Motion capture system get users’ movement data 
- The model of players and scene were built in blender 
- Unity 
 
[[Image:software.png|software]] 
 
'''Visual theme''' 

Firstly, we want to use dots, line and face as the basic pattern, like the geometrical form. Then we want to do some transform to the basic pattern such as repetition, superimposed, offset and so on. 
[[Image:visual_1.png|visual]]

Secondly, for color matching, we want to use fluorescence color as the main color, like pink, blue and purple. We also want to use grey and yellow and other colors as the complementary color. 
Thirdly， for the color pallet, we want to create something that people wouldn’t believe it is real, like a dream, or a psychedelic trip. 
[[Image:visual_2.png|visual]]
[[Image:visual_3.png|visual]] 

But after we put these style in game we found we can't control the movement of texture, it didn't reach our expectation so we chose a simple way to express it. The background is red and the player are light yellow cube. The texture looks like mottled printed paper 
[[Image:visual_4.png|visual]] 
 
'''Coding part''' 

This program has two main parts. One is to connect the Unity and theCaptury, and send the position data of each bone to the game object. The other is to control the environment parameters and generate a plain and a ball. 

These are all game objects in this project. Including all the models and scripts and other setting like camera and UI. This concept is based on object-oriented programming so that users can add components to each object based on their needs. 
[[Image:unity_1.png|unity]] 

'''1.Connecting Unity and theCaputry.''' 
TheCaputry provides API for Unity applications. It uses UDP as its Internet protocol suite. In “Osc_Receive_tutorial” this script we should set remoteIP or local host if tested locally, listening port and sending port. Taking into account the stability of the system the listening and sending port should be 1065. 
[[Image:unity_2.png|unity]] 

In this project we have at least two or three players on stage. To define every bone in every player and put them in an array. These are all bones that can be recognized by theCaputry. 
[[Image:unity_3.png|unity]] 

Unity has its own humanoid system to recognize the bones in model and match it. Users need to define animation type and avatar definition. Next step is to initialize on start up to listen for messages make sure this game object has both UDPPackIO and OSC script attached. Subscribing for the position data from theCaputry with a certain format. 

[[''"/subscribe/name of the model/blender/Root/vector 50.0 0.0 20.0"'']] 

Then the position of xyz axis is obtained and stored in a variable and transfer to a game object. 
<source lang="c#">
case "/Fiona_fit/blender/Root/vector":
hip[0] = values[0];
hip[1] = values[1];
hip[2] = values[2];
transHip.transform.position = Vector3(hip[0], -hip[2], hip[1]);
</source>
Because Unity is go up on the Y axis and theCaptury is go up on the Z axis, so pay attention to the location of the array when an game object is assigned to the position data. 

'''2.Generating plain''' 
In the second part complete three tasks. Selecting one bone on each player randomly then make up a plain or a line then generating a ball above it, the position of each player will change by the movement of each participants. 
[[Image:unity_4.png|unity]]
At first we should define every bone of players and put them in an array. We classify these bones and delete three spine bone because if they were selected player were not easy to adjust their gesture. 
<source lang="c#">
private string[] points1 = new string[17]{"Cube_hip1","Cube_LeftShoulder1","Cube_LeftForeArm1",
"Cube_LeftArm1","Cube_LeftHand1","Cube_RightShoulder1","Cube_RightForeArm1",
"Cube_RightArm1","Cube_RightHand1","Cube_LeftUpLeg1","Cube_LeftLeg1","Cube_LeftFoot1",
"Cube_RightUpLeg1","Cube_RightLeg1","Cube_RightFoot1","Cube_Neck1","Cube_Head1"};
</source>

Secondly, get a random number range from 0 to 17 then corresponding to the bone. 
<source lang="c#">
a = Random.Range (0, 17);
b = Random.Range (0, 17);
c = Random.Range (0, 17);

cube1 = GameObject.Find(points1[a]);
cube2 = GameObject.Find(points2[b]);
cube3 = GameObject.Find(points3[c]);
</source>

Thirdly, by adding MeshRenderer component to three bones to make up a plain and giving them material. Three points are combined with each other can get three vectors and using these vectors to make up a triangle mesh plain. 
<source lang="c#">
MeshRenderer mr1,mr2,mr3;
mr1 = cube1.GetComponent<MeshRenderer> ();
mr1.material = select;
mr2 = cube2.GetComponent<MeshRenderer> ();
mr2.material = select;
mr3 = cube3.GetComponent<MeshRenderer> ();
mr3.material = select;

if (sphere.activeSelf != true)
sphere.SetActive (true);

face.AddComponent<MeshCollider> ();

// Obtain the mesh renderer component through the name of gameobject (face)
MeshFilter meshFilter =face.GetComponent<MeshFilter>();
MeshRenderer mr_face = face.GetComponent<MeshRenderer>();

mr_face.material = select;

//Obtain the mesh object by mesh filter object
Mesh mesh = meshFilter.mesh;

//Create three vector objects to make up a triangle mesh
Vector3 e,f,g;
e = cube1.transform.position;
f = cube2.transform.position;
g = cube3.transform.position;
mesh.vertices = new Vector3[] {g,f,e};

Vector2 v1, v2, v3;
v1 = new Vector2 (cube1.transform.position.x, cube1.transform.position.z);
v2 = new Vector2 (cube2.transform.position.x, cube2.transform.position.z);
v3 = new Vector2 (cube3.transform.position.x, cube3.transform.position.z);

mesh.uv = new Vector2[] {v1,v2,v3};
mesh.triangles= new int []{0,1,2};
</source>

'''3.Setting environment parameters''' 
We chose to control the environment parameter manually that is to press key to change it. There are force coming from four directions up,down,left and right. There is a function in Unity which can change gravity. Using a a vector to represent force. In this case we add a upward force. When we press the key the ball will flow up. 
<source lang="c#">
if (Input.GetKeyDown (KeyCode.A))
{
Physics.gravity = new Vector3(2, -9.8f,0);
wind.SetActive (true);
up.SetActive (false);
left.SetActive (true);
right.SetActive (false);
}
</source>

File:Unity 4.png

2016-10-07T09:21:06Z

Hito3218:

== Summary ==

== Copyright status: ==

== Source: ==

File:Unity 3.png

2016-10-07T09:20:38Z

Hito3218:

== Summary ==

== Copyright status: ==

== Source: ==

File:Unity 2.png

2016-10-07T09:20:17Z

Hito3218:

== Summary ==

== Copyright status: ==

== Source: ==

File:Unity 1.png

2016-10-07T09:19:55Z

Hito3218:

== Summary ==

== Copyright status: ==

== Source: ==

File:Visual 4.png

2016-10-07T09:07:08Z

Hito3218: Hito3218 uploaded a new version of File:Visual 4.png

== Summary ==

== Copyright status: ==

== Source: ==

File:Visual 4.png

2016-10-07T09:04:49Z

Hito3218:

== Summary ==

== Copyright status: ==

== Source: ==

File:Visual 3.png

2016-10-07T09:04:17Z

Hito3218: Hito3218 uploaded a new version of File:Visual 3.png

== Summary ==

== Copyright status: ==

== Source: ==

File:Visual 3.png

2016-10-07T09:03:07Z

Hito3218: Hito3218 uploaded a new version of File:Visual 3.png

== Summary ==

== Copyright status: ==

== Source: ==

File:Visual 3.png

2016-10-07T08:56:55Z

Hito3218:

== Summary ==

== Copyright status: ==

== Source: ==

File:Visual 2.png

2016-10-07T08:55:58Z

Hito3218:

== Summary ==

== Copyright status: ==

== Source: ==

File:Visual 1.png

2016-10-07T08:55:20Z

Hito3218:

== Summary ==

== Copyright status: ==

== Source: ==

File:Software.png

2016-10-07T08:54:46Z

Hito3218:

== Summary ==

== Copyright status: ==

== Source: ==

GMU:Human and Nonhuman Performances II SS16/Yuxin Tan

2016-10-07T08:54:05Z

Hito3218:

'''== Idea introduction ==''' 

'''Meanings of balance''' 

- balance of life 
God is fair to everyone. For instance, the snail has a strong shell, but it moves slowly. the fish can swim free in the water, but it will die when it is exposed to the air. Only so, the life would reach a level of balance, and the nature would reach the state of balance as well. 

- balance with body 
Live in a city, every lamp can light up a story, but not every story can enrich a period of life. A sort of protagonist in the story keeps working day and night. They know how to type computer quickly，how to work effectively, how to smile to colleague accurately, but maybe they never try to understand their body. As a individual, the more integrated into society, the more our body posture tend to social cognition. So the relationship between body and soul is a widespread question in the world. Rather than treating body as the obstacle to the soul, people should treat the body as a bridge to their soul. According to having the conversion with bodies, individual can learn more about themselves, then achieve a state of balance in their own life. 

- balance with environment 
The only constant in the world is change. How to find the balance in the changeable world is one of the most important subject in our life. It is a process which from finding the change of environment to reacting to it. And the process is also can be renamed as study. From a balance status to another balance status, it shows the most notable features: live, dynamic, energetic. It means there are a number of external factors affect the balance ,instead of in a isolate scene. 

'''Put the concept of balance in our game''' 
- the basic scene 
- the object in the scene 
- as players,how to interactive with the game 

'''== Working flow ==''' 
- Motion capture system get users’ movement data 
- The model of players and scene were built in blender 
- Unity 
[[Image:software.png|software]] 

'''Visual theme''' 

Firstly, we want to use dots, line and face as the basic pattern, like the geometrical form. Then we want to do some transform to the basic pattern such as repetition, superimposed, offset and so on. 
[[Image:visual_1.png|visual]]

Secondly, for color matching, we want to use fluorescence color as the main color, like pink, blue and purple. We also want to use grey and yellow and other colors as the complementary color. 
Thirdly， for the color pallet, we want to create something that people wouldn’t believe it is real, like a dream, or a psychedelic trip. 
[[Image:visual_2.png|visual]] 
[[Image:visual_3.png|visual]] 

But after we put these style in game we found we can't control the movement of texture, it didn't reach our expectation so we chose a simple way to express it. The background is red and the player are light yellow cube. The texture looks like mottled printed paper 
[[Image:visual_4.png|visual]] 

'''Coding part''' 

This program has two main parts. One is to connect the Unity and theCaptury, and send the position data of each bone to the game object. The other is to control the environment parameters and generate a plain and a ball. 

These are all game objects in this project. Including all the models and scripts and other setting like camera and UI. This concept is based on object-oriented programming so that users can add components to each object based on their needs. 
[[Image:unity_1.png|unity]] 

'''1.Connecting Unity and theCaputry.''' 
TheCaputry provides API for Unity applications. It uses UDP as its Internet protocol suite. In “Osc_Receive_tutorial” this script we should set remoteIP or local host if tested locally, listening port and sending port. Taking into account the stability of the system the listening and sending port should be 1065. 
[[Image:unity_2.png|unity]] 

In this project we have at least two or three players on stage. To define every bone in every player and put them in an array. These are all bones that can be recognized by theCaputry. 
[[Image:unity_3.png|unity]] 

Unity has its own humanoid system to recognize the bones in model and match it. Users need to define animation type and avatar definition. Next step is to initialize on start up to listen for messages make sure this game object has both UDPPackIO and OSC script attached. Subscribing for the position data from theCaputry with a certain format. 

[[''"/subscribe/name of the model/blender/Root/vector 50.0 0.0 20.0"'']] 

Then the position of xyz axis is obtained and stored in a variable and transfer to a game object. 
<source lang="c#">
case "/Fiona_fit/blender/Root/vector":
hip[0] = values[0];
hip[1] = values[1];
hip[2] = values[2];
transHip.transform.position = Vector3(hip[0], -hip[2], hip[1]);
</source>
Because Unity is go up on the Y axis and theCaptury is go up on the Z axis, so pay attention to the location of the array when an game object is assigned to the position data. 

'''2.Generating plain''' 
In the second part complete three tasks. Selecting one bone on each player randomly then make up a plain or a line then generating a ball above it, the position of each player will change by the movement of each participants. 
[[Image:unity_4.png|unity]]
At first we should define every bone of players and put them in an array. We classify these bones and delete three spine bone because if they were selected player were not easy to adjust their gesture. 
<source lang="c#">
private string[] points1 = new string[17]{"Cube_hip1","Cube_LeftShoulder1","Cube_LeftForeArm1",
"Cube_LeftArm1","Cube_LeftHand1","Cube_RightShoulder1","Cube_RightForeArm1",
"Cube_RightArm1","Cube_RightHand1","Cube_LeftUpLeg1","Cube_LeftLeg1","Cube_LeftFoot1",
"Cube_RightUpLeg1","Cube_RightLeg1","Cube_RightFoot1","Cube_Neck1","Cube_Head1"};
</source>

Secondly, get a random number range from 0 to 17 then corresponding to the bone. 
<source lang="c#">
a = Random.Range (0, 17);
b = Random.Range (0, 17);
c = Random.Range (0, 17);

cube1 = GameObject.Find(points1[a]);
cube2 = GameObject.Find(points2[b]);
cube3 = GameObject.Find(points3[c]);
</source>

Thirdly, by adding MeshRenderer component to three bones to make up a plain and giving them material. Three points are combined with each other can get three vectors and using these vectors to make up a triangle mesh plain. 
<source lang="c#">
MeshRenderer mr1,mr2,mr3;
mr1 = cube1.GetComponent<MeshRenderer> ();
mr1.material = select;
mr2 = cube2.GetComponent<MeshRenderer> ();
mr2.material = select;
mr3 = cube3.GetComponent<MeshRenderer> ();
mr3.material = select;

if (sphere.activeSelf != true)
sphere.SetActive (true);

face.AddComponent<MeshCollider> ();

// Obtain the mesh renderer component through the name of gameobject (face)
MeshFilter meshFilter =face.GetComponent<MeshFilter>();
MeshRenderer mr_face = face.GetComponent<MeshRenderer>();

mr_face.material = select;

//Obtain the mesh object by mesh filter object
Mesh mesh = meshFilter.mesh;

//Create three vector objects to make up a triangle mesh
Vector3 e,f,g;
e = cube1.transform.position;
f = cube2.transform.position;
g = cube3.transform.position;
mesh.vertices = new Vector3[] {g,f,e};

Vector2 v1, v2, v3;
v1 = new Vector2 (cube1.transform.position.x, cube1.transform.position.z);
v2 = new Vector2 (cube2.transform.position.x, cube2.transform.position.z);
v3 = new Vector2 (cube3.transform.position.x, cube3.transform.position.z);

mesh.uv = new Vector2[] {v1,v2,v3};
mesh.triangles= new int []{0,1,2};
</source>

'''3.Setting environment parameters''' 
We chose to control the environment parameter manually that is to press key to change it. There are force coming from four directions up,down,left and right. There is a function in Unity which can change gravity. Using a a vector to represent force. In this case we add a upward force. When we press the key the ball will flow up. 
<source lang="c#">
if (Input.GetKeyDown (KeyCode.A))
{
Physics.gravity = new Vector3(2, -9.8f,0);
wind.SetActive (true);
up.SetActive (false);
left.SetActive (true);
right.SetActive (false);
}
</source>

GMU:Human and Nonhuman Performances II SS16/Yuxin Tan

2016-10-07T08:52:11Z

Hito3218:

'''== Idea introduction ==''' 
'''meanings of balance''' 
- balance of life 
God is fair to everyone. For instance, the snail has a strong shell, but it moves slowly. the fish can swim free in the water, but it will die when it is exposed to the air. Only so, the life would reach a level of balance, and the nature would reach the state of balance as well. 
- balance with body 
Live in a city, every lamp can light up a story, but not every story can enrich a period of life. A sort of protagonist in the story keeps working day and night. They know how to type computer quickly，how to work effectively, how to smile to colleague accurately, but maybe they never try to understand their body. As a individual, the more integrated into society, the more our body posture tend to social cognition. So the relationship between body and soul is a widespread question in the world. Rather than treating body as the obstacle to the soul, people should treat the body as a bridge to their soul. According to having the conversion with bodies, individual can learn more about themselves, then achieve a state of balance in their own life. 
- balance with environment 
The only constant in the world is change. How to find the balance in the changeable world is one of the most important subject in our life. It is a process which from finding the change of environment to reacting to it. And the process is also can be renamed as study. From a balance status to another balance status, it shows the most notable features: live, dynamic, energetic. It means there are a number of external factors affect the balance ,instead of in a isolate scene. 

'''Put the concept of balance in our game''' 
- the basic scene 
- the object in the scene 
- as players,how to interactive with the game 

'''== Working flow ==''' 
- Motion capture system get users’ movement data 
- The model of players and scene were built in blender 
- Unity 
[[Image:software.png|software]] 

'''Visual theme'''
Firstly, we want to use dots, line and face as the basic pattern, like the geometrical form. Then we want to do some transform to the basic pattern such as repetition, superimposed, offset and so on. 
[[Image:visual_1.png|visual]]
Secondly, for color matching, we want to use fluorescence color as the main color, like pink, blue and purple. We also want to use grey and yellow and other colors as the complementary color. 
Thirdly， for the color pallet, we want to create something that people wouldn’t believe it is real, like a dream, or a psychedelic trip. 
[[Image:visual_2.png|visual]] 
[[Image:visual_3.png|visual]] 
But after we put these style in game we found we can't control the movement of texture, it didn't reach our expectation so we chose a simple way to express it. The background is red and the player are light yellow cube. The texture looks like mottled printed paper 
[[Image:visual_4.png|visual]] 

'''Coding part''' 
This program has two main parts. One is to connect the Unity and theCaptury, and send the position data of each bone to the game object. The other is to control the environment parameters and generate a plain and a ball. 

These are all game objects in this project. Including all the models and scripts and other setting like camera and UI. This concept is based on object-oriented programming so that users can add components to each object based on their needs. 
[[Image:unity_1.png|unity]] 

'''1.Connecting Unity and theCaputry.''' 
TheCaputry provides API for Unity applications. It uses UDP as its Internet protocol suite. In “Osc_Receive_tutorial” this script we should set remoteIP or local host if tested locally, listening port and sending port. Taking into account the stability of the system the listening and sending port should be 1065. 
[[Image:unity_2.png|unity]] 
In this project we have at least two or three players on stage. To define every bone in every player and put them in an array. These are all bones that can be recognized by theCaputry. 
[[Image:unity_3.png|unity]] 
Unity has its own humanoid system to recognize the bones in model and match it. Users need to define animation type and avatar definition. Next step is to initialize on start up to listen for messages make sure this game object has both UDPPackIO and OSC script attached. Subscribing for the position data from theCaputry with a certain format. 
[[''"/subscribe/name of the model/blender/Root/vector 50.0 0.0 20.0"'']] 

Then the position of xyz axis is obtained and stored in a variable and transfer to a game object. 
<source lang="c#">
case "/Fiona_fit/blender/Root/vector":
hip[0] = values[0];
hip[1] = values[1];
hip[2] = values[2];
transHip.transform.position = Vector3(hip[0], -hip[2], hip[1]);
</source>
Because Unity is go up on the Y axis and theCaptury is go up on the Z axis, so pay attention to the location of the array when an game object is assigned to the position data. 

'''2.Generating plain''' 
In the second part complete three tasks. Selecting one bone on each player randomly then make up a plain or a line then generating a ball above it, the position of each player will change by the movement of each participants. 
[[Image:unity_4.png|unity]]
At first we should define every bone of players and put them in an array. We classify these bones and delete three spine bone because if they were selected player were not easy to adjust their gesture. 
<source lang="c#">
private string[] points1 = new string[17]{"Cube_hip1","Cube_LeftShoulder1","Cube_LeftForeArm1",
"Cube_LeftArm1","Cube_LeftHand1","Cube_RightShoulder1","Cube_RightForeArm1",
"Cube_RightArm1","Cube_RightHand1","Cube_LeftUpLeg1","Cube_LeftLeg1","Cube_LeftFoot1",
"Cube_RightUpLeg1","Cube_RightLeg1","Cube_RightFoot1","Cube_Neck1","Cube_Head1"};
</source>

Secondly, get a random number range from 0 to 17 then corresponding to the bone. 
<source lang="c#">
a = Random.Range (0, 17);
b = Random.Range (0, 17);
c = Random.Range (0, 17);

cube1 = GameObject.Find(points1[a]);
cube2 = GameObject.Find(points2[b]);
cube3 = GameObject.Find(points3[c]);
</source>

Thirdly, by adding MeshRenderer component to three bones to make up a plain and giving them material. Three points are combined with each other can get three vectors and using these vectors to make up a triangle mesh plain. 
<source lang="c#">
MeshRenderer mr1,mr2,mr3;
mr1 = cube1.GetComponent<MeshRenderer> ();
mr1.material = select;
mr2 = cube2.GetComponent<MeshRenderer> ();
mr2.material = select;
mr3 = cube3.GetComponent<MeshRenderer> ();
mr3.material = select;

if (sphere.activeSelf != true)
sphere.SetActive (true);

face.AddComponent<MeshCollider> ();

// Obtain the mesh renderer component through the name of gameobject (face)
MeshFilter meshFilter =face.GetComponent<MeshFilter>();
MeshRenderer mr_face = face.GetComponent<MeshRenderer>();

mr_face.material = select;

//Obtain the mesh object by mesh filter object
Mesh mesh = meshFilter.mesh;

//Create three vector objects to make up a triangle mesh
Vector3 e,f,g;
e = cube1.transform.position;
f = cube2.transform.position;
g = cube3.transform.position;
mesh.vertices = new Vector3[] {g,f,e};

Vector2 v1, v2, v3;
v1 = new Vector2 (cube1.transform.position.x, cube1.transform.position.z);
v2 = new Vector2 (cube2.transform.position.x, cube2.transform.position.z);
v3 = new Vector2 (cube3.transform.position.x, cube3.transform.position.z);

mesh.uv = new Vector2[] {v1,v2,v3};
mesh.triangles= new int []{0,1,2};
</source>

'''3.Setting environment parameters''' 
We chose to control the environment parameter manually that is to press key to change it. There are force coming from four directions up,down,left and right. There is a function in Unity which can change gravity. Using a a vector to represent force. In this case we add a upward force. When we press the key the ball will flow up. 
<source lang="c#">
if (Input.GetKeyDown (KeyCode.A))
{
Physics.gravity = new Vector3(2, -9.8f,0);
wind.SetActive (true);
up.SetActive (false);
left.SetActive (true);
right.SetActive (false);
}
</source>

GMU:Human and Nonhuman Performances II SS16/Yuxin Tan

2016-10-07T08:44:58Z

Hito3218:

'''== Idea introduction =='''
'''meanings of balance''' 
- balance of life 
God is fair to everyone. For instance, the snail has a strong shell, but it moves slowly. the fish can swim free in the water, but it will die when it is exposed to the air. Only so, the life would reach a level of balance, and the nature would reach the state of balance as well. 
- balance with body 
Live in a city, every lamp can light up a story, but not every story can enrich a period of life. A sort of protagonist in the story keeps working day and night. They know how to type computer quickly，how to work effectively, how to smile to colleague accurately, but maybe they never try to understand their body. As a individual, the more integrated into society, the more our body posture tend to social cognition. So the relationship between body and soul is a widespread question in the world. Rather than treating body as the obstacle to the soul, people should treat the body as a bridge to their soul. According to having the conversion with bodies, individual can learn more about themselves, then achieve a state of balance in their own life. 
- balance with environment 
The only constant in the world is change. How to find the balance in the changeable world is one of the most important subject in our life. It is a process which from finding the change of environment to reacting to it. And the process is also can be renamed as study. From a balance status to another balance status, it shows the most notable features: live, dynamic, energetic. It means there are a number of external factors affect the balance ,instead of in a isolate scene. 

'''Put the concept of balance in our game'''
- the basic scene 
- the object in the scene 
- as players,how to interactive with the game 

'''== Working flow =='''
- Motion capture system get users’ movement data 
- The model of players and scene were built in blender 
- Unity 
[[Image:software.png|software]]

'''Visual theme'''
Firstly, we want to use dots, line and face as the basic pattern, like the geometrical form. Then we want to do some transform to the basic pattern such as repetition, superimposed, offset and so on. 
[[Image:visual_1.png|visual]]
Secondly, for color matching, we want to use fluorescence color as the main color, like pink, blue and purple. We also want to use grey and yellow and other colors as the complementary color. 
Thirdly， for the color pallet, we want to create something that people wouldn’t believe it is real, like a dream, or a psychedelic trip. 
[[Image:visual_2.png|visual]]
[[Image:visual_3.png|visual]]
But after we put these style in game we found we can't control the movement of texture, it didn't reach our expectation so we chose a simple way to express it. The background is red and the player are light yellow cube. The texture looks like mottled printed paper 
[[Image:visual_4.png|visual]]

'''Coding part'''
This program has two main parts. One is to connect the Unity and theCaptury, and send the position data of each bone to the game object. The other is to control the environment parameters and generate a plain and a ball. 

These are all game objects in this project. Including all the models and scripts and other setting like camera and UI. This concept is based on object-oriented programming so that users can add components to each object based on their needs. 
[[Image:unity_1.png|unity]]

'''1.Connecting Unity and theCaputry.''' 
TheCaputry provides API for Unity applications. It uses UDP as its Internet protocol suite. In “Osc_Receive_tutorial” this script we should set remoteIP or local host if tested locally, listening port and sending port. Taking into account the stability of the system the listening and sending port should be 1065.
[[Image:unity_2.png|unity]]
In this project we have at least two or three players on stage. To define every bone in every player and put them in an array. These are all bones that can be recognized by theCaputry. 
[[Image:unity_3.png|unity]]
Unity has its own humanoid system to recognize the bones in model and match it. Users need to define animation type and avatar definition. Next step is to initialize on start up to listen for messages make sure this game object has both UDPPackIO and OSC script attached. Subscribing for the position data from theCaputry with a certain format. 
[[''"/subscribe/name of the model/blender/Root/vector 50.0 0.0 20.0"'']] 
Then the position of xyz axis is obtained and stored in a variable and transfer to a game object. 
<source lang="c#">
case "/Fiona_fit/blender/Root/vector":
hip[0] = values[0];
hip[1] = values[1];
hip[2] = values[2];
transHip.transform.position = Vector3(hip[0], -hip[2], hip[1]);
</source>
Because Unity is go up on the Y axis and theCaptury is go up on the Z axis, so pay attention to the location of the array when an game object is assigned to the position data. 

'''2.Generating plain''' 
In the second part complete three tasks. Selecting one bone on each player randomly then make up a plain or a line then generating a ball above it, the position of each player will change by the movement of each participants. 
[[Image:unity_4.png|unity]]
At first we should define every bone of players and put them in an array. We classify these bones and delete three spine bone because if they were selected player were not easy to adjust their gesture. 
<source lang="c#">
private string[] points1 = new string[17]{"Cube_hip1","Cube_LeftShoulder1","Cube_LeftForeArm1",
"Cube_LeftArm1","Cube_LeftHand1","Cube_RightShoulder1","Cube_RightForeArm1",
"Cube_RightArm1","Cube_RightHand1","Cube_LeftUpLeg1","Cube_LeftLeg1","Cube_LeftFoot1",
"Cube_RightUpLeg1","Cube_RightLeg1","Cube_RightFoot1","Cube_Neck1","Cube_Head1"};
</source>

Secondly, get a random number range from 0 to 17 then corresponding to the bone. 
<source lang="c#">
a = Random.Range (0, 17);
b = Random.Range (0, 17);
c = Random.Range (0, 17);

cube1 = GameObject.Find(points1[a]);
cube2 = GameObject.Find(points2[b]);
cube3 = GameObject.Find(points3[c]);
</source>

Thirdly, by adding MeshRenderer component to three bones to make up a plain and giving them material. Three points are combined with each other can get three vectors and using these vectors to make up a triangle mesh plain. 
<source lang="c#">
MeshRenderer mr1,mr2,mr3;
mr1 = cube1.GetComponent<MeshRenderer> ();
mr1.material = select;
mr2 = cube2.GetComponent<MeshRenderer> ();
mr2.material = select;
mr3 = cube3.GetComponent<MeshRenderer> ();
mr3.material = select;

if (sphere.activeSelf != true)
sphere.SetActive (true);

face.AddComponent<MeshCollider> ();

// Obtain the mesh renderer component through the name of gameobject (face)
MeshFilter meshFilter =face.GetComponent<MeshFilter>();
MeshRenderer mr_face = face.GetComponent<MeshRenderer>();

mr_face.material = select;

//Obtain the mesh object by mesh filter object
Mesh mesh = meshFilter.mesh;

//Create three vector objects to make up a triangle mesh
Vector3 e,f,g;
e = cube1.transform.position;
f = cube2.transform.position;
g = cube3.transform.position;
mesh.vertices = new Vector3[] {g,f,e};

Vector2 v1, v2, v3;
v1 = new Vector2 (cube1.transform.position.x, cube1.transform.position.z);
v2 = new Vector2 (cube2.transform.position.x, cube2.transform.position.z);
v3 = new Vector2 (cube3.transform.position.x, cube3.transform.position.z);

mesh.uv = new Vector2[] {v1,v2,v3};
mesh.triangles= new int []{0,1,2};
</source>

'''3.Setting environment parameters''' 
We chose to control the environment parameter manually that is to press key to change it. There are force coming from four directions up,down,left and right. There is a function in Unity which can change gravity. Using a a vector to represent force. In this case we add a upward force. When we press the key the ball will flow up. 
<source lang="c#">
if (Input.GetKeyDown (KeyCode.A))
{
Physics.gravity = new Vector3(2, -9.8f,0);
wind.SetActive (true);
up.SetActive (false);
left.SetActive (true);
right.SetActive (false);
}
</source>

GMU:Tutorials/Networking/Controlling Objects in Unity with The Captury

2016-07-31T15:42:34Z

Hito3218:

== Introduction ==
Controlling Objects in Unity with The Captury 

- Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative 
- How to create objects in Unity and arrange them so they represent the nodes 
- How to animate these Objects 

== Rotation matrix, Quaternion ==
At first we should understand some concepts.There are three ways to represent rotation that is rotation matrix, quaternion and Euler, theCaputry uses rotation matrix, Unity uses Quaternion and Euler. This tutorial focus on Rotation matrix, Quaternion. 

'''4×4 Rotation matrix''' 
TheCaputry uses it to represent rotation. Unity had only provided a 4 × 4 matrix class Matrix4x4, it contains transform T, rotation R and scaling information. You can refer to [https://en.wikipedia.org/wiki/Rotation_matrix]. 

Advantage: 
Any vector can be the rotation axis; 
Disadvantage: 
1. In fact, to rotate a object only need 4 values ,a vector(x,y,z) and a angle, but the matrix has 16 elements;
2. It will increase the amount of calculation when doing multiplication operation and resultin some waste of space and time;

'''Quaternion''' 
Quaternions are used to represent rotations. Mostly you can use Quaternion AngleAxis(float angle, Vector3 axis) to create a quaternion.Unity internally uses Quaternions to represent all rotations. you can refer to:[https://docs.unity3d.com/ScriptReference/Quaternion.html] 

Advantage: 
1. They are compact, don't suffer from gimbal lock and can easily be interpolated; 
2. It only need a 4-dimensional quaternion through the origin then can execute arbitrary rotation. In some cases it has higher efficiency than rotation matrix; 
3. It can provide a smooth interpolation; 

Disadvantage: 
1.Compare to Euler it has one more dimension, so it will be difficult to understand.

== Conversion between Rotation matrix and Quaternion ==
We might need to convert rotation matrix to quaternion depend on your project needs after we get data from theCaptury in matrix format.There i present two ways to convert there two.

'''Convert quaternion to 4×4 Rotation matrix.''' 
<source lang="csharp">
Quaternion q = Quaternion.LookRotation(new Vector3(0,0.5,1));
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1));
</source>

'''Convert 4×4 Rotation matrix to quaternion.''' 
<source lang="csharp">
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1)); //It’s the same “q” that used above
Vector4 vy = rot.GetColumn(1);
Vector4 vz = rot.GetColumn(2);
Quaternion newQ = Quaternion.LookRotation(new Vector3(vz.x,vz.y,vz.z),new Vector3(vy.x,vy.y,vy.z));
</source>

'''Other conversion:''' 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/eulerToQuaternion/index.htm Euler to Quaternion] 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/quaternionToEuler/index.htm Quaternion To Euler] 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/angleToQuaternion/index.htm AngleAxis to Quaternion] 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/quaternionToAngle/index.htm Quaternion to AngleAxis] 

== Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative ==
Cover the OSC syntax and get nodes as matrix / vector 
With OSC you can subscribe to the following:
1. subscribe to a bone position,rotation as vector in world coordinates for positions: 
/subscribe/<name of person1>/blender/@/vector 
[[Image:vector.png|left|Vector]] 
 

2. subscribe to a bone position,rotation as vector in relative coordinates for positions: 
/subscribe/<name of person1>/blender/@/upper/vector 
[[Image:vector_upper.png|left|Relative vector]] 
 

3. subscribe to a bone position,rotation as matrix in world coordinates: 
/subscribe/<name of person1>/blender/@/matrix 
[[Image:matrix.png|left|matrix]] 
 

4. subscribe to a bone position,rotation as matrix in relative coordinates: 
/subscribe/<name of person1>/blender/@/upper/matrix 
[[Image:matrix_upper.png|left|Relative matrix]] 
 

You can use transform.localPosition to get position of the transform relative to the parent transform.

== How to create objects in Unity and arrange them so they represent the nodes ==
1. Create a gameobject or you can import your own model into Unity 
[[Image:create_cube.png|Relative vector]]

2. Arrange the cube in a certain hierarchy 
[[Image:hierarchy.png|hierarchy]]

or you can import your model then automap it. 
[[Image:avatar_1.png|avatar]]
[[Image:avatar_2.png|avatar]]

== How to animate these Objects ==
Asking for data; 
<source lang="javascript">
msg = handler.StringToOscMessage("/subscribe/fiona/blender/Root/vector 50.0 0.0 20.0");
handler.Send(msg);
</source>

2. Getting data; 
<source lang="javascript">
switch (msgAddress){
case "/Fiona_fit/blender/Root/vector":
hip[0] = values[0];
hip[1] = values[1];
hip[2] = values[2];
break;}
</source>

3. Giving the data to the object. 
<source lang="javascript">
var transHip = GameObject.Find("Cube_hip1");
transHip.transform.position = Vector3(hip[0], -hip[2], hip[1]);
</source>

4. [https://www.youtube.com/watch?v=VVhXqrPgMJ0&feature=youtu.be '''Video'''] In this video i use cube to replace every bone.

GMU:Tutorials/Performance Platform/Using the tracking system

2016-07-31T15:42:16Z

Hito3218:

GMU:Tutorials/Performance Platform/Using the tracking system

2016-07-31T15:41:37Z

Hito3218:

== Introduction ==
Controlling Objects in Unity with The Captury 

- Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative 
- How to create objects in Unity and arrange them so they represent the nodes 
- How to animate these Objects 

== Rotation matrix, Quaternion ==
At first we should understand some concepts.There are three ways to represent rotation that is rotation matrix, quaternion and Euler, theCaputry uses rotation matrix, Unity uses Quaternion and Euler. This tutorial focus on Rotation matrix, Quaternion. 

'''4×4 Rotation matrix''' 
TheCaputry uses it to represent rotation. Unity had only provided a 4 × 4 matrix class Matrix4x4, it contains transform T, rotation R and scaling information. You can refer to [https://en.wikipedia.org/wiki/Rotation_matrix]. 

Advantage: 
Any vector can be the rotation axis; 
Disadvantage: 
1. In fact, to rotate a object only need 4 values ,a vector(x,y,z) and a angle, but the matrix has 16 elements;
2. It will increase the amount of calculation when doing multiplication operation and resultin some waste of space and time;

'''Quaternion''' 
Quaternions are used to represent rotations. Mostly you can use Quaternion AngleAxis(float angle, Vector3 axis) to create a quaternion.Unity internally uses Quaternions to represent all rotations. you can refer to:[https://docs.unity3d.com/ScriptReference/Quaternion.html] 

Advantage: 
1. They are compact, don't suffer from gimbal lock and can easily be interpolated; 
2. It only need a 4-dimensional quaternion through the origin then can execute arbitrary rotation. In some cases it has higher efficiency than rotation matrix; 
3. It can provide a smooth interpolation; 

Disadvantage: 
1.Compare to Euler it has one more dimension, so it will be difficult to understand.

== Conversion between Rotation matrix and Quaternion ==
We might need to convert rotation matrix to quaternion depend on your project needs after we get data from theCaptury in matrix format.There i present two ways to convert there two.

'''Convert quaternion to 4×4 Rotation matrix.''' 
<source lang="csharp">
Quaternion q = Quaternion.LookRotation(new Vector3(0,0.5,1));
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1));
</source>

'''Convert 4×4 Rotation matrix to quaternion.''' 
<source lang="csharp">
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1)); //It’s the same “q” that mentioned above
Vector4 vy = rot.GetColumn(1);
Vector4 vz = rot.GetColumn(2);
Quaternion newQ = Quaternion.LookRotation(new Vector3(vz.x,vz.y,vz.z),new Vector3(vy.x,vy.y,vy.z));
</source>

'''Other conversion:''' 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/eulerToQuaternion/index.htm Euler to Quaternion] 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/quaternionToEuler/index.htm Quaternion To Euler] 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/angleToQuaternion/index.htm AngleAxis to Quaternion] 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/quaternionToAngle/index.htm Quaternion to AngleAxis] 

== Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative ==
Cover the OSC syntax and get nodes as matrix / vector 
With OSC you can subscribe to the following:
1. subscribe to a bone position,rotation as vector in world coordinates for positions: 
/subscribe/<name of person1>/blender/@/vector 
[[Image:vector.png|left|Vector]] 
 

2. subscribe to a bone position,rotation as vector in relative coordinates for positions: 
/subscribe/<name of person1>/blender/@/upper/vector 
[[Image:vector_upper.png|left|Relative vector]] 
 

3. subscribe to a bone position,rotation as matrix in world coordinates: 
/subscribe/<name of person1>/blender/@/matrix 
[[Image:matrix.png|left|matrix]] 
 

4. subscribe to a bone position,rotation as matrix in relative coordinates: 
/subscribe/<name of person1>/blender/@/upper/matrix 
[[Image:matrix_upper.png|left|Relative matrix]] 
 

You can use transform.localPosition to get position of the transform relative to the parent transform.

== How to create objects in Unity and arrange them so they represent the nodes ==
1. Create a gameobject or you can import your own model into Unity 
[[Image:create_cube.png|Relative vector]]

2. Arrange the cube in a certain hierarchy 
[[Image:hierarchy.png|hierarchy]]

or you can import your model then automap it. 
[[Image:avatar_1.png|avatar]]
[[Image:avatar_2.png|avatar]]

== How to animate these Objects ==
Asking for data; 
<source lang="javascript">
msg = handler.StringToOscMessage("/subscribe/fiona/blender/Root/vector 50.0 0.0 20.0");
handler.Send(msg);
</source>

2. Getting data; 
<source lang="javascript">
switch (msgAddress){
case "/Fiona_fit/blender/Root/vector":
hip[0] = values[0];
hip[1] = values[1];
hip[2] = values[2];
break;}
</source>

3. Giving the data to the object. 
<source lang="javascript">
var transHip = GameObject.Find("Cube_hip1");
transHip.transform.position = Vector3(hip[0], -hip[2], hip[1]);
</source>

4. [https://www.youtube.com/watch?v=VVhXqrPgMJ0&feature=youtu.be '''Video'''] In this video i use cube to replace every bone.

GMU:Tutorials/Networking/Controlling Objects in Unity with The Captury

2016-07-31T15:40:05Z

Hito3218:

== Introduction ==
Controlling Objects in Unity with The Captury 

- Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative 
- How to create objects in Unity and arrange them so they represent the nodes 
- How to animate these Objects 

== Rotation matrix, Quaternion ==
At first we should understand some concepts.There are three ways to represent rotation that is rotation matrix, quaternion and Euler, theCaputry uses rotation matrix, Unity uses Quaternion and Euler. This tutorial focus on Rotation matrix, Quaternion. 

'''4×4 Rotation matrix''' 
TheCaputry uses it to represent rotation. Unity had only provided a 4 × 4 matrix class Matrix4x4, it contains transform T, rotation R and scaling information. You can refer to [https://en.wikipedia.org/wiki/Rotation_matrix]. 

Advantage: 
Any vector can be the rotation axis; 
Disadvantage: 
1. In fact, to rotate a object only need 4 values ,a vector(x,y,z) and a angle, but the matrix has 16 elements;
2. It will increase the amount of calculation when doing multiplication operation and resultin some waste of space and time;

'''Quaternion''' 
Quaternions are used to represent rotations. Mostly you can use Quaternion AngleAxis(float angle, Vector3 axis) to create a quaternion.Unity internally uses Quaternions to represent all rotations. you can refer to:[https://docs.unity3d.com/ScriptReference/Quaternion.html] 

Advantage: 
1. They are compact, don't suffer from gimbal lock and can easily be interpolated; 
2. It only need a 4-dimensional quaternion through the origin then can execute arbitrary rotation. In some cases it has higher efficiency than rotation matrix; 
3. It can provide a smooth interpolation; 

Disadvantage: 
1.Compare to Euler it has one more dimension, so it will be difficult to understand.

== Conversion between Rotation matrix and Quaternion ==
We might need to convert rotation matrix to quaternion depend on your project needs after we get data from theCaptury in matrix format.There i present two ways to convert there two.

'''Convert quaternion to 4×4 Rotation matrix.''' 
<source lang="csharp">
Quaternion q = Quaternion.LookRotation(new Vector3(0,0.5,1));
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1));
</source>

'''Convert 4×4 Rotation matrix to quaternion.''' 
<source lang="csharp">
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1)); //It’s the same “q” that mentioned above
Vector4 vy = rot.GetColumn(1);
Vector4 vz = rot.GetColumn(2);
Quaternion newQ = Quaternion.LookRotation(new Vector3(vz.x,vz.y,vz.z),new Vector3(vy.x,vy.y,vy.z));
</source>

'''Other conversion:''' 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/eulerToQuaternion/index.htm Euler to Quaternion] 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/quaternionToEuler/index.htm Quaternion To Euler] 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/angleToQuaternion/index.htm AngleAxis to Quaternion] 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/quaternionToAngle/index.htm Quaternion to AngleAxis] 

== Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative ==
Cover the OSC syntax and get nodes as matrix / vector 
With OSC you can subscribe to the following:
1. subscribe to a bone position,rotation as vector in world coordinates for positions: 
/subscribe/<name of person1>/blender/@/vector 
[[Image:vector.png|left|Vector]] 
 

2. subscribe to a bone position,rotation as vector in relative coordinates for positions: 
/subscribe/<name of person1>/blender/@/upper/vector 
[[Image:vector_upper.png|left|Relative vector]] 
 

3. subscribe to a bone position,rotation as matrix in world coordinates: 
/subscribe/<name of person1>/blender/@/matrix 
[[Image:matrix.png|left|matrix]] 
 

4. subscribe to a bone position,rotation as matrix in relative coordinates: 
/subscribe/<name of person1>/blender/@/upper/matrix 
[[Image:matrix_upper.png|left|Relative matrix]] 
 

You can use transform.localPosition to get position of the transform relative to the parent transform.

== How to create objects in Unity and arrange them so they represent the nodes ==
1. Create a gameobject or you can import your own model into Unity 
[[Image:create_cube.png|Relative vector]]

2. Arrange the cube in a certain hierarchy 
[[Image:hierarchy.png|hierarchy]]

or you can import your model then automap it. 
[[Image:avatar_1.png|avatar]]
[[Image:avatar_2.png|avatar]]

== How to animate these Objects ==
Asking for data; 
<source lang="javascript">
msg = handler.StringToOscMessage("/subscribe/fiona/blender/Root/vector 50.0 0.0 20.0");
handler.Send(msg);
</source>

2. Getting data; 
<source lang="javascript">
switch (msgAddress){
case "/Fiona_fit/blender/Root/vector":
hip[0] = values[0];
hip[1] = values[1];
hip[2] = values[2];
break;}
</source>

3. Giving the data to the object. 
<source lang="javascript">
var transHip = GameObject.Find("Cube_hip1");
transHip.transform.position = Vector3(hip[0], -hip[2], hip[1]);
</source>

4. [https://www.youtube.com/watch?v=VVhXqrPgMJ0&feature=youtu.be '''Video'''] In this video i use cube to replace every bone.

GMU:Tutorials/Networking/Controlling Objects in Unity with The Captury

2016-07-31T15:34:12Z

Hito3218:

== Introduction ==
Controlling Objects in Unity with The Captury 

- Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative 
- How to create objects in Unity and arrange them so they represent the nodes 
- How to animate these Objects 

== Rotation matrix, Quaternion ==
At first we should understand some concepts.There are three ways to represent rotation that is rotation matrix, quaternion and Euler, theCaputry uses rotation matrix, Unity uses Quaternion and Euler. This tutorial focus on Rotation matrix, Quaternion. 

'''4×4 Rotation matrix''' 
TheCaputry uses it to represent rotation. Unity had only provided a 4 × 4 matrix class Matrix4x4, it contains transform T, rotation R and scaling information. You can refer to [https://en.wikipedia.org/wiki/Rotation_matrix]. 

Advantage: 
Any vector can be the rotation axis; 
Disadvantage: 
1. In fact, to rotate a object only need 4 values ,a vector(x,y,z) and a angle, but the matrix has 16 elements;
2. It will increase the amount of calculation when doing multiplication operation and resultin some waste of space and time;

'''Quaternion''' 
Quaternions are used to represent rotations. Mostly you can use Quaternion AngleAxis(float angle, Vector3 axis) to create a quaternion.Unity internally uses Quaternions to represent all rotations. you can refer to:[https://docs.unity3d.com/ScriptReference/Quaternion.html] 

Advantage: 
1. They are compact, don't suffer from gimbal lock and can easily be interpolated; 
2. It only need a 4-dimensional quaternion through the origin then can execute arbitrary rotation. In some cases it has higher efficiency than rotation matrix; 
3. It can provide a smooth interpolation; 

Disadvantage: 
1.Compare to Euler it has one more dimension, so it will be difficult to understand.

== Conversion between Rotation matrix and Quaternion ==
We might need to convert rotation matrix to quaternion depend on your project needs after we get data from theCaptury in matrix format.There i present two ways to convert there two.

'''Convert quaternion to 4×4 Rotation matrix.''' 
<source lang="csharp">
Quaternion q = Quaternion.LookRotation(new Vector3(0,0.5,1));
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1));
</source>

'''Convert 4×4 Rotation matrix to quaternion.''' 
<source lang="csharp">
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1)); //It’s the same “q” that mentioned above
Vector4 vy = rot.GetColumn(1);
Vector4 vz = rot.GetColumn(2);
Quaternion newQ = Quaternion.LookRotation(new Vector3(vz.x,vz.y,vz.z),new Vector3(vy.x,vy.y,vy.z));
</source>

'''Other conversion:''' 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/eulerToQuaternion/index.htm Euler to Quaternion] 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/quaternionToEuler/index.htm Quaternion To Euler] 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/angleToQuaternion/index.htm AngleAxis to Quaternion] 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/quaternionToAngle/index.htm Quaternion to AngleAxis] 

== Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative ==
Cover the OSC syntax and get nodes as matrix / vector 
With OSC you can subscribe to the following:
1. subscribe to a bone position,rotation as vector in world coordinates for positions: 
/subscribe/<name of person1>/blender/@/vector 
[[Image:vector.png|left|Vector]] 
 

2. subscribe to a bone position,rotation as vector in relative coordinates for positions: 
/subscribe/<name of person1>/blender/@/upper/vector 
[[Image:vector_upper.png|left|Relative vector]] 
 

3. subscribe to a bone position,rotation as matrix in world coordinates: 
/subscribe/<name of person1>/blender/@/matrix 
[[Image:matrix.png|left|matrix]] 
 

4. subscribe to a bone position,rotation as matrix in relative coordinates: 
/subscribe/<name of person1>/blender/@/upper/matrix 
[[Image:matrix_upper.png|left|Relative matrix]] 
 

You can use transform.localPosition to get position of the transform relative to the parent transform.

== How to create objects in Unity and arrange them so they represent the nodes ==
1. Create a gameobject or you can import your own model into Unity 
[[Image:create_cube.png|Relative vector]]

2. Arrange the cube in a certain hierarchy 
[[Image:hierarchy.png|hierarchy]]

or you can import your model then automap it. 
[[Image:avatar_1.png|avatar]]
[[Image:avatar_2.png|avatar]]

== How to animate these Objects ==
Asking for data; 
<source lang="javascript">
msg = handler.StringToOscMessage("/subscribe/fiona/blender/Root/vector 50.0 0.0 20.0");
handler.Send(msg);
</source>

2. Getting data; 
<source lang="javascript">
switch (msgAddress){
case "/Fiona_fit/blender/Root/vector":
hip[0] = values[0];
hip[1] = values[1];
hip[2] = values[2];
break;}
</source>

3. Giving the data to the object. 
<source lang="javascript">
var transHip = GameObject.Find("Cube_hip1");
transHip.transform.position = Vector3(hip[0], -hip[2], hip[1]);
</source>

4. [https://www.youtube.com/watch?v=VVhXqrPgMJ0&feature=youtu.be '''Video''']

GMU:Tutorials/Networking/Controlling Objects in Unity with The Captury

2016-07-31T15:33:30Z

Hito3218:

== Introduction ==
Controlling Objects in Unity with The Captury 

- Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative 
- How to create objects in Unity and arrange them so they represent the nodes 
- How to animate these Objects 

== Rotation matrix, Quaternion ==
At first we should understand some concepts.There are three ways to represent rotation that is rotation matrix, quaternion and Euler, theCaputry uses rotation matrix, Unity uses Quaternion and Euler. This tutorial focus on Rotation matrix, Quaternion. 

'''4×4 Rotation matrix''' 
TheCaputry uses it to represent rotation. Unity had only provided a 4 × 4 matrix class Matrix4x4, it contains transform T, rotation R and scaling information. You can refer to [https://en.wikipedia.org/wiki/Rotation_matrix]. 

Advantage: 
Any vector can be the rotation axis; 
Disadvantage: 
1. In fact, to rotate a object only need 4 values ,a vector(x,y,z) and a angle, but the matrix has 16 elements;
2. It will increase the amount of calculation when doing multiplication operation and resultin some waste of space and time;

'''Quaternion''' 
Quaternions are used to represent rotations. Mostly you can use Quaternion AngleAxis(float angle, Vector3 axis) to create a quaternion.Unity internally uses Quaternions to represent all rotations. you can refer to:[https://docs.unity3d.com/ScriptReference/Quaternion.html] 

Advantage: 
1. They are compact, don't suffer from gimbal lock and can easily be interpolated; 
2. It only need a 4-dimensional quaternion through the origin then can execute arbitrary rotation. In some cases it has higher efficiency than rotation matrix; 
3. It can provide a smooth interpolation; 

Disadvantage: 
1.Compare to Euler it has one more dimension, so it will be difficult to understand.

== Conversion between Rotation matrix and Quaternion ==
We might need to convert rotation matrix to quaternion depend on your project needs after we get data from theCaptury in matrix format.There i present two ways to convert there two.

'''Convert quaternion to 4×4 Rotation matrix.''' 
<source lang="csharp">
Quaternion q = Quaternion.LookRotation(new Vector3(0,0.5,1));
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1));
</source>

'''Convert 4×4 Rotation matrix to quaternion.''' 
<source lang="csharp">
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1)); //It’s the same “q” that mentioned above
Vector4 vy = rot.GetColumn(1);
Vector4 vz = rot.GetColumn(2);
Quaternion newQ = Quaternion.LookRotation(new Vector3(vz.x,vz.y,vz.z),new Vector3(vy.x,vy.y,vy.z));
</source>

'''Other converion:''' 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/eulerToQuaternion/index.htm Euler to Quaternion] 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/quaternionToEuler/index.htm Quaternion To Euler] 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/angleToQuaternion/index.htm AngleAxis to Quaternion] 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/quaternionToAngle/index.htm Quaternion to AngleAxis] 

== Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative ==
Cover the OSC syntax and get nodes as matrix / vector 
With OSC you can subscribe to the following:
1. subscribe to a bone position,rotation as vector in world coordinates for positions: 
/subscribe/<name of person1>/blender/@/vector 
[[Image:vector.png|left|Vector]] 
 

2. subscribe to a bone position,rotation as vector in relative coordinates for positions: 
/subscribe/<name of person1>/blender/@/upper/vector 
[[Image:vector_upper.png|left|Relative vector]] 
 

3. subscribe to a bone position,rotation as matrix in world coordinates: 
/subscribe/<name of person1>/blender/@/matrix 
[[Image:matrix.png|left|matrix]] 
 

4. subscribe to a bone position,rotation as matrix in relative coordinates: 
/subscribe/<name of person1>/blender/@/upper/matrix 
[[Image:matrix_upper.png|left|Relative matrix]] 
 

You can use transform.localPosition to get position of the transform relative to the parent transform.

== How to create objects in Unity and arrange them so they represent the nodes ==
1. Create a gameobject or you can import your own model into Unity 
[[Image:create_cube.png|Relative vector]]

2. Arrange the cube in a certain hierarchy 
[[Image:hierarchy.png|hierarchy]]

or you can import your model then automap it. 
[[Image:avatar_1.png|avatar]]
[[Image:avatar_2.png|avatar]]

== How to animate these Objects ==
Asking for data; 
<source lang="javascript">
msg = handler.StringToOscMessage("/subscribe/fiona/blender/Root/vector 50.0 0.0 20.0");
handler.Send(msg);
</source>

2. Getting data; 
<source lang="javascript">
switch (msgAddress){
case "/Fiona_fit/blender/Root/vector":
hip[0] = values[0];
hip[1] = values[1];
hip[2] = values[2];
break;}
</source>

3. Giving the data to the object. 
<source lang="javascript">
var transHip = GameObject.Find("Cube_hip1");
transHip.transform.position = Vector3(hip[0], -hip[2], hip[1]);
</source>

4. [https://www.youtube.com/watch?v=VVhXqrPgMJ0&feature=youtu.be '''Video''']

GMU:Tutorials/Networking/Controlling Objects in Unity with The Captury

2016-07-31T15:32:03Z

Hito3218:

== Introduction ==
Controlling Objects in Unity with The Captury 

- Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative 
- How to create objects in Unity and arrange them so they represent the nodes 
- How to animate these Objects 

== Rotation matrix, Quaternion ==
At first we should understand some concepts.There are three ways to represent rotation that is rotation matrix, quaternion and Euler, theCaputry uses rotation matrix, Unity uses Quaternion and Euler. This tutorial focus on Rotation matrix, Quaternion. 

4×4 Rotation matrix 
TheCaputry uses it to represent rotation. Unity had only provided a 4 × 4 matrix class Matrix4x4, it contains transform T, rotation R and scaling information. You can refer to [https://en.wikipedia.org/wiki/Rotation_matrix]. 

Advantage: 
Any vector can be the rotation axis; 
Disadvantage: 
1. In fact, to rotate a object only need 4 values ,a vector(x,y,z) and a angle, but the matrix has 16 elements;
2. It will increase the amount of calculation when doing multiplication operation and resultin some waste of space and time;

Quaternion 
Quaternions are used to represent rotations. Mostly you can use Quaternion AngleAxis(float angle, Vector3 axis) to create a quaternion.Unity internally uses Quaternions to represent all rotations. you can refer to:[https://docs.unity3d.com/ScriptReference/Quaternion.html] 

Advantage: 
1. They are compact, don't suffer from gimbal lock and can easily be interpolated; 
2. It only need a 4-dimensional quaternion through the origin then can execute arbitrary rotation. In some cases it has higher efficiency than rotation matrix; 
3. It can provide a smooth interpolation; 

Disadvantage: 
1.Compare to Euler it has one more dimension, so it will be difficult to understand.

== Conversion between Rotation matrix and Quaternion ==
We might need to convert rotation matrix to quaternion depend on your project needs after we get data from theCaptury in matrix format.There i present two ways to convert there two.

Convert quaternion to 4×4 Rotation matrix. 
<source lang="csharp">
Quaternion q = Quaternion.LookRotation(new Vector3(0,0.5,1));
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1));
</source>

Convert 4×4 Rotation matrix to quaternion. 
<source lang="csharp">
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1)); //It’s the same “q” that mentioned above
Vector4 vy = rot.GetColumn(1);
Vector4 vz = rot.GetColumn(2);
Quaternion newQ = Quaternion.LookRotation(new Vector3(vz.x,vz.y,vz.z),new Vector3(vy.x,vy.y,vy.z));
</source>

Other conversion 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/eulerToQuaternion/index.htm Euler to Quaternion] 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/quaternionToEuler/index.htm Quaternion To Euler] 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/angleToQuaternion/index.htm AngleAxis to Quaternion] 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/quaternionToAngle/index.htm Quaternion to AngleAxis] 

== Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative ==
Cover the OSC syntax and get nodes as matrix / vector 
With OSC you can subscribe to the following:
1. subscribe to a bone position,rotation as vector in world coordinates for positions: 
/subscribe/<name of person1>/blender/@/vector 
[[Image:vector.png|left|Vector]] 
 

2. subscribe to a bone position,rotation as vector in relative coordinates for positions: 
/subscribe/<name of person1>/blender/@/upper/vector 
[[Image:vector_upper.png|left|Relative vector]] 
 

3. subscribe to a bone position,rotation as matrix in world coordinates: 
/subscribe/<name of person1>/blender/@/matrix 
[[Image:matrix.png|left|matrix]] 
 

4. subscribe to a bone position,rotation as matrix in relative coordinates: 
/subscribe/<name of person1>/blender/@/upper/matrix 
[[Image:matrix_upper.png|left|Relative matrix]] 
 

You can use transform.localPosition to get position of the transform relative to the parent transform.

== How to create objects in Unity and arrange them so they represent the nodes ==
1. Create a gameobject or you can import your own model into Unity 
[[Image:create_cube.png|Relative vector]]

2. Arrange the cube in a certain hierarchy 
[[Image:hierarchy.png|hierarchy]]

or you can import your model then automap it. 
[[Image:avatar_1.png|avatar]]
[[Image:avatar_2.png|avatar]]

== How to animate these Objects ==
Asking for data; 
<source lang="javascript">
msg = handler.StringToOscMessage("/subscribe/fiona/blender/Root/vector 50.0 0.0 20.0");
handler.Send(msg);
</source>

2. Getting data; 
<source lang="javascript">
switch (msgAddress){
case "/Fiona_fit/blender/Root/vector":
hip[0] = values[0];
hip[1] = values[1];
hip[2] = values[2];
break;}
</source>

3. Giving the data to the object. 
<source lang="javascript">
var transHip = GameObject.Find("Cube_hip1");
transHip.transform.position = Vector3(hip[0], -hip[2], hip[1]);
</source>

4. [https://www.youtube.com/watch?v=VVhXqrPgMJ0&feature=youtu.be Video]

GMU:Tutorials/Networking/Controlling Objects in Unity with The Captury

2016-07-31T15:30:20Z

Hito3218:

== Introduction ==
Controlling Objects in Unity with The Captury 

- Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative 
- How to create objects in Unity and arrange them so they represent the nodes 
- How to animate these Objects 

== Rotation matrix, Quaternion ==
At first we should understand some concepts.There are three ways to represent rotation that is rotation matrix, quaternion and Euler, theCaputry uses rotation matrix, Unity uses Quaternion and Euler. This tutorial focus on Rotation matrix, Quaternion. 

4×4 Rotation matrix 
TheCaputry uses it to represent rotation. Unity had only provided a 4 × 4 matrix class Matrix4x4, it contains transform T, rotation R and scaling information. You can refer to [https://en.wikipedia.org/wiki/Rotation_matrix]. 

Advantage: 
Any vector can be the rotation axis; 
Disadvantage: 
1. In fact, to rotate a object only need 4 values ,a vector(x,y,z) and a angle, but the matrix has 16 elements;
2. It will increase the amount of calculation when doing multiplication operation and resultin some waste of space and time;

Quaternion 
Quaternions are used to represent rotations. Mostly you can use Quaternion AngleAxis(float angle, Vector3 axis) to create a quaternion.Unity internally uses Quaternions to represent all rotations. you can refer to:[https://docs.unity3d.com/ScriptReference/Quaternion.html] 

Advantage: 
1. They are compact, don't suffer from gimbal lock and can easily be interpolated; 
2. It only need a 4-dimensional quaternion through the origin then can execute arbitrary rotation. In some cases it has higher efficiency than rotation matrix; 
3. It can provide a smooth interpolation; 

Disadvantage: 
1.Compare to Euler it has one more dimension, so it will be difficult to understand.

== Conversion between Rotation matrix and Quaternion ==
We might need to convert rotation matrix to quaternion depend on your project needs after we get data from theCaptury in matrix format.There i present two ways to convert there two.

Convert quaternion to 4×4 Rotation matrix. 
<source lang="csharp">
Quaternion q = Quaternion.LookRotation(new Vector3(0,0.5,1));
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1));
</source>

Convert 4×4 Rotation matrix to quaternion. 
<source lang="csharp">
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1)); //It’s the same “q” that mentioned above
Vector4 vy = rot.GetColumn(1);
Vector4 vz = rot.GetColumn(2);
Quaternion newQ = Quaternion.LookRotation(new Vector3(vz.x,vz.y,vz.z),new Vector3(vy.x,vy.y,vy.z));
</source>

Other conversion
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/eulerToQuaternion/index.htm Euler to Quaternion] 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/quaternionToEuler/index.htm Quaternion To Euler] 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/angleToQuaternion/index.htm AngleAxis to Quaternion] 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/quaternionToAngle/index.htm Quaternion to AngleAxis] 

== Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative ==
Cover the OSC syntax and get nodes as matrix / vector 
With OSC you can subscribe to the following:
1. subscribe to a bone position,rotation as vector in world coordinates for positions: 
/subscribe/<name of person1>/blender/@/vector 
[[Image:vector.png|left|Vector]] 
 

2. subscribe to a bone position,rotation as vector in relative coordinates for positions: 
/subscribe/<name of person1>/blender/@/upper/vector 
[[Image:vector_upper.png|left|Relative vector]] 
 

3. subscribe to a bone position,rotation as matrix in world coordinates: 
/subscribe/<name of person1>/blender/@/matrix 
[[Image:matrix.png|left|matrix]] 
 

4. subscribe to a bone position,rotation as matrix in relative coordinates: 
/subscribe/<name of person1>/blender/@/upper/matrix 
[[Image:matrix_upper.png|left|Relative matrix]] 
 

You can use transform.localPosition to get position of the transform relative to the parent transform.

== How to create objects in Unity and arrange them so they represent the nodes ==
1. Create a gameobject or you can import your own model into Unity 
[[Image:create_cube.png|Relative vector]]

2. Arrange the cube in a certain hierarchy 
[[Image:hierarchy.png|hierarchy]]

or you can import your model then automap it. 
[[Image:avatar_1.png|avatar]]
[[Image:avatar_2.png|avatar]]

== How to animate these Objects ==
Asking for data; 
<source lang="javascript">
msg = handler.StringToOscMessage("/subscribe/fiona/blender/Root/vector 50.0 0.0 20.0");
handler.Send(msg);
</source>

2. Getting data; 
<source lang="javascript">
switch (msgAddress){
case "/Fiona_fit/blender/Root/vector":
hip[0] = values[0];
hip[1] = values[1];
hip[2] = values[2];
break;}
</source>

3. Giving the data to the object. 
<source lang="javascript">
var transHip = GameObject.Find("Cube_hip1");
transHip.transform.position = Vector3(hip[0], -hip[2], hip[1]);
</source>

4. [https://www.youtube.com/watch?v=VVhXqrPgMJ0&feature=youtu.be Video]

GMU:Tutorials/Networking/Controlling Objects in Unity with The Captury

2016-07-31T15:27:18Z

Hito3218:

== Introduction ==
Controlling Objects in Unity with The Captury 

- Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative 
- How to create objects in Unity and arrange them so they represent the nodes 
- How to animate these Objects 

== Rotation matrix, Quaternion ==
At first we should understand some concepts.There are three ways to represent rotation that is rotation matrix, quaternion and Euler, theCaputry uses rotation matrix, Unity uses Quaternion and Euler. This tutorial focus on Rotation matrix, Quaternion. 

*4×4 Rotation matrix 
TheCaputry uses it to represent rotation. Unity had only provided a 4 × 4 matrix class Matrix4x4, it contains transform T, rotation R and scaling information. You can refer to [https://en.wikipedia.org/wiki/Rotation_matrix]. 

Advantage: 
Any vector can be the rotation axis; 
Disadvantage: 
1. In fact, to rotate a object only need 4 values ,a vector(x,y,z) and a angle, but the matrix has 16 elements;
2. It will increase the amount of calculation when doing multiplication operation and resultin some waste of space and time;

*Quaternion 
Quaternions are used to represent rotations. Mostly you can use Quaternion AngleAxis(float angle, Vector3 axis) to create a quaternion.Unity internally uses Quaternions to represent all rotations. you can refer to:[https://docs.unity3d.com/ScriptReference/Quaternion.html] 

Advantage: 
1. They are compact, don't suffer from gimbal lock and can easily be interpolated; 
2. It only need a 4-dimensional quaternion through the origin then can execute arbitrary rotation. In some cases it has higher efficiency than rotation matrix; 
3. It can provide a smooth interpolation; 

Disadvantage: 
1.Compare to Euler it has one more dimension, so it will be difficult to understand.

== Conversion between Rotation matrix and Quaternion ==
We might need to convert rotation matrix to quaternion depend on your project needs after we get data from theCaptury in matrix format.There i present two ways to convert there two.

*Convert quaternion to 4×4 Rotation matrix. 
<source lang="csharp">
Quaternion q = Quaternion.LookRotation(new Vector3(0,0.5,1));
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1));
</source>

*Convert 4×4 Rotation matrix to quaternion. 
<source lang="csharp">
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1)); //It’s the same “q” that mentioned above
Vector4 vy = rot.GetColumn(1);
Vector4 vz = rot.GetColumn(2);
Quaternion newQ = Quaternion.LookRotation(new Vector3(vz.x,vz.y,vz.z),new Vector3(vy.x,vy.y,vy.z));
</source>

*Other conversion
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/eulerToQuaternion/index.htm Euler to Quaternion] 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/quaternionToEuler/index.htm Quaternion To Euler] 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/angleToQuaternion/index.htm AngleAxis to Quaternion] 
[http://www.euclideanspace.com/maths/geometry/rotations/conversions/quaternionToAngle/index.htm Quaternion to AngleAxis] 

== Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative ==
* Cover the OSC syntax and get nodes as matrix / vector 
With OSC you can subscribe to the following:
1. subscribe to a bone position,rotation as vector in world coordinates for positions: 
/subscribe/<name of person1>/blender/@/vector 
[[Image:vector.png|left|Vector]] 
 

2. subscribe to a bone position,rotation as vector in relative coordinates for positions: 
/subscribe/<name of person1>/blender/@/upper/vector 
[[Image:vector_upper.png|left|Relative vector]] 
 

3. subscribe to a bone position,rotation as matrix in world coordinates: 
/subscribe/<name of person1>/blender/@/matrix 
[[Image:matrix.png|left|matrix]] 
 

4. subscribe to a bone position,rotation as matrix in relative coordinates: 
/subscribe/<name of person1>/blender/@/upper/matrix 
[[Image:matrix_upper.png|left|Relative matrix]] 
 

*You can use transform.localPosition to get position of the transform relative to the parent transform.

== How to create objects in Unity and arrange them so they represent the nodes ==
1. Create a gameobject or you can import your own model into Unity 
[[Image:create_cube.png|Relative vector]]

2. Arrange the cube in a certain hierarchy 
[[Image:hierarchy.png|hierarchy]]

or you can import your model then automap it. 
[[Image:avatar_1.png|avatar]]
[[Image:avatar_2.png|avatar]]

== How to animate these Objects ==
Asking for data; 
<source lang="javascript">
msg = handler.StringToOscMessage("/subscribe/fiona/blender/Root/vector 50.0 0.0 20.0");
handler.Send(msg);
</source>

2. Getting data; 
<source lang="javascript">
switch (msgAddress){
case "/Fiona_fit/blender/Root/vector":
hip[0] = values[0];
hip[1] = values[1];
hip[2] = values[2];
break;}
</source>

3. Giving the data to the object. 
<source lang="javascript">
var transHip = GameObject.Find("Cube_hip1");
transHip.transform.position = Vector3(hip[0], -hip[2], hip[1]);
</source>

4. Video

GMU:Tutorials/Networking/Controlling Objects in Unity with The Captury

2016-07-31T15:03:15Z

Hito3218:

== Introduction ==
Controlling Objects in Unity with The Captury 

- Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative 
- How to create objects in Unity and arrange them so they represent the nodes 
- How to animate these Objects 

== Rotation matrix, Quaternion ==
At first we should understand some concepts.There are three ways to represent rotation that is rotation matrix, quaternion and Euler, theCaputry uses rotation matrix, Unity uses Quaternion and Euler. This tutorial focus on Rotation matrix, Quaternion. 

*4×4 Rotation matrix 
TheCaputry uses it to represent rotation. Unity had only provided a 4 × 4 matrix class Matrix4x4, it contains transform T, rotation R and scaling information. You can refer to [https://en.wikipedia.org/wiki/Rotation_matrix]. 

Advantage: 
Any vector can be the rotation axis; 
Disadvantage: 
1. In fact, to rotate a object only need 4 values ,a vector(x,y,z) and a angle, but the matrix has 16 elements;
2. It will increase the amount of calculation when doing multiplication operation and resultin some waste of space and time;

*Quaternion 
Quaternions are used to represent rotations. Mostly you can use Quaternion AngleAxis(float angle, Vector3 axis) to create a quaternion.Unity internally uses Quaternions to represent all rotations. you can refer to:[https://docs.unity3d.com/ScriptReference/Quaternion.html] 

Advantage: 
1. They are compact, don't suffer from gimbal lock and can easily be interpolated; 
2. It only need a 4-dimensional quaternion through the origin then can execute arbitrary rotation. In some cases it has higher efficiency than rotation matrix; 
3. It can provide a smooth interpolation; 

Disadvantage: 
1.Compare to Euler it has one more dimension, so it will be difficult to understand.

== Conversion between Rotation matrix and Quaternion ==
We might need to convert rotation matrix to quaternion depend on your project needs after we get data from theCaptury in matrix format.There i present two ways to convert there two.

Convert quaternion to 4×4 Rotation matrix. 
<source lang="csharp">
Quaternion q = Quaternion.LookRotation(new Vector3(0,0.5,1));
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1));
</source>

Convert 4×4 Rotation matrix to quaternion. 
<source lang="csharp">
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1)); //It’s the same “q” that mentioned above
Vector4 vy = rot.GetColumn(1);
Vector4 vz = rot.GetColumn(2);
Quaternion newQ = Quaternion.LookRotation(new Vector3(vz.x,vz.y,vz.z),new Vector3(vy.x,vy.y,vy.z));
</source>

== Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative ==
* Cover the OSC syntax and get nodes as matrix / vector 
With OSC you can subscribe to the following:
1. subscribe to a bone position,rotation as vector in world coordinates for positions: 
/subscribe/<name of person1>/blender/@/vector 
[[Image:vector.png|left|Vector]] 
 

2. subscribe to a bone position,rotation as vector in relative coordinates for positions: 
/subscribe/<name of person1>/blender/@/upper/vector 
[[Image:vector_upper.png|left|Relative vector]] 
 

3. subscribe to a bone position,rotation as matrix in world coordinates: 
/subscribe/<name of person1>/blender/@/matrix 
[[Image:matrix.png|left|matrix]] 
 

4. subscribe to a bone position,rotation as matrix in relative coordinates: 
/subscribe/<name of person1>/blender/@/upper/matrix 
[[Image:matrix_upper.png|left|Relative matrix]] 
 

You can use transform.localPosition to get position of the transform relative to the parent transform.

== How to create objects in Unity and arrange them so they represent the nodes ==
1. Create a gameobject or you can import your own model into Unity 
[[Image:create_cube.png|Relative vector]]

2. Arrange the cube in a certain hierarchy 
[[Image:hierarchy.png|hierarchy]]

or you can import your model then automap it. 
[[Image:avatar_1.png|avatar]]
[[Image:avatar_2.png|avatar]]

== How to animate these Objects ==
Asking for data; 
<source lang="javascript">
msg = handler.StringToOscMessage("/subscribe/fiona/blender/Root/vector 50.0 0.0 20.0");
handler.Send(msg);
</source>

2. Getting data; 
<source lang="javascript">
switch (msgAddress){
case "/Fiona_fit/blender/Root/vector":
hip[0] = values[0];
hip[1] = values[1];
hip[2] = values[2];
break;}
</source>

3. Giving the data to the object. 
<source lang="javascript">
var transHip = GameObject.Find("Cube_hip1");
transHip.transform.position = Vector3(hip[0], -hip[2], hip[1]);
</source>

4. Video

GMU:Tutorials/Networking/Controlling Objects in Unity with The Captury

2016-07-31T15:02:37Z

Hito3218:

== Introduction ==
Controlling Objects in Unity with The Captury 

- Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative 
- How to create objects in Unity and arrange them so they represent the nodes 
- How to animate these Objects 

== Rotation matrix, Quaternion ==
At first we should understand some concepts.There are three ways to represent rotation that is rotation matrix, quaternion and Euler, theCaputry uses rotation matrix, Unity uses Quaternion and Euler. This tutorial focus on Rotation matrix, Quaternion. 

*4×4 Rotation matrix 
TheCaputry uses it to represent rotation. Unity had only provided a 4 × 4 matrix class Matrix4x4, it contains transform T, rotation R and scaling information. You can refer to [https://en.wikipedia.org/wiki/Rotation_matrix]. 

Advantage: 
Any vector can be the rotation axis; 
Disadvantage: 
1. In fact, to rotate a object only need 4 values ,a vector(x,y,z) and a angle, but the matrix has 16 elements;
2. It will increase the amount of calculation when doing multiplication operation and resultin some waste of space and time;

*Quaternion 
Quaternions are used to represent rotations. Mostly you can use Quaternion AngleAxis(float angle, Vector3 axis) to create a quaternion.Unity internally uses Quaternions to represent all rotations. you can refer to:[https://docs.unity3d.com/ScriptReference/Quaternion.html] 

Advantage: 
1. They are compact, don't suffer from gimbal lock and can easily be interpolated; 
2. It only need a 4-dimensional quaternion through the origin then can execute arbitrary rotation. In some cases it has higher efficiency than rotation matrix; 
3. It can provide a smooth interpolation; 

Disadvantage: 
1.Compare to Euler it has one more dimension, so it will be difficult to understand.

== Conversion between Rotation matrix and Quaternion ==
We might need to convert rotation matrix to quaternion depend on your project needs after we get data from theCaptury in matrix format.There i present two ways to convert there two.

Convert quaternion to 4×4 Rotation matrix. 
<source lang="csharp">
Quaternion q = Quaternion.LookRotation(new Vector3(0,0.5,1));
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1));
</source>

Convert 4×4 Rotation matrix to quaternion. 
<source lang="csharp">
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1)); //It’s the same “q” that mentioned above
Vector4 vy = rot.GetColumn(1);
Vector4 vz = rot.GetColumn(2);
Quaternion newQ = Quaternion.LookRotation(new Vector3(vz.x,vz.y,vz.z),new Vector3(vy.x,vy.y,vy.z));
</source>

== Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative ==
* Cover the OSC syntax and get nodes as matrix / vector 
With OSC you can subscribe to the following:
1. subscribe to a bone position,rotation as vector in world coordinates for positions: 
/subscribe/<name of person1>/blender/@/vector 
[[Image:vector.png|left|Vector]] 
 

2. subscribe to a bone position,rotation as vector in relative coordinates for positions: 
/subscribe/<name of person1>/blender/@/upper/vector 
[[Image:vector_upper.png|left|Relative vector]] 
 

3. subscribe to a bone position,rotation as matrix in world coordinates: 
/subscribe/<name of person1>/blender/@/matrix 
[[Image:matrix.png|left|matrix]] 
 

4. subscribe to a bone position,rotation as matrix in relative coordinates: 
/subscribe/<name of person1>/blender/@/upper/matrix 
[[Image:matrix_upper.png|left|Relative matrix]] 
 

You can use transform.localPosition to get position of the transform relative to the parent transform.

== How to create objects in Unity and arrange them so they represent the nodes ==
1. Create a gameobject or you can import your own model into Unity 
[[Image:create_cube.png|Relative vector]]

2. Arrange the cube in a certain hierarchy 
[[Image:hierarchy.png|hierarchy]]
or you can import your model then automap it. 
[[Image:avatar_1.png|avatar]]
[[Image:avatar_2.png|avatar]]

== How to animate these Objects ==
Asking for data; 
<source lang="javascript">
msg = handler.StringToOscMessage("/subscribe/fiona/blender/Root/vector 50.0 0.0 20.0");
handler.Send(msg);
</source>

2. Getting data; 
<source lang="javascript">
switch (msgAddress){
case "/Fiona_fit/blender/Root/vector":
hip[0] = values[0];
hip[1] = values[1];
hip[2] = values[2];
break;}
</source>

3. Giving the data to the object. 
<source lang="javascript">
var transHip = GameObject.Find("Cube_hip1");
transHip.transform.position = Vector3(hip[0], -hip[2], hip[1]);
</source>

4. Video

GMU:Tutorials/Networking/Controlling Objects in Unity with The Captury

2016-07-31T15:01:59Z

Hito3218:

== Introduction ==
Controlling Objects in Unity with The Captury 

- Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative 
- How to create objects in Unity and arrange them so they represent the nodes 
- How to animate these Objects 

== Rotation matrix, Quaternion ==
At first we should understand some concepts.There are three ways to represent rotation that is rotation matrix, quaternion and Euler, theCaputry uses rotation matrix, Unity uses Quaternion and Euler. This tutorial focus on Rotation matrix, Quaternion. 

*4×4 Rotation matrix 
TheCaputry uses it to represent rotation. Unity had only provided a 4 × 4 matrix class Matrix4x4, it contains transform T, rotation R and scaling information. You can refer to [https://en.wikipedia.org/wiki/Rotation_matrix]. 

Advantage: 
Any vector can be the rotation axis; 
Disadvantage: 
1. In fact, to rotate a object only need 4 values ,a vector(x,y,z) and a angle, but the matrix has 16 elements;
2. It will increase the amount of calculation when doing multiplication operation and resultin some waste of space and time;

*Quaternion 
Quaternions are used to represent rotations. Mostly you can use Quaternion AngleAxis(float angle, Vector3 axis) to create a quaternion.Unity internally uses Quaternions to represent all rotations. you can refer to:[https://docs.unity3d.com/ScriptReference/Quaternion.html] 

Advantage: 
1. They are compact, don't suffer from gimbal lock and can easily be interpolated; 
2. It only need a 4-dimensional quaternion through the origin then can execute arbitrary rotation. In some cases it has higher efficiency than rotation matrix; 
3. It can provide a smooth interpolation; 

Disadvantage: 
1.Compare to Euler it has one more dimension, so it will be difficult to understand.

== Conversion between Rotation matrix and Quaternion ==
We might need to convert rotation matrix to quaternion depend on your project needs after we get data from theCaptury in matrix format.There i present two ways to convert there two.

Convert quaternion to 4×4 Rotation matrix. 
<source lang="csharp">
Quaternion q = Quaternion.LookRotation(new Vector3(0,0.5,1));
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1));
</source>

Convert 4×4 Rotation matrix to quaternion. 
<source lang="csharp">
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1)); //It’s the same “q” that mentioned above
Vector4 vy = rot.GetColumn(1);
Vector4 vz = rot.GetColumn(2);
Quaternion newQ = Quaternion.LookRotation(new Vector3(vz.x,vz.y,vz.z),new Vector3(vy.x,vy.y,vy.z));
</source>

== Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative ==
* Cover the OSC syntax and get nodes as matrix / vector 
With OSC you can subscribe to the following:
1. subscribe to a bone position,rotation as vector in world coordinates for positions: 
/subscribe/<name of person1>/blender/@/vector 
[[Image:vector.png|left|Vector]] 
 

2. subscribe to a bone position,rotation as vector in relative coordinates for positions: 
/subscribe/<name of person1>/blender/@/upper/vector 
[[Image:vector_upper.png|left|Relative vector]] 
 

3. subscribe to a bone position,rotation as matrix in world coordinates: 
/subscribe/<name of person1>/blender/@/matrix 
[[Image:matrix.png|left|matrix]]
 

4. subscribe to a bone position,rotation as matrix in relative coordinates: 
/subscribe/<name of person1>/blender/@/upper/matrix 
[[Image:matrix_upper.png|left|Relative matrix]]
 

You can use transform.localPosition to get position of the transform relative to the parent transform.

== How to create objects in Unity and arrange them so they represent the nodes ==
1. Create a gameobject or you can import your own model into Unity 
[[Image:create_cube.png|Relative vector]]

2. Arrange the cube in a certain hierarchy 
[[Image:hierarchy.png|hierarchy]]
or you can import your model then automap it. 
[[Image:avatar_1.png|avatar]]
[[Image:avatar_2.png|avatar]]

== How to animate these Objects ==
Asking for data; 
<source lang="javascript">
msg = handler.StringToOscMessage("/subscribe/fiona/blender/Root/vector 50.0 0.0 20.0");
handler.Send(msg);
</source>

2. Getting data; 
<source lang="javascript">
switch (msgAddress){
case "/Fiona_fit/blender/Root/vector":
hip[0] = values[0];
hip[1] = values[1];
hip[2] = values[2];
break;}
</source>

3. Giving the data to the object. 
<source lang="javascript">
var transHip = GameObject.Find("Cube_hip1");
transHip.transform.position = Vector3(hip[0], -hip[2], hip[1]);
</source>

4. Video

GMU:Tutorials/Networking/Controlling Objects in Unity with The Captury

2016-07-31T15:00:59Z

Hito3218:

== Introduction ==
Controlling Objects in Unity with The Captury 

- Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative 
- How to create objects in Unity and arrange them so they represent the nodes 
- How to animate these Objects 

== Rotation matrix, Quaternion ==
At first we should understand some concepts.There are three ways to represent rotation that is rotation matrix, quaternion and Euler, theCaputry uses rotation matrix, Unity uses Quaternion and Euler. This tutorial focus on Rotation matrix, Quaternion. 

*4×4 Rotation matrix 
TheCaputry uses it to represent rotation. Unity had only provided a 4 × 4 matrix class Matrix4x4, it contains transform T, rotation R and scaling information. You can refer to [https://en.wikipedia.org/wiki/Rotation_matrix]. 

Advantage: 
Any vector can be the rotation axis; 
Disadvantage: 
1. In fact, to rotate a object only need 4 values ,a vector(x,y,z) and a angle, but the matrix has 16 elements;
2. It will increase the amount of calculation when doing multiplication operation and resultin some waste of space and time;

*Quaternion 
Quaternions are used to represent rotations. Mostly you can use Quaternion AngleAxis(float angle, Vector3 axis) to create a quaternion.Unity internally uses Quaternions to represent all rotations. you can refer to:[https://docs.unity3d.com/ScriptReference/Quaternion.html] 

Advantage: 
1. They are compact, don't suffer from gimbal lock and can easily be interpolated; 
2. It only need a 4-dimensional quaternion through the origin then can execute arbitrary rotation. In some cases it has higher efficiency than rotation matrix; 
3. It can provide a smooth interpolation; 

Disadvantage: 
1.Compare to Euler it has one more dimension, so it will be difficult to understand.

== Conversion between Rotation matrix and Quaternion ==
We might need to convert rotation matrix to quaternion depend on your project needs after we get data from theCaptury in matrix format.There i present two ways to convert there two.

Convert quaternion to 4×4 Rotation matrix. 
<source lang="csharp">
Quaternion q = Quaternion.LookRotation(new Vector3(0,0.5,1));
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1));
</source>

Convert 4×4 Rotation matrix to quaternion. 
<source lang="csharp">
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1)); //It’s the same “q” that mentioned above
Vector4 vy = rot.GetColumn(1);
Vector4 vz = rot.GetColumn(2);
Quaternion newQ = Quaternion.LookRotation(new Vector3(vz.x,vz.y,vz.z),new Vector3(vy.x,vy.y,vy.z));
</source>

== Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative ==
* Cover the OSC syntax and get nodes as matrix / vector 
With OSC you can subscribe to the following:
1. subscribe to a bone position,rotation as vector in world coordinates for positions: 
/subscribe/<name of person1>/blender/@/vector 
[[Image:vector.png|left|Vector]]
 

2. subscribe to a bone position,rotation as vector in relative coordinates for positions: 
/subscribe/<name of person1>/blender/@/upper/vector 
[[Image:vector_upper.png|left|Relative vector]]
 

3. subscribe to a bone position,rotation as matrix in world coordinates: 
/subscribe/<name of person1>/blender/@/matrix 
[[Image:matrix.png|left|matrix]]
 

4. subscribe to a bone position,rotation as matrix in relative coordinates: 
/subscribe/<name of person1>/blender/@/upper/matrix 
[[Image:matrix_upper.png|left|Relative matrix]]
 

You can use transform.localPosition to get position of the transform relative to the parent transform.

== How to create objects in Unity and arrange them so they represent the nodes ==
1. Create a gameobject or you can import your own model into Unity 
[[Image:create_cube.png|Relative vector]]

2. Arrange the cube in a certain hierarchy 
[[Image:hierarchy.png|hierarchy]]
or you can import your model then automap it. 
[[Image:avatar_1.png|avatar]]
[[Image:avatar_2.png|avatar]]

== How to animate these Objects ==
Asking for data; 
<source lang="javascript">
msg = handler.StringToOscMessage("/subscribe/fiona/blender/Root/vector 50.0 0.0 20.0");
handler.Send(msg);
</source>

2. Getting data; 
<source lang="javascript">
switch (msgAddress){
case "/Fiona_fit/blender/Root/vector":
hip[0] = values[0];
hip[1] = values[1];
hip[2] = values[2];
break;}
</source>

3. Giving the data to the object. 
<source lang="javascript">
var transHip = GameObject.Find("Cube_hip1");
transHip.transform.position = Vector3(hip[0], -hip[2], hip[1]);
</source>

4. Video

GMU:Tutorials/Networking/Controlling Objects in Unity with The Captury

2016-07-31T15:00:06Z

Hito3218:

== Introduction ==
Controlling Objects in Unity with The Captury 

- Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative 
- How to create objects in Unity and arrange them so they represent the nodes 
- How to animate these Objects 

== Rotation matrix, Quaternion ==
At first we should understand some concepts.There are three ways to represent rotation that is rotation matrix, quaternion and Euler, theCaputry uses rotation matrix, Unity uses Quaternion and Euler. This tutorial focus on Rotation matrix, Quaternion. 

*4×4 Rotation matrix 
TheCaputry uses it to represent rotation. Unity had only provided a 4 × 4 matrix class Matrix4x4, it contains transform T, rotation R and scaling information. You can refer to [https://en.wikipedia.org/wiki/Rotation_matrix]. 

Advantage: 
Any vector can be the rotation axis; 
Disadvantage: 
1. In fact, to rotate a object only need 4 values ,a vector(x,y,z) and a angle, but the matrix has 16 elements;
2. It will increase the amount of calculation when doing multiplication operation and resultin some waste of space and time;

*Quaternion 
Quaternions are used to represent rotations. Mostly you can use Quaternion AngleAxis(float angle, Vector3 axis) to create a quaternion.Unity internally uses Quaternions to represent all rotations. you can refer to:[https://docs.unity3d.com/ScriptReference/Quaternion.html] 

Advantage: 
1. They are compact, don't suffer from gimbal lock and can easily be interpolated; 
2. It only need a 4-dimensional quaternion through the origin then can execute arbitrary rotation. In some cases it has higher efficiency than rotation matrix; 
3. It can provide a smooth interpolation; 

Disadvantage: 
1.Compare to Euler it has one more dimension, so it will be difficult to understand.

== Conversion between Rotation matrix and Quaternion ==
We might need to convert rotation matrix to quaternion depend on your project needs after we get data from theCaptury in matrix format.There i present two ways to convert there two.

Convert quaternion to 4×4 Rotation matrix. 
<source lang="csharp">
Quaternion q = Quaternion.LookRotation(new Vector3(0,0.5,1));
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1));
</source>

Convert 4×4 Rotation matrix to quaternion. 
<source lang="csharp">
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1)); //It’s the same “q” that mentioned above
Vector4 vy = rot.GetColumn(1);
Vector4 vz = rot.GetColumn(2);
Quaternion newQ = Quaternion.LookRotation(new Vector3(vz.x,vz.y,vz.z),new Vector3(vy.x,vy.y,vy.z));
</source>

== Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative ==
* Cover the OSC syntax and get nodes as matrix / vector 
With OSC you can subscribe to the following:
1. subscribe to a bone position,rotation as vector in world coordinates for positions: 
/subscribe/<name of person1>/blender/@/vector 
[[Image:vector.png|left|Vector]]
 

2. subscribe to a bone position,rotation as vector in relative coordinates for positions: 
/subscribe/<name of person1>/blender/@/upper/vector 
[[Image:vector_upper.png|left|Relative vector]]
 

3. subscribe to a bone position,rotation as matrix in world coordinates: 
/subscribe/<name of person1>/blender/@/matrix 
[[Image:matrix.png|left|matrix]]
 

4. subscribe to a bone position,rotation as matrix in relative coordinates: 
/subscribe/<name of person1>/blender/@/upper/matrix 
[[Image:matrix_upper.png|left|Relative matrix]]
 

You can use transform.localPosition to get position of the transform relative to the parent transform.

== How to create objects in Unity and arrange them so they represent the nodes ==
1. Create a gameobject or you can import your own model into Unity 
[[Image:create_cube.png|left|Relative vector]]

2. Arrange the cube in a certain hierarchy 
[[Image:hierarchy.png|left|hierarchy]]
or you can import your model then automap it. 
[[Image:avatar_1.png|left|avatar]]
[[Image:avatar_2.png|left|avatar]]

== How to animate these Objects ==
Asking for data; 
<source lang="javascript">
msg = handler.StringToOscMessage("/subscribe/fiona/blender/Root/vector 50.0 0.0 20.0");
handler.Send(msg);
</source>

2. Getting data; 
<source lang="javascript">
switch (msgAddress){
case "/Fiona_fit/blender/Root/vector":
hip[0] = values[0];
hip[1] = values[1];
hip[2] = values[2];
break;}
</source>

3. Giving the data to the object. 
<source lang="javascript">
var transHip = GameObject.Find("Cube_hip1");
transHip.transform.position = Vector3(hip[0], -hip[2], hip[1]);
</source>

4. Video

File:Avatar 2.png

2016-07-31T14:57:51Z

Hito3218:

== Summary ==

== Copyright status: ==

== Source: ==

File:Avatar 1.png

2016-07-31T14:57:34Z

Hito3218:

== Summary ==

== Copyright status: ==

== Source: ==

File:Hierarchy.png

2016-07-31T14:57:21Z

Hito3218:

== Summary ==

== Copyright status: ==

== Source: ==

File:Create cube.png

2016-07-31T14:56:53Z

Hito3218:

== Summary ==

== Copyright status: ==

== Source: ==

File:Matrix upper.png

2016-07-31T14:56:21Z

Hito3218:

== Summary ==

== Copyright status: ==

== Source: ==

File:Matrix.png

2016-07-31T14:56:07Z

Hito3218:

== Summary ==

== Copyright status: ==

== Source: ==

File:Vector upper.png

2016-07-31T14:55:41Z

Hito3218:

== Summary ==

== Copyright status: ==

== Source: ==

File:Vector.png

2016-07-31T14:55:08Z

Hito3218:

== Summary ==

== Copyright status: ==

== Source: ==

GMU:Tutorials/Networking/Controlling Objects in Unity with The Captury

2016-07-31T14:53:53Z

Hito3218:

== Introduction ==
Controlling Objects in Unity with The Captury 

- Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative 
- How to create objects in Unity and arrange them so they represent the nodes 
- How to animate these Objects 

== Rotation matrix, Quaternion ==
At first we should understand some concepts.There are three ways to represent rotation that is rotation matrix, quaternion and Euler, theCaputry uses rotation matrix, Unity uses Quaternion and Euler. This tutorial focus on Rotation matrix, Quaternion. 

*4×4 Rotation matrix 
TheCaputry uses it to represent rotation. Unity had only provided a 4 × 4 matrix class Matrix4x4, it contains transform T, rotation R and scaling information. You can refer to [https://en.wikipedia.org/wiki/Rotation_matrix]. 

Advantage: 
Any vector can be the rotation axis; 
Disadvantage: 
1. In fact, to rotate a object only need 4 values ,a vector(x,y,z) and a angle, but the matrix has 16 elements;
2. It will increase the amount of calculation when doing multiplication operation and resultin some waste of space and time;

*Quaternion 
Quaternions are used to represent rotations. Mostly you can use Quaternion AngleAxis(float angle, Vector3 axis) to create a quaternion.Unity internally uses Quaternions to represent all rotations. you can refer to:[https://docs.unity3d.com/ScriptReference/Quaternion.html] 

Advantage: 
1. They are compact, don't suffer from gimbal lock and can easily be interpolated; 
2. It only need a 4-dimensional quaternion through the origin then can execute arbitrary rotation. In some cases it has higher efficiency than rotation matrix; 
3. It can provide a smooth interpolation; 

Disadvantage: 
1.Compare to Euler it has one more dimension, so it will be difficult to understand.

== Conversion between Rotation matrix and Quaternion ==
We might need to convert rotation matrix to quaternion depend on your project needs after we get data from theCaptury in matrix format.There i present two ways to convert there two.

Convert quaternion to 4×4 Rotation matrix. 
<source lang="csharp">
Quaternion q = Quaternion.LookRotation(new Vector3(0,0.5,1));
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1));
</source>

Convert 4×4 Rotation matrix to quaternion. 
<source lang="csharp">
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1)); //It’s the same “q” that mentioned above
Vector4 vy = rot.GetColumn(1);
Vector4 vz = rot.GetColumn(2);
Quaternion newQ = Quaternion.LookRotation(new Vector3(vz.x,vz.y,vz.z),new Vector3(vy.x,vy.y,vy.z));
</source>

== Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative ==
* Cover the OSC syntax and get nodes as matrix / vector 
With OSC you can subscribe to the following:
1. subscribe to a bone position,rotation as vector in world coordinates for positions: 
/subscribe/<name of person1>/blender/@/vector 
[[Image:vector.png|left|Vector]]
 

2. subscribe to a bone position,rotation as vector in relative coordinates for positions: 
/subscribe/<name of person1>/blender/@/upper/vector 
[[Image:vector_upper.png|left|Relative vector]]
 

3. subscribe to a bone position,rotation as matrix in world coordinates: 
/subscribe/<name of person1>/blender/@/matrix 
[[Image:matrix.png|left|Relative vector]]
 

4. subscribe to a bone position,rotation as matrix in relative coordinates: 
/subscribe/<name of person1>/blender/@/upper/matrix 
[[Image:matrix_upper.png|left|Relative vector]]
 

You can use transform.localPosition to get position of the transform relative to the parent transform.

== How to create objects in Unity and arrange them so they represent the nodes ==
1. Create a gameobject or you can import your own model into Unity 
[[Image:create_cube.png|left|Relative vector]]

2. Arrange the cube in a certain hierarchy 
[[Image:hierarchy.png|left|Relative vector]]
or you can import your model then automap it. 
[[Image:avatar_1.png|left|Relative vector]]
[[Image:avatar_2.png|left|Relative vector]]

== How to animate these Objects ==
Asking for data; 
<source lang="javascript">
msg = handler.StringToOscMessage("/subscribe/fiona/blender/Root/vector 50.0 0.0 20.0");
handler.Send(msg);
</source>

2. Getting data; 
<source lang="javascript">
switch (msgAddress){
case "/Fiona_fit/blender/Root/vector":
hip[0] = values[0];
hip[1] = values[1];
hip[2] = values[2];
break;}
</source>

3. Giving the data to the object. 
<source lang="javascript">
var transHip = GameObject.Find("Cube_hip1");
transHip.transform.position = Vector3(hip[0], -hip[2], hip[1]);
</source>

4. Video

GMU:Tutorials/Networking/Controlling Objects in Unity with The Captury

2016-07-31T14:53:17Z

Hito3218:

== Introduction ==
Controlling Objects in Unity with The Captury 

- Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative 
- How to create objects in Unity and arrange them so they represent the nodes 
- How to animate these Objects 

== Rotation matrix, Quaternion ==
At first we should understand some concepts.There are three ways to represent rotation that is rotation matrix, quaternion and Euler, theCaputry uses rotation matrix, Unity uses Quaternion and Euler. This tutorial focus on Rotation matrix, Quaternion. 

*4×4 Rotation matrix 
TheCaputry uses it to represent rotation. Unity had only provided a 4 × 4 matrix class Matrix4x4, it contains transform T, rotation R and scaling information. You can refer to [https://en.wikipedia.org/wiki/Rotation_matrix]. 

Advantage: 
Any vector can be the rotation axis; 
Disadvantage: 
1. In fact, to rotate a object only need 4 values ,a vector(x,y,z) and a angle, but the matrix has 16 elements;
2. It will increase the amount of calculation when doing multiplication operation and resultin some waste of space and time;

*Quaternion 
Quaternions are used to represent rotations. Mostly you can use Quaternion AngleAxis(float angle, Vector3 axis) to create a quaternion.Unity internally uses Quaternions to represent all rotations. you can refer to:[https://docs.unity3d.com/ScriptReference/Quaternion.html] 

Advantage: 
1. They are compact, don't suffer from gimbal lock and can easily be interpolated; 
2. It only need a 4-dimensional quaternion through the origin then can execute arbitrary rotation. In some cases it has higher efficiency than rotation matrix; 
3. It can provide a smooth interpolation; 

Disadvantage: 
1.Compare to Euler it has one more dimension, so it will be difficult to understand.

== Conversion between Rotation matrix and Quaternion ==
We might need to convert rotation matrix to quaternion depend on your project needs after we get data from theCaptury in matrix format.There i present two ways to convert there two.

Convert quaternion to 4×4 Rotation matrix. 
<source lang="csharp">
Quaternion q = Quaternion.LookRotation(new Vector3(0,0.5,1));
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1));
</source>

Convert 4×4 Rotation matrix to quaternion. 
<source lang="csharp">
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1)); //It’s the same “q” that mentioned above
Vector4 vy = rot.GetColumn(1);
Vector4 vz = rot.GetColumn(2);
Quaternion newQ = Quaternion.LookRotation(new Vector3(vz.x,vz.y,vz.z),new Vector3(vy.x,vy.y,vy.z));
</source>

== Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative ==
* Cover the OSC syntax and get nodes as matrix / vector 
With OSC you can subscribe to the following:
1. subscribe to a bone position,rotation as vector in world coordinates for positions: 
/subscribe/<name of person1>/blender/@/vector 
[[Image:vector.png|left|Vector]]
 

2. subscribe to a bone position,rotation as vector in relative coordinates for positions: 
/subscribe/<name of person1>/blender/@/upper/vector 
[[Image:vector_upper.png|left|Relative vector]]
 

3. subscribe to a bone position,rotation as matrix in world coordinates: 
/subscribe/<name of person1>/blender/@/matrix 
[[Image:matrix.png|left|Relative vector]]
 

4. subscribe to a bone position,rotation as matrix in relative coordinates: 
/subscribe/<name of person1>/blender/@/upper/matrix 
[[Image:matrix_upper.png|left|Relative vector]]
 

You can use transform.localPosition to get position of the transform relative to the parent transform.

== How to create objects in Unity and arrange them so they represent the nodes ==
1. Create a gameobject or you can import your own model into Unity 
[[Image:create_cube.png|left|Relative vector]]

2. Arrange the cube in a certain hierarchy 
[[Image:hierarchy.png|left|Relative vector]]
or you can import your model then automap it. 
[[Image:avatar_1.png|left|Relative vector]]
[[Image:avatar_2.png|left|Relative vector]]

== How to animate these Objects ==
Asking for data; 
<source lang="javac=script">
msg = handler.StringToOscMessage("/subscribe/fiona/blender/Root/vector 50.0 0.0 20.0");
handler.Send(msg);
</source>

2. Getting data; 
<source lang="javascript">
switch (msgAddress){
case "/Fiona_fit/blender/Root/vector":
hip[0] = values[0];
hip[1] = values[1];
hip[2] = values[2];
break;}
</source>

3. Giving the data to the object. 
<source lang="javascript">
var transHip = GameObject.Find("Cube_hip1");
transHip.transform.position = Vector3(hip[0], -hip[2], hip[1]);
</source>

4. Video

GMU:Tutorials/Networking/Controlling Objects in Unity with The Captury

2016-07-31T14:50:52Z

Hito3218:

== Introduction ==
Controlling Objects in Unity with The Captury 

- Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative 
- How to create objects in Unity and arrange them so they represent the nodes 
- How to animate these Objects 

== Rotation matrix, Quaternion ==
At first we should understand some concepts.There are three ways to represent rotation that is rotation matrix, quaternion and Euler, theCaputry uses rotation matrix, Unity uses Quaternion and Euler. This tutorial focus on Rotation matrix, Quaternion. 

*4×4 Rotation matrix 
TheCaputry uses it to represent rotation. Unity had only provided a 4 × 4 matrix class Matrix4x4, it contains transform T, rotation R and scaling information. You can refer to [https://en.wikipedia.org/wiki/Rotation_matrix]. 

Advantage: 
Any vector can be the rotation axis; 
Disadvantage: 
1. In fact, to rotate a object only need 4 values ,a vector(x,y,z) and a angle, but the matrix has 16 elements;
2. It will increase the amount of calculation when doing multiplication operation and resultin some waste of space and time;

*Quaternion 
Quaternions are used to represent rotations. Mostly you can use Quaternion AngleAxis(float angle, Vector3 axis) to create a quaternion.Unity internally uses Quaternions to represent all rotations. you can refer to:[https://docs.unity3d.com/ScriptReference/Quaternion.html] 

Advantage: 
1. They are compact, don't suffer from gimbal lock and can easily be interpolated; 
2. It only need a 4-dimensional quaternion through the origin then can execute arbitrary rotation. In some cases it has higher efficiency than rotation matrix; 
3. It can provide a smooth interpolation; 

Disadvantage: 
1.Compare to Euler it has one more dimension, so it will be difficult to understand.

== Conversion between Rotation matrix and Quaternion ==
We might need to convert rotation matrix to quaternion depend on your project needs after we get data from theCaptury in matrix format.There i present two ways to convert there two.

Convert quaternion to 4×4 Rotation matrix. 
<source lang="C#">
Quaternion q = Quaternion.LookRotation(new Vector3(0,0.5,1));
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1));
</source>

Convert 4×4 Rotation matrix to quaternion. 
<source lang="C#">
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1)); //It’s the same “q” that mentioned above
Vector4 vy = rot.GetColumn(1);
Vector4 vz = rot.GetColumn(2);
Quaternion newQ = Quaternion.LookRotation(new Vector3(vz.x,vz.y,vz.z),new Vector3(vy.x,vy.y,vy.z));
</source>

== Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative ==
* Cover the OSC syntax and get nodes as matrix / vector 
With OSC you can subscribe to the following:
1. subscribe to a bone position,rotation as vector in world coordinates for positions: 
/subscribe/<name of person1>/blender/@/vector 
[[Image:vector.png|left|Vector]]
 

2. subscribe to a bone position,rotation as vector in relative coordinates for positions: 
/subscribe/<name of person1>/blender/@/upper/vector 
[[Image:vector_upper.png|left|Relative vector]]
 

3. subscribe to a bone position,rotation as matrix in world coordinates: 
/subscribe/<name of person1>/blender/@/matrix 
[[Image:matrix.png|left|Relative vector]]
 

4. subscribe to a bone position,rotation as matrix in relative coordinates: 
/subscribe/<name of person1>/blender/@/upper/matrix 
[[Image:matrix_upper.png|left|Relative vector]]
 

You can use transform.localPosition to get position of the transform relative to the parent transform.

== How to create objects in Unity and arrange them so they represent the nodes ==
1. Create a gameobject or you can import your own model into Unity 
[[Image:create_cube.png|left|Relative vector]]

2. Arrange the cube in a certain hierarchy 
[[Image:hierarchy.png|left|Relative vector]]
or you can import your model then automap it. 
[[Image:avatar_1.png|left|Relative vector]]
[[Image:avatar_2.png|left|Relative vector]]

== How to animate these Objects ==
Asking for data; 
<source lang="javac=script">
msg = handler.StringToOscMessage("/subscribe/fiona/blender/Root/vector 50.0 0.0 20.0");
handler.Send(msg);
</source>

2. Getting data; 
<source lang="javascript">
switch (msgAddress){
case "/Fiona_fit/blender/Root/vector":
hip[0] = values[0];
hip[1] = values[1];
hip[2] = values[2];
break;}
</source>

3. Giving the data to the object. 
<source lang="javascript">
var transHip = GameObject.Find("Cube_hip1");
transHip.transform.position = Vector3(hip[0], -hip[2], hip[1]);
</source>

4. Video

GMU:Tutorials/Networking/Controlling Objects in Unity with The Captury

2016-07-31T14:48:59Z

Hito3218: Created page with "== Introduction == Controlling Objects in Unity with The Captury - Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative - How to create ob..."

== Introduction ==
Controlling Objects in Unity with The Captury 

- Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative 
- How to create objects in Unity and arrange them so they represent the nodes 
- How to animate these Objects 

== Rotation matrix, Quaternion ==
At first we should understand some concepts.There are three ways to represent rotation that is rotation matrix, quaternion and Euler, theCaputry uses rotation matrix, Unity uses Quaternion and Euler. This tutorial focus on Rotation matrix, Quaternion. 

*4×4 Rotation matrix 
TheCaputry uses it to represent rotation. Unity had only provided a 4 × 4 matrix class Matrix4x4, it contains transform T, rotation R and scaling information. You can refer to [https://en.wikipedia.org/wiki/Rotation_matrix]. 

Advantage: 
Any vector can be the rotation axis; 
Disadvantage: 
1. In fact, to rotate a object only need 4 values ,a vector(x,y,z) and a angle, but the matrix has 16 elements;
2. It will increase the amount of calculation when doing multiplication operation and resultin some waste of space and time;

*Quaternion 
Quaternions are used to represent rotations. Mostly you can use Quaternion AngleAxis(float angle, Vector3 axis) to create a quaternion.Unity internally uses Quaternions to represent all rotations. you can refer to:[https://docs.unity3d.com/ScriptReference/Quaternion.html] 

Advantage: 
1. They are compact, don't suffer from gimbal lock and can easily be interpolated; 
2. It only need a 4-dimensional quaternion through the origin then can execute arbitrary rotation. In some cases it has higher efficiency than rotation matrix; 
3. It can provide a smooth interpolation; 

Disadvantage: 
1.Compare to Euler it has one more dimension, so it will be difficult to understand.

== Conversion between Rotation matrix and Quaternion ==
We might need to convert rotation matrix to quaternion depend on your project needs after we get data from theCaptury in matrix format.There i present two ways to convert there two.

Convert quaternion to 4×4 Rotation matrix. 
<source>
Quaternion q = Quaternion.LookRotation(new Vector3(0,0.5,1));
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1));
</source>

Convert 4×4 Rotation matrix to quaternion. 
<source>
Matrix4x4 rot = new Matrix4x4();
rot.SetTRS(new Vector3(0,0,0),q,new Vector3(1,1,1)); //It’s the same “q” that mentioned above
Vector4 vy = rot.GetColumn(1);
Vector4 vz = rot.GetColumn(2);

Quaternion newQ = Quaternion.LookRotation(new Vector3(vz.x,vz.y,vz.z),new Vector3(vy.x,vy.y,vy.z));
</source>

== Cover the OSC syntax and how to get nodes as matrix / vector, absolute and relative ==
* Cover the OSC syntax and get nodes as matrix / vector 
With OSC you can subscribe to the following:
1. subscribe to a bone position,rotation as vector in world coordinates for positions: 
/subscribe/<name of person1>/blender/@/vector 
[[Image:vector.png|left|Vector]]
 

2. subscribe to a bone position,rotation as vector in relative coordinates for positions: 
/subscribe/<name of person1>/blender/@/upper/vector 
[[Image:vector_upper.png|left|Relative vector]]
 

3. subscribe to a bone position,rotation as matrix in world coordinates: 
/subscribe/<name of person1>/blender/@/matrix 
[[Image:matrix.png|left|Relative vector]]
 

4. subscribe to a bone position,rotation as matrix in relative coordinates: 
/subscribe/<name of person1>/blender/@/upper/matrix 
[[Image:matrix_upper.png|left|Relative vector]]
 

You can use transform.localPosition to get position of the transform relative to the parent transform.

== How to create objects in Unity and arrange them so they represent the nodes ==
1. Create a gameobject or you can import your own model into Unity 
[[Image:create_cube.png|left|Relative vector]]

2. Arrange the cube in a certain hierarchy 
[[Image:hierarchy.png|left|Relative vector]]
or you can import your model then automap it. 
[[Image:avatar_1.png|left|Relative vector]]
[[Image:avatar_2.png|left|Relative vector]]

== How to animate these Objects ==
Asking for data; 
<source>
msg = handler.StringToOscMessage("/subscribe/fiona/blender/Root/vector 50.0 0.0 20.0");
handler.Send(msg);
</source>

2. Getting data; 
<source>
switch (msgAddress){
case "/Fiona_fit/blender/Root/vector":
hip[0] = values[0];
hip[1] = values[1];
hip[2] = values[2];
break;}
</source>

3. Giving the data to the object. 
<source>
var transHip = GameObject.Find("Cube_hip1");
transHip.transform.position = Vector3(hip[0], -hip[2], hip[1]);
</source>

4. Video

GMU:Performance Platform

2016-06-28T20:41:53Z

Hito3218: /* Project Groups */

The '''''Interactive Performance Platform''''' is a lab for artistic research operated by the [[GMU:Start|GMU]].
== Location ==

'''Interactive Performance Platform'''
Digital Bauhaus Lab, Room 001 (Ground Floor)
Bauhausstr. 9a
99423 Weimar

== Hardware ==

[[Image:performance-platform-videowall.png|thumb|left|200px|The videowall in action]]
[[Image:the-captury-screenshot.png|thumb|left|300px|Screenshot from the tracking software]]

 

* markerless multi-person tracking
* highspeed camera for longterm-recording
* 12.2 channel audio system
* 4 x 4 tiled video wall
* 4 mac workstations

== Setup ==

[[Image:performance-platform-setup.png|500px]]

== Schedule ==

The Performance Platform is used for artistic research. 
However there are occasional workshops and modules inside the lab to introduce the participants to the technology and foster the emergence of cross-disciplinary projects.

The place may be crowded during modules and workshops.
Please try not to disturb during those times.
Thank you :)

=== Regular Schedule ===

Note:
Starting June 13th the Lab will be used for Project-Work and Workshops.
If you want access to the lab please get in contact with [[Martin Schneider]]

{|align="left" {{Prettytable}}
|
!Monday
!Tuesday
!Wednesday
!Thursday
!Friday
!Saturday
!Sunday
|-
!09:15 - 10:45
|Lab-Time
|Lab-Time
|Lab-Time
|Lab-Time
|Lab-Time
|Lab-Time
|Lab-Time
|-
!11:00 - 12:30
|Lab-Time
|Lab-Time
|Lab-Time
|Lab-Time
|Lab-Time
|Lab-Time
|Lab-Time
|-
!13:30 - 15:00
|Lab-Time
|Lab-Time
|Lab-Time
|Lab-Time
|Lab-Time
|Lab-Time
|Lab-Time
|-
!15:15 - 16:45
|Lab-Time
|Lab-Time
|Lab-Time
|Lab-Time
|Lab-Time
|Lab-Time
|Lab-Time
|-
!17:00 - 18:30
|Lab-Time
|Lab-Time
|[[GMU:Digital_Puppetry_Lab|Tutorium]] / Lab-Time
|Lab-Time
|Lab-Time
|Lab-Time
|Lab-Time
|-
!19:00 - 20:30
|Lab-Time
|[[GMU:Digital_Puppetry_Lab|Tutorium]]
|[[GMU:Digital_Puppetry_Lab|Tutorium]] / Lab-Time
|Lab-Time
|Lab-Time
|Lab-Time
|Lab-Time
|}

=== Workshops ===

{|align="left" {{Prettytable}}
! workshop title
! first day
! last day
|-
| [[GMU:Digital_Puppetry_Lab|Digital Puppetry Lab]] - Martin Schneider (GMU/EXPTV)
| Friday, 15. April
| Sunday 17. April
|-
| [[EXPTV:Start|UNITY-Workshop]] - Stephan Iserman (EXPTV)
| Thursday, 12. May
| Friday 13. May
|-
| [[GMU:Minecraft Ecologies|Minecraft Ecologies I]] Martin Schneider (GMU)
| Friday, 13. May
| Sunday 15. May
|-
| [[GMU:Human_and_Nonhuman_Performances_II_SS16|Bio-Semiotics]] - Dario Martinelli (GMU)
| Friday, 17. May
| Sunday 19. May
|-
| [[GMU:Minecraft Ecologies|Minecraft Ecologies II]] - Martin Schneider (GMU)
| Friday, 20. May
| Sunday 22. May
|-
| [[GMU:Minecraft Ecologies|Minecraft Ecologies III]] - Daniel Braun, Thomas Hawranke (GMU)
| Friday, 24. May
| Sunday 26. May
|}

 

=== Group Work ===

The following 12 dates are available for group work. Please mention at least 3 days, that would would work for you in your group profile! We will activate you for the day and send you a short email when once you are active.

By working in the lab you agree that you have read and understood, and that you will honour the [[GMU:Nutzungsordnung_IPP|Nutzungsordnung]]. You are fully responsible for any damage that occurs during your group work period. (Even if caused by somebody else).

 

* '''SLOT 1''' – 16. June (Thu) – PASSED
* '''SLOT 2''' – 17. June (Fri) – Group 7
* '''SLOT 3''' – 18. June (Sat) – Individuals: Jessica Hüttig, Tim Vischer
* '''SLOT 4''' – 20. June (Mon) – Individuals: Jessica Hüttig, Tim Vischer

* '''SLOT 5''' – 23. June (Thu) – Group 2
* '''SLOT 6''' – 27. June (Mon) – Group 8
* '''SLOT 7''' – 28. June (Tue) – Group 4
* '''SLOT 8''' – 29. June (Wed) – Group 5

* '''SLOT 9''' – 30. June (Thu) – Individuals: Di Yang + Group 9
* '''SLOT 10''' – 01. July (Fri) – Group 2
* '''SLOT 11''' – 02. July (Sat) – Group 6 + Group 10
* '''SLOT 12''' – 03. July (Sun) – Group 7

* '''SLOT 13''' – 04. July (Mon)
* '''SLOT 14''' – 05. July (Tue) – Group 4
* '''SLOT 15''' – 06. July (Wed)
* '''SLOT 16''' – 07. July (Thu)
* '''SLOT 17''' – 08. July (Fri)
* '''SLOT 18''' – 09. July (Sat)
* '''SLOT 19''' – 19. July (Sun)

== Project Groups ==

NOTE:
The person printed in bold face is responsible for the lab, in case anything goes wrong.

* Group 1 – '''[[GMU:Minecraft_Ecologies|Minecraft Ecologies]] – GMU'''
** Preferred Slots: ???
** '''Meike Halle'''
** Marcel Gohsen
** Asha Murali
** Andre Faupel
* Group 2 – '''[[Physical Sound Environment]] – GMU'''
** Preferred Slots: 10, 11, 12
** '''Kan Feng''' – Tutorial: [[GMU:Tutorials/Performance_Platform/Capture_with_Processing|Custom Setup to count People using a Light Barrier]]
** Shuyan Chen – Tutorial:[[Custom Setup to track People using a Camera on the Ceiling]]
** Shih-Li Chao – Tutorial: [[GMU:Tutorials/Performance_Platform/Sound_System_Stereo|Play Stereo on the Sound System]]
* Group 3 – '''[[/Multiple Gravity|Multiple Gravity]] – ExpTV'''
** Preferred Slots: ''none''
** '''Benjamin Vossler''' – [[GMU:Tutorials/Networking/Controlling_MAX-MSP_with_TheCaptury|Controlling Max MSP with the Captury]]
** Gianluca Pandolfo – [[GMU:Tutorials/Networking/Controlling_Unity_with_TheCaptury|Controling Unity with The Captury]]
* Group 4 – '''[[/Madre Monte|Madre Monte]] – ExpTV'''
** Preferred Slots: 6, 7, 8, 14, 16, 17
** '''Emilio Aguas''' – Tutorial: [[GMU:Tutorials/Performance Platform/Tracking Platform Export|Using the Multi-Speaker-System]]
** Fiona Mortimer – Tutorial Title 2
** Eduardo Oliviera – Tutorial Title 3
* Group 5 – '''[[/Bounce & Rebound|Bounce & Rebound]] – ExpTV'''
** Preferred Slots: 6, 7, 8
** '''Jonas Jülch''' – Tutorial: [[GMU:Tutorials/Performance_Platform/Tracking_Platform_Rigging|Using Tracking Data in Blender]]
** Leif Weitzel – Tutorial: [[/Networking/Controlling MAX MSP with IanniX|Controlling MAX MSP with IanniX]]
* Group 6 – '''[[/Escape or Kill|Escape or Kill]] – ExpTV'''
** Slot: 11
** '''Florian Froger''' – Tutorial: [[GMU:Tutorials/Performance Platform/Tracking Platform Export|Exporting Tracking Data]]
* Group 7 – '''[[/Dependance|Dependance]] – ExpTV'''
** Preferred Slots: 2, 3, 10, 11, 12
** '''Alicia Kremser''' – Tutorial Title 1
** Tim Vischer
** Adam Streicher - [[GMU:Tutorials/Networking/Controlling_Unity_with_TheCaptury|Controling Unity with The Captury]]
* Group 8 – '''[[/Group dynamics|Group Dyamics]] – ExpTV'''
** Preferred Slots: 6
** '''Kei Kitamura''' – Tutorial Title 1
* Group 9 – '''[[/Woll's World|Woll's World]] – GMU'''
** Preferred Slots: 6, 7, 8, 9, 10
** '''Yun Liu''' - Tutorial: [[GMU:Tutorials/Visual Interaction/Using Unity for simulation|Control 3D knot by the data of position and velocity in real-time]]
** '''Xiangzhen Fan'''- Tutorial: [[GMU:Tutorials/Visual Interaction/Using Unity for simulation|Simulating 3D knot in real-time]]
** '''Qianqian Li'''- Tutorial: [[GMU:Tutorials/Performance_Platform/Using the tracking system|Using the Tracking System to Track the position of joints]]
* Group 10 – '''[[/Balance|Balance]] – GMU'''
** Preferred Slots: 7,8,10,11,12
** '''Yuxin Tan''' - Tutorial: [[GMU:Tutorials/Performance_Platform/Using the tracking system|Using the Tracking System to Track the position of bones in Unity]]
** '''Junyuan Wu''' - Tutorial: [[GMU:Tutorials/Performance_Platform/Using the tracking system|Using the Tracking System to control the movement of the scene in Unity]]

== Individuals ==
* Jessica Hüttig – Tutorial: [[GMU:Tutorials/Performance Platform/Tracking Platform Calibration|Calibrating the Tracking System]]
**Preferred slots: 3
* Di Yang – Tutorial: [[GMU:Tutorials/Performance Platform/Videowall Calibration|Calibrating the Videowall]]
** preferred slots: 8, 9, 10
* Rachel Smith - [[GMU:Tutorials/Performance_Platform/Recognizing_Gestures_with_Wekinator|Recognising Gestures with Wekinator]]
** Preferred slots: 10, 11, 12
* Christopher Dake-Outhet – Tutorial: [[GMU:Tutorials/Performance Platform/Tracking Platform Calibration|Recording Tacking Data]]
** preferred slots: 6, 8, 12
* Elena Liv Felderer - Tutorial: [[GMU: Tutorials/Networking Tutorials|Controlling Unity with Processing]]
** no slots for me

== Highlights ==
* Student projects from the [[GMU:Spacial_Information_Lab#Participants|Spacial Information Lab]]
* Tracking 3 dancers for the [https://vimeo.com/156704320 3D-Pitoti project]

== Tutorials ==
As part of the [[GMU:Digital_Puppetry_Lab|Introduction to the Lab]] the students will create [[GMU:Tutorials#Performance_Plattform_Tutorials|Online Tutorials]]. 
The tutorials will explain how to use the technology available at the Performance Platform.

== Mailing-List ==
There is an internal mailing list for everyone that has their working space on the DBL groundfloor. 
Please contact [[Martin Schneider]] if you think you should be on that list.

== Links ==
* [https://www.uni-weimar.de/en/media/institutes/digital-bauhaus-lab Digital Bauhaus Lab Website]
* [[GMU:Nutzungsordnung_IPP|Nutzungsordnung]]

GMU:Performance Platform/Balance

2016-06-28T09:03:59Z

Hito3218: Created page with "== Name == Yuxin Tan Junyuan Wu == Slot == 7,8,10,11,12 == Title == Balance Notes: - Connect Unity and Caputry - Control the models and scene in Unity by Captury"

== Name ==
Yuxin Tan
Junyuan Wu

== Slot ==
7,8,10,11,12

== Title ==

Balance

Notes:

- Connect Unity and Caputry
- Control the models and scene in Unity by Captury

GMU:Digital Puppetry Lab

2016-06-22T22:06:47Z

Hito3218: /* Participants */

[[Image:Digital-puppetry.png|thumb|left|200px|''Chinese Shadows'' by Ferdinand du Puigaudeau]]

'''Digital Puppetry Lab''' — Introduction to the ''Interactive Performance Platform''

[[:Category:Werkmodul|Werkmodul]]/[[:Category:Fachmodul|Fachmodul]] 
''Lecturer:'' [[Martin Schneider]] 
''Credits:'' 6 [[ECTS]], 4 [[SWS]] 
''Date:'' Tuesday 19:00 - 20:30 (weekly) + Wednesday 17:00 - 20:30 (biweekly)          '''Blockmodul (15. - 17. April)''' 
''Venue:'' [[Performance Platform]], Digital Bauhaus Lab 
''First meeting:''' TUESDAY, 12. April, 19:00h'''

 

'''This is a hands on course that is required for project modules by GMU and EXPTV.'''

== Tutoriums ==

Note: this plan may be subject to changes.
Please follow the mailing list for updates.

The tutoriums are split into two groups. 
'''They take place on Tuesday at 19:00 and every other Wednesday at 17:00.'''
=== April ===
* 19. April, Tue, 19:00 (Su, Max): Learning Blender
* 20. April, Wed, 17:00(Su, Max): Learning Blender
* 26. April, Tue, 19:00(Luca, Ben): Learning Blender

=== May ===
* 03. May, Tue, 19:00 (Luca, Su): Learn how to get a simple Blender model into Unity
* 04. May, Wed, 17:00 (Martin, Luca, Su): Learn how to use OSC to connect Iannix and Unity
* 10. May, Tue, 19:00 (Martin, Luca, Ben): Introduction to MAX MSP + Connecting Iannix to MAX MSP
* 17. May, Tue, 19:00
* 18. May, Wed, 17:00
* 24. May, Tue, 19:00
* 31. May, Tue, 19:00

=== June ===
* 01. June, Wed, 17:00 Q+A (Luca / Ben)
* 07. June, Tue, 19:00 Q+A (Luca / Ben)
* 14. June, Tue, 19:00 Q+A (Luca / Ben)
* 15. June, Wed, 17:00 Q+A (Luca / Ben)
* 21. June, Tue, 19:00 Q+A (Luca / Ben)
* 28. June, Tue, 19:00 Q+A (Luca / Ben)
* 29. June, Wed, 17:00 Q+A (Luca / Ben)

=== July ===
* 05. July, Tue, 19:00 Q+A (Luca / Ben)
* 12. July, Tue, 19:00 Q+A (Luca / Ben)
* 13. July, Wed, 17:00 Q+A (Luca / Ben)

== Weekend Workshop ==

=== Be Prepared ===

Please make sure to install the software on your laptops at home. 
We will start using it right away and have no time for installation during the course.

* [https://www.blender.org/download/ Blender]
* [https://unity3d.com/get-unity/download?ref=personal Unity]
* [http://www.iannix.org/en/download-iannix/ Iannix]
* [https://processing.org/download/?processing Processing] (Version 3.0.2)
* [https://puredata.info/downloads/pd-extended/releases/0.43.4 Pure Data Extended] (0.43.4)

=== Schedule ===

{| class="wikitable"
! colspan="3" | FRIDAY
|-
!11:00 - 11:45
|Intro to the Wiki
|Martin
|-
!11:45 - 12:30
| Intro to OSC, Iannix and Processing
| Martin
|-
| colspan="3" style="text-align:center"| ''Lunch Break''
|-
!13:30 - 14:15
| Intro to MAX-MSP + Puredata
| Martin, Benjamin
|-
!14:15 - 15:00
| Intro to Blender + Unity
| Luca, Miga
|-
!15:15 - 16:00
| Intro to Unity I
| Luca
|-
!16:00 - 16:45
| Intro to Unity II
| Luca
|-
! colspan="3" | SATURDAY
|-
! 10:00 - 12:30
| Hands-On Blender
| Su Li, Benjamin
|-
| colspan="3" style="text-align:center"| ''Lunch Break''
|-
! 13:30 - 16:00
| Hands-On Blender
| Su Li, Benjamin
|-
! 16:00 - 18:30
| Hands-On Blender
| Su Li, Benjamin
|-
! colspan="3" | SUNDAY
|-
!10:00 - 12:30
| Hands-On Blender
| Su Li, Max
|-
| colspan="3" style="text-align:center"| ''Lunch Break''
|-
!13:30 - 16:00
| Hands-On Blender
| Su Li, Max
|-
!16:00 - 16:45
| Demo in the DBL
| Martin, Luca
|}

== Beschreibung ==

Das Modul vermittelt die nötigen Grundkenntinisse um interaktive Performances mit Hilfe der Performance-Plattform des Digital Bauhaus Labs zu erstellen.

Nach einem einführende Blockmodul (15. - 17. April) geht es im Rahmen der wöchentlichen Veranstaltung um den praktischen Umgang mit den entsprechenden Software-Werkzeugen und Programmier-Umgebungen.

Am Ende des Moduls sollen die Studierenden in der Lage sein, eigene Setups zu erstellen, die aus menschliche Bewegung, Interaktion, und Tanz immersive visuelle und akkustische Umgebungen erzeugen.

== Description ==

This course will teach you basic skills required to create interactive performances, using the Peformance Platform of the Digital Bauhaus Lab.

By the end of the course you will be able to create your own immersive setup for generating live audio and visuals from human motion, interaction and dance.

== Language ==

The course is in English, because not all participants are speaking German.

== Eligible Participants ==

Undergraduates and graduates enrolled in the faculties of:

* Media Art + Design
* Media Architecture
* Visual Communication
* Product Design

== Participants ==
* [[/Jasmine|Jing Zhao]]
* [[/Jack|Jixiang JIANG]]
* [[/Martin Schneider|Martin Schneider]]
* [[/Fiona Mortimer|Fiona M]]
* [[//Emilio Aguas|''Emilio Aguas'']]
* [[/Jessica Hüttig|Jessica Hüttig]]
* [[/Kan Feng|Kan Feng]]
* [[/Priyanka Srinivasagopalan|Priyanka Srinivasagopalan]]
* [[/Tim Vischer|Tim Vischer]]
* [[/Rachel Smith|Rachel Smith]]
* [[/Taissa Fromme|Taissa Fromme]]
*[[/FANXZ|Xiangzhen Fan]]
* [[/Minsoo Hwang|Minsoo Hwang]]
* [[/Di Yang|Di Yang]]
* [[/elenaliv|Elena Liv Felderer]]
* [[/Kei Kitamura|Kei Kitamura]]
*[[/Qianqian Li|Qianqian Li]]
* [[/Yun Liu|Yun Liu]]
* [[/Logic|Ji Luo]]
* [[/Florian Froger|Florian Froger]]
* [[/Anna Hack|Anna Hack]]
* [[/Shubhra Bhatt | Shubhra Bhatt]]
* [[/Jane doe|Jane doe]]
* [[/Jonas Jülch|Jonas Jülch]]
* [[/Seb|Sebastian Richter]]
* [[/Rama Bielewski|Rama Bielewski]]
* [[/Edu_Oliveira| Eduardo Oliviera]]
* [[/Shih Li Chao|Shih Li C]]
* [[/Shuyan|Shuyan Chen]]
* [[/Junyuan WU|Junyuan WU]]
* [[/Christopher Dake-Outhet|Christopher Dake-Outhet]]
* [[/Leif Weitzel|Leif Weitzel]]
* [[/Alicia Kremser|Alicia Kremser]]
* [[/Amy Jean Barnett|Amy Jean Barnett]]
* [[/Yuxin Tan|Yuxin Tan]]

== OSC Projects ==

[https://github.com/bitcraftlab/digital-puppetry-lab OSC-Example Code]

[[File:OSC_THE_CAPTURY.zip]]

Add your projects here:

* [[/Group Ben & Luca|Ben & Luca]]
* [[/Group A Midsummer Night's Dream|Yun & Qianqian & Xiangzhen & Junyuan & Yuxin]]
* [[/Group Play with rhythms |Di Yang & Jixiang Jiang & Kan Feng & Shuyan Chen]]
* [[/Group Shih Li & Sebastian & Adam & Jessica|Shih Li & Sebastian & Adam & Jessica]]
* [[/Group B0XJUMP |Alicia/Tim/Elena/Chris]]
* [[/Group KittenRemote |Amy/Jonas/Florian]]
*[[/Group Swarm|Emilio Aguas/ Fiona Mortimer/ Eduardo Oliveira ]] – Hornet swarm
* [[/Group Leif/Rachel/Kei |Leif/Rachel/Kei]]

== Tutorials ==
* [https://www.uni-weimar.de/medien/wiki/GMU:Tutorials/Networking/Controlling_Unity_with_IanniX Controlling Unity with Iannix] (Martin Schneider)
Please add your tutorials below.
''All tutorials developed at the GMU can be found [[GMU:Tutorials|here]]''.

== Examples ==

* [https://www.dropbox.com/sh/czkyhsz57fokqdm/AADDMv23wN4Zs0GVXSn69Z-ja?dl=0|OSC Example in Max/Msp]
* [https://www.dropbox.com/sh/9j3qc700t2bdq91/AAAtS1FXUKTBXiALVxm5KlfTa?dl=0 Smooth Out Jittery Data] in Max/Msp (e.g. for TouchOSC Input)
* [https://www.youtube.com/playlist?list=PL12DC9A161D8DC5DC Pure Data Video Tutorial] on Youtube

*[https://www.dropbox.com/sh/lew8lel0q81tm0g/AACmkCgCxScvCELVEL1yOx0Ha?dl=0 | 3D Motion Simulator and Receiver]

*[https://www.zhdk.ch/index.php?id=icst_ambisonicsexternals | Ambisonics External for Max & Pd]

== Application ==

Applications from students that have signed up for the project modules at GMU or EXPTV, will be favoured, because this course is a requirement for those modules.

'''To:''' [[User:ms|Martin Schneider]] 
'''Subject:''' Digital Puppetry Lab /// Application 
'''Content:'''

* Name, Surname
* program and semester (Studienprogramm und Fachsemester)
* matriculation number (Matrikelnummer)
* Valid email address @uni-weimar.de
* Your project module

== Syllabus ==
* First Meeting 12. April (Tuesday)
* Block-Weekend 15. - 17. April

The syallbus includes:
* Introduction to the Tracking System
* Basics of Networking with OSC
* Basics of 3D-Modelling and Rigging
* Programming Interactive 3D Graphics
* Programming interactive Sound in Space

== Evaluation ==
* 20% Presence and active participation
* 50% Creation of an interactive setup (documented in the form of a tutorial)
* 30% Documentation on the wiki

== Books ==
''to be done''

== Links ==

* [[www.thecaptury.com|The Captury]]
* [[www.blender.org|Blender]] (3D Modelling)
* [[www.unity3d.com|Unity]] (3D Game Engine)
* [[www.iannix.org|Iannix]] (Visual Synthesizer for OSC)
* [[www.sojamo.de/libraries/oscP5/|OSC for Processing]]
* [[trippylighting.com/teensy-arduino-ect/touchosc-and-arduino-oscuino|TouchOSC + OSCuino]]
* [[Pure Data]]
* [[Max MSP]]

[[Category:SS16]]
[[Category:Werkmodul]]
[[Category:Fachmodul]]
[[Category:Martin Schneider]]

[[Category:Tracking]]
[[Category:OSC]]
[[Category:Blender]]
[[Category:Dataflow]]