GMU:Home Made Bioelectronics/Marah Doleh/Docummentation of progress - Revision history

Faxi0847 at 08:11, 12 July 2022

2022-07-12T08:11:10Z

← Older revision		Revision as of 08:11, 12 July 2022
Line 62:		Line 62:
	*intersection with Arduino: reaction to the '''pulse''' input		*intersection with Arduino: reaction to the '''pulse''' input
	*intersection with python: trigger change in scenes by the '''emotional''' input		*intersection with python: trigger change in scenes by the '''emotional''' input

			==List of readings and references:==

			*https://www.youtube.com/watch?v=yvbThD835m0
			*https://github.com/lbugnon/emoHR
			*https://github.com/FarhatBuet14/Heart-Rate-Monitoring-with-Emotion-Detection-using-PPG-GSR-Sensors
			*https://www.youtube.com/watch?v=1clagERAiR4
			*https://link.springer.com/article/10.1007/s11042-020-09576-0
			*https://www.thinkmind.org/articles/etelemed_2016_7_40_40093.pdf
			*https://www.scitepress.org/papers/2015/52411/52411.pdf
			*https://www.researchgate.net/publication/342075389_Development_of_ECG_sensor_using_arduino_uno_and_e-health_sensor_platform_mood_detection_from_heartbeat
			*https://link.springer.com/chapter/10.1007/11941354_44

Faxi0847 at 08:09, 12 July 2022

2022-07-12T08:09:43Z

← Older revision		Revision as of 08:09, 12 July 2022
Line 1:		Line 1:

			==CONCEPT==

			In this project, I plan to create an interactive installation that reflects this relationship between architectural space and music. While putting an emphasis on the emotional aspect of this experience.
			The installation will have a musical instrument, VR glasses, and HR sensor. The participater is is allowed to play any music he/she wants and to change the music they are playing whenever the well through the experience.
			The interaction starts after the participator starts playing and an emotional change is detected. This will trigger an audio-reactive environment to appear. The interactive environment will keep changing with respect to the emotional change during the musical performance, which will (probably) in return lead to affect the emotion of the participator. By this participator is influenced by music, changing his emotions, influencing the virtual space, followed by another emotional change, changing the music, ect.. This closed feedback loop is an embodiment of architecture, music, and emotion relationship.




			==TECHNICAL ASPECT==

			This installation will be divided into three main parts; emotion detector (HR sensor+arduino+python), music (piano or any other instrument), and audio-reactive environment (touchdesigner viewed by VR glasses).



			==AESTHETICAL ASPECT==

			Although the program that will be used and the general vision of the visual outcome of this interaction is predetermined; an interactive architectural space that is changed by emotions and music. The design is not yet clear, and will be worked on during this semester in the Touchdesigner course I am currently taking.

	==What has been done so far:==		==What has been done so far:==

Faxi0847: /* What's next? */

2022-05-11T15:59:11Z

What's next?

← Older revision		Revision as of 15:59, 11 May 2022
Line 24:		Line 24:
	[https://youtu.be/R7sAomk2vR4 Touchdesigner audio analysis]		[https://youtu.be/R7sAomk2vR4 Touchdesigner audio analysis]

	===What's next?===		==What's next?==

	====Arduino====		====Arduino====

Faxi0847: /* What has been done so far: */

2022-05-11T15:58:54Z

What has been done so far:

← Older revision		Revision as of 15:58, 11 May 2022
Line 1:		Line 1:


	===What has been done so far:===		==What has been done so far:==

Faxi0847: /* What has been done so far: */

2022-05-11T15:58:02Z

What has been done so far:

← Older revision		Revision as of 15:58, 11 May 2022
Line 23:		Line 23:
	[https://youtu.be/SJZIMGg-thY Instancing in Touchdesigner],		[https://youtu.be/SJZIMGg-thY Instancing in Touchdesigner],
	[https://youtu.be/R7sAomk2vR4 Touchdesigner audio analysis]		[https://youtu.be/R7sAomk2vR4 Touchdesigner audio analysis]


	===What's next?===		===What's next?===

Faxi0847: /* What has been done so far: */

2022-05-11T15:57:36Z

What has been done so far:

← Older revision		Revision as of 15:57, 11 May 2022
Line 23:		Line 23:
	[https://youtu.be/SJZIMGg-thY Instancing in Touchdesigner],		[https://youtu.be/SJZIMGg-thY Instancing in Touchdesigner],
	[https://youtu.be/R7sAomk2vR4 Touchdesigner audio analysis]		[https://youtu.be/R7sAomk2vR4 Touchdesigner audio analysis]


			===What's next?===

			====Arduino====

			*Send '''pulse''' data to TD
			*Send to Emotion recognition code

			====Python \| Emotion recognition====

			*Emotion recognition
			*Send data to TD

			====Touchdesinger====

			*test other forms of 3D (point clouds/ more complex instancing/....)
			*try other sets of reactions to music
			*create multiple scenes for different emotions

			*intersection with Arduino: reaction to the '''pulse''' input
			*intersection with python: trigger change in scenes by the '''emotional''' input

Faxi0847 at 15:43, 11 May 2022

2022-05-11T15:43:50Z

← Older revision		Revision as of 15:43, 11 May 2022
Line 15:		Line 15:
	[https://youtu.be/83K3QEK6Iv0 Feedback in Touchdesigner],		[https://youtu.be/83K3QEK6Iv0 Feedback in Touchdesigner],
	[https://youtu.be/V_Q_fDukTI0 TOUCHDESIGNER & ARDUINO]		[https://youtu.be/V_Q_fDukTI0 TOUCHDESIGNER & ARDUINO]

			*Audio-reactive 3D model

			[[File:Audioreactive test.mp4\|600px]]

			Links used for this step:
			[https://youtu.be/SJZIMGg-thY Instancing in Touchdesigner],
			[https://youtu.be/R7sAomk2vR4 Touchdesigner audio analysis]

Faxi0847: /* What has been done so far: */

2022-05-11T13:11:40Z

What has been done so far:

← Older revision		Revision as of 13:11, 11 May 2022
Line 13:		Line 13:

	Links used for this step:		Links used for this step:
	[https://youtu.be/83K3QEK6Iv0 Feedback in Touchdesigner]		[https://youtu.be/83K3QEK6Iv0 Feedback in Touchdesigner],
	[https://youtu.be/V_Q_fDukTI0 TOUCHDESIGNER & ARDUINO]		[https://youtu.be/V_Q_fDukTI0 TOUCHDESIGNER & ARDUINO]

Faxi0847: /* What has been done so far: */

2022-05-11T13:11:22Z

What has been done so far:

← Older revision		Revision as of 13:11, 11 May 2022
Line 11:		Line 11:

	[[File:TD-trim.mp4\|600px]]		[[File:TD-trim.mp4\|600px]]

			Links used for this step:
			[https://youtu.be/83K3QEK6Iv0 Feedback in Touchdesigner]
			[https://youtu.be/V_Q_fDukTI0 TOUCHDESIGNER & ARDUINO]

Faxi0847 at 13:07, 11 May 2022

2022-05-11T13:07:19Z

← Older revision		Revision as of 13:07, 11 May 2022
Line 4:		Line 4:


			*Testing receiving data from Arduino to Touchdesigner using Ultrasonic Distance Sensor (only for this test)
	*Testing receiving data from Arduino to Touchdesigner using ~~approximately sensor~~ (only for this test)

	[[/Code on arduino]]		[[/Code on arduino]]


	*Manipulating 3D object using data received from Arduino		*Manipulating 3D object using data received from Arduino

	[[File:TD-trim.mp4]]		[[File:TD-trim.mp4\|600px]]