GMU:Max and the World/F.Z. Aygüler - Revision history

Fzayguler: /* AN EYE TRACKING EXPERIMENT */

2020-11-18T21:56:55Z

AN EYE TRACKING EXPERIMENT

← Older revision		Revision as of 21:56, 18 November 2020
Line 75:		Line 75:
	ASSIGNMENTS		ASSIGNMENTS

	[[/Week 1/]]		[[/Week 1/]] Rotating/ jit.world/ jit.gl.gridshape

	[[/Week 2/]]		[[/Week 2/]] Data Conversations

	[[/Week 3/]]		[[/Week 3/]] Data Sensing

	[[/Week 4/]]		[[/Week 4/]] OSC Protocol

Fzayguler: /* AN EYE TRACKING EXPERIMENT */

2020-11-11T19:29:34Z

AN EYE TRACKING EXPERIMENT

← Older revision		Revision as of 19:29, 11 November 2020
Line 8:		Line 8:


	This project is an eye-tracking experimentation with Max MSP. My experiment on eye tracking is inspired by historic findings of Alfred Yarbus on eye movements in the 1950s and 1960s. ~~Yarbu’s~~ device was a video-based system. He recorded the close-up videos of the eyes and then he edited the video frame by frame to calculate the gaze tracking data. I experimented with both video footage and web cam to track the eyeball. After targeting eyeballs using cv.jit library ~~extensions~~, adaptive threshold method was used to turn eye image into a white dot on black background. The most difficult part was to capture eye balls with a web cam due to the low resolution. I used jit.lcd to draw lines based on the data coming from tracking. In the first video, you see a sample of my webcam and video-based eye ~~tracking~~.		This project is an eye-tracking experimentation with Max MSP. My experiment on eye tracking is inspired by historic findings of Alfred Yarbus on eye movements in the 1950s and 1960s. Yarbus’s device was a video-based system. He recorded the close-up videos of the eyes and then he edited the video frame by frame to calculate the gaze tracking data. I experimented with both video footage and web cam to track the eyeball. After targeting eyeballs using cv.jit library externals, adaptive threshold method was used to turn eye image into a white dot on black background. cv.jit is a collection of max/msp/jitter tools for computer vision applications. I used cv.jit.face externals in my in my web cam tracking patch. The most difficult part was to capture eye balls with a web cam due to the low resolution. I used jit.lcd to draw lines based on the data coming from tracking. In the first video, you see a sample of my webcam and video-based eye trackings.

	In the second video, you see me looking at my room while tracking my eye movements. During the quarantine, I have stayed at my family house and spent most of my time in my childhood bedroom. I had many moments when my eyes were darting around trying to pull the answer out of my head or searching for a long term memory. Although predominantly externally triggered by the vision, eye movements also occur in cognitive activities. This pattern of eye movement is mostly related to internal thought processes and don’t generally serve visual processing. It is called ‘nonvisual eye movements’ or ‘stimulus independent eye movement’ in most of the recent studies. Why people move their eyes when they are thinking or searching for a long term memory is not clear.		In the second video, you see me looking at my room while tracking my eye movements. During the quarantine, I have stayed at my family house and spent most of my time in my childhood bedroom. I had many moments when my eyes were darting around trying to pull the answer out of my head or searching for a long term memory. Although predominantly externally triggered by the vision, eye movements also occur in cognitive activities. This pattern of eye movement is mostly related to internal thought processes and don’t generally serve visual processing. It is called ‘nonvisual eye movements’ or ‘stimulus independent eye movement’ in most of the recent studies. Why people move their eyes when they are thinking or searching for a long term memory is not clear.

Fzayguler: /* AN EYE TRACKING EXPERIMENT */

2020-11-09T18:53:53Z

AN EYE TRACKING EXPERIMENT

← Older revision		Revision as of 18:53, 9 November 2020
Line 65:		Line 65:

	Tracking - Pupil Tracking https://www.notion.so/Tracking-Pupil-Tracking-2371c7334752476f86f22e7ee6ffdf47		Tracking - Pupil Tracking https://www.notion.so/Tracking-Pupil-Tracking-2371c7334752476f86f22e7ee6ffdf47

	cv.jit \| Computer Vision for Jitter https://jmpelletier.com/cvjit/		cv.jit \| Computer Vision for Jitter https://jmpelletier.com/cvjit/

Fzayguler: /* AN EYE TRACKING EXPERIMENT */

2020-11-09T18:53:05Z

AN EYE TRACKING EXPERIMENT

← Older revision		Revision as of 18:53, 9 November 2020
Line 81:		Line 81:

	[[/Week 4/]]		[[/Week 4/]]

	~~[[/Final project]]~~

Fzayguler: /* AN EYE TRACKING EXPERIMENT */

2020-11-09T18:51:54Z

AN EYE TRACKING EXPERIMENT

← Older revision		Revision as of 18:51, 9 November 2020
Line 16:		Line 16:


	Later on this page, you will find some useful information regarding the basic types of eye movements, historic findings of Alfred Yarbus and a few sentences about the eye tracking technology used today. You will also find the patches I used in this class work at the end of the page.		Later on this page, you will find some useful information regarding the basic types of eye movements, historic findings of Alfred Yarbus and a few sentences about the eye tracking technology used today. You will also find the patches I used in this class work at the end of the page. Please see my research notes below if you even want to read more.

	[[:File:unexpected visitor.pdf]]		[[:File:unexpected visitor.pdf]]

Fzayguler: /* AN EYE TRACKING EXPERIMENT */

2020-11-09T02:03:04Z

AN EYE TRACKING EXPERIMENT

← Older revision		Revision as of 02:03, 9 November 2020
Line 13:		Line 13:

	{{#ev:youtube\|3PQrkL43iEE \|700}}		{{#ev:youtube\|3PQrkL43iEE \|700}}

Fzayguler: /* AN EYE TRACKING EXPERIMENT */

2020-11-09T02:01:15Z

AN EYE TRACKING EXPERIMENT

← Older revision		Revision as of 02:01, 9 November 2020
Line 1:		Line 1:

	== AN EYE TRACKING EXPERIMENT==		== AN EYE TRACKING EXPERIMENT==



Line 12:		Line 13:

	{{#ev:youtube\|3PQrkL43iEE \|700}}		{{#ev:youtube\|3PQrkL43iEE \|700}}

Fzayguler at 02:00, 9 November 2020

2020-11-09T02:00:07Z

← Older revision		Revision as of 02:00, 9 November 2020
Line 33:		Line 33:
	[[File:yarbus3.png\|700px]]		[[File:yarbus3.png\|700px]]

	[[File:yarbus1.jpg\|~~200px~~]]		[[File:yarbus1.jpg\|190px]]
	[[File:yarbus2.jpg\|220px]]		[[File:yarbus2.jpg\|220px]]
	[[File:unnamed.jpg\|130px]]		[[File:unnamed.jpg\|130px]]

Fzayguler at 01:59, 9 November 2020

2020-11-09T01:59:39Z

← Older revision		Revision as of 01:59, 9 November 2020
Line 34:		Line 34:

	[[File:yarbus1.jpg\|200px]]		[[File:yarbus1.jpg\|200px]]
	[[File:yarbus2.jpg\|~~200px~~]]		[[File:yarbus2.jpg\|220px]]
	[[File:unnamed.jpg\|~~140px~~]]		[[File:unnamed.jpg\|130px]]
	[[File:1_d1WOfKfTaCeCLUzdU-pH0w.jpeg\|180px]]		[[File:1_d1WOfKfTaCeCLUzdU-pH0w.jpeg\|180px]]

Fzayguler at 01:59, 9 November 2020

2020-11-09T01:59:03Z

← Older revision		Revision as of 01:59, 9 November 2020
Line 35:		Line 35:
	[[File:yarbus1.jpg\|200px]]		[[File:yarbus1.jpg\|200px]]
	[[File:yarbus2.jpg\|200px]]		[[File:yarbus2.jpg\|200px]]
	[[File:unnamed.jpg\|~~150px~~]]		[[File:unnamed.jpg\|140px]]
	[[File:1_d1WOfKfTaCeCLUzdU-pH0w.jpeg\|~~170px~~]]		[[File:1_d1WOfKfTaCeCLUzdU-pH0w.jpeg\|180px]]

← Older revision		Revision as of 02:00, 9 November 2020
Line 33:		Line 33:
	[[File:yarbus3.png\|700px]]		[[File:yarbus3.png\|700px]]

	[[File:yarbus1.jpg\|~~200px~~]]		[[File:yarbus1.jpg\|190px]]
	[[File:yarbus2.jpg\|220px]]		[[File:yarbus2.jpg\|220px]]
	[[File:unnamed.jpg\|130px]]		[[File:unnamed.jpg\|130px]]

← Older revision		Revision as of 01:59, 9 November 2020
Line 34:		Line 34:

	[[File:yarbus1.jpg\|200px]]		[[File:yarbus1.jpg\|200px]]
	[[File:yarbus2.jpg\|~~200px~~]]		[[File:yarbus2.jpg\|220px]]
	[[File:unnamed.jpg\|~~140px~~]]		[[File:unnamed.jpg\|130px]]
	[[File:1_d1WOfKfTaCeCLUzdU-pH0w.jpeg\|180px]]		[[File:1_d1WOfKfTaCeCLUzdU-pH0w.jpeg\|180px]]

← Older revision		Revision as of 01:59, 9 November 2020
Line 35:		Line 35:
	[[File:yarbus1.jpg\|200px]]		[[File:yarbus1.jpg\|200px]]
	[[File:yarbus2.jpg\|200px]]		[[File:yarbus2.jpg\|200px]]
	[[File:unnamed.jpg\|~~150px~~]]		[[File:unnamed.jpg\|140px]]
	[[File:1_d1WOfKfTaCeCLUzdU-pH0w.jpeg\|~~170px~~]]		[[File:1_d1WOfKfTaCeCLUzdU-pH0w.jpeg\|180px]]