GMU:Max and the World/F.Z. Aygüler: Difference between revisions

From Medien Wiki
No edit summary
No edit summary
Line 1: Line 1:
[https://www.youtube.com/watch?v=SswayKs9XtE]
 
AN EYE TRACKING EXPERIMENT
AN EYE TRACKING EXPERIMENT


This project is a web cam eye tracking experimentation with Max MSP. My experiment on eye tracking is inspired by historic findings of  Alfred Yarbus on  eye movements in the 1950s and 1960s. Yarbus’ device was a video-based system. He recorded the close-up videos of the eyes and then he edited the video frame by frame to calculate the gaze tracking data. I experimented both video footage and web cam to track the eyeball. After targeting eyeballs using cv.jit library extensions, adaptive threshold method was used to turn eye image into white dot on black background. The most difficult part was to capture eye balls from web cam because of the low resolution. Then, I used jit.lcd to draw line based on the data coming from tracking.   
 
This project is an eye-tracking experimentation with Max MSP. My experiment on eye tracking is inspired by historic findings of  Alfred Yarbus on  eye movements in the 1950s and 1960s. Yarbu’s device was a video-based system. He recorded the close-up videos of the eyes and then he edited the video frame by frame to calculate the gaze tracking data. I experimented with both video footage and web cam to track the eyeball. After targeting eyeballs using cv.jit library extensions, adaptive threshold method was used to turn eye image into a white dot on black background. The most difficult part was to capture eye balls with a web cam due to the low resolution. I used jit.lcd to draw lines based on the data coming from tracking.  In the first video, you see a sample of my webcam and video-based eye tracking.
 
In the second video, you see me looking at my room while tracking my eye movements. During the quarantine, I have stayed at my family house and spent most of my time in my childhood bedroom. I had many moments when my eyes were darting around trying to pull the answer out of my head. Looking at a very familiar place,  looking at objects that are not there or searching for a long term memory.
 
Although predominantly externally triggered by the vision, eye movements also occur in cognitive activities. This pattern of eye movement is mostly related to internal thought processes and don’t generally serve visual processing. It is called ‘nonvisual eye movements’ or ‘stimulus independent eye movement’ in most of the recent studies. Why people move their eyes when they are thinking or  searching for a long term memory is not clear.