CHI 2025: Perceived Asynchrony of Rhythmic Stimuli Affects Pupil Diameter and Smooth Pursuit Eye Movements

Lina had the opportunity to present our latest paper, »Perceived Asynchrony of Rhythmic Stimuli Affects Pupil Diameter and Smooth Pursuit Eye Movements«, at CHI 2025 in Yokohama, Japan. Watch the presentation recording here:

CHI '25: Perceived Asynchrony of Rhythmic Stimuli Affects Pupil Diameter and Smooth Pursuit Eye Movements

Klicken Sie auf den Play-Button, um externe Inhalte von Vimeo.com zu laden und anzuzeigen.

Externe Inhalte von Vimeo.com zukünftig automatisch laden und anzeigen (Sie können diese Einstellung jederzeit über unsere »Datenschutzerklärung« ändern.)


Abstract

In networked applications, latency can disrupt the sense of synchrony by causing offsets e.g. between local speech and remote visual response. We investigate the influence of frequency and Stimulus Onset Asynchrony (SOA) on synchrony perception during rhythmic audiovisual experiences. Our results show that the Point of Subjective Synchrony (PSS) is influenced by frequency, whereas the Window of Subjective Synchrony (WSS) is not. Variations in SOA induce adaptive gaze behavior in response to audiovisual latencies, while pupil diameter increases with increasing SOA, suggesting a higher cognitive load for successive unisensory rather than integrated events. This has practical implications for the design of computer-mediated applications that promote a sense of community through rhythmic interaction. Eye tracking data may indicate perceived (a)synchrony in audiovisual integration. In addition, the choice of frequencies may help to mask latencies, enhance the experience of synchrony and thus support feelings of closeness and intimacy in virtual interaction.

Klass, L., Lammert, A., Simon, L., Hornecker, E., Froehlich, B., Ehlers, J. (2025). Perceived Asynchrony of Rhythmic Stimuli Affects Pupil Diameter and Smooth Pursuit Eye Movements. In 2025 ACM CHI Conference on Human Factors in Computing Systems, Yokohama, Japan. https://dl.acm.org/doi/10.1145/3706598.3713152