< Back to previous page

Project

Eye movement and cognitive-interactional linguistics. In a multimodal approach to interaction management.

Face-to-face communication is an inherently multimodal process, with multiple semiotic channels operating simultaneously and collaboratively, including verbal, para-verbal (e.g. intonation, pace and volume of speech) and non-verbal behaviour (e.g. gaze, gesture, posture). This project presents a novel approach to multimodal interaction, with a specific focus on the role of interlocutors’ eye gaze in relation to the other semiotic channels. In order to capture the continuous stream of visible information being exchanged in dialogue, we use a recently developed paradigm of multifocal eyetracking, with mobile eye-trackers simultaneously recording the gaze behaviour of two or more conversation partners in a face-to-face setting. The recordings of two- and three-party interactions will be used to explore the multimodal dynamics of interaction management, and more specifically the negotiation of speakership (turn allocation and turn-taking) and the signalling of attention and understanding (grounding). The analysis of these phenomena focuses both on the temporal dynamics, or how they are organized sequentially in the unfolding interactions, and on the emergence of multimodal patterns across semiotic channels (multimodal information packages, McNeill 2006). The results of the analyses may challenge key concepts in cognitive(-interactional) linguistics, conversation analysis and psycholinguistics.

Date:1 Jan 2015 →  31 Dec 2018
Keywords:Oogbewegingsonderzoek, Cgnitief-interactionele taalkunde
Disciplines:Theory and methodology of literary studies