TY  - JOUR
A1  - Tseng, Chiao-I
A1  - Laubrock, Jochen
A1  - Bateman, John A.
T1  - The impact of multimodal cohesion on attention and interpretation in film
JF  - Discourse, context & media
N2  - This article presents results of an exploratory investigation combining multimodal cohesion analysis and eye-tracking studies. Multimodal cohesion, as a tool of multimodal discourse analysis, goes beyond lin-guistic cohesive mechanisms to enable the construction of cross-modal discourse structures that system-atically relate technical details of audio, visual and verbal modalities. Patterns of multimodal cohesion from these discourse structures were used to design eye-tracking experiments and questionnaires in order to empirically investigate how auditory and visual cohesive cues affect attention and comprehen-sion. We argue that the cross-modal structures of cohesion revealed by our method offer a strong methodology for addressing empirical questions concerning viewers' comprehension of narrative settings and the comparative salience of visual, verbal and audio cues. Analyses are presented of the beginning of Hitchcock's The Birds (1963) and a sketch from Monty Python filmed in 1971. Our approach balances the narrative-based issue of how narrative elements in film guide meaning interpretation and the recipient -based question of where a film viewer's attention is directed during viewing and how this affects comprehension.
KW  - Film
KW  - Cohesion
KW  - Discourse semantics
KW  - Multimodality
KW  - Eye-tracking
KW  - Attention
Y1  - 2021
U6  - https://doi.org/10.1016/j.dcm.2021.100544
SN  - 2211-6958
VL  - 44
PB  - Amsterdam [u.a.]
CY  - Oxford
ER  - 
TY  - JOUR
A1  - Kupetz, Maxi
T1  - Empathy displays as interactional achievements-Multimodal and sequential aspects
JF  - Journal of pragmatics : an interdisciplinary journal of language studies
KW  - Empathy
KW  - Understanding
KW  - Affectivity
KW  - Conversation Analysis
KW  - Interactional Linguistics
KW  - Multimodality
Y1  - 2014
U6  - https://doi.org/10.1016/j.pragma.2013.11.006
SN  - 0378-2166
SN  - 1879-1387
VL  - 61
SP  - 4
EP  - 34
PB  - Elsevier
CY  - Amsterdam
ER  -