Séminaire au DIC: «The coherence of multimodal communication: inquiry and inference» par Matthew Stone
Séminaire ayant lieu dans le cadre du Doctorat en informatique cognitive, en collaboration avec le centre de recherche CRIA
TITRE : The coherence of multimodal communication: inquiry and inference
Matthew STONE
Jeudi le 10 décembre 2026 à 10h30
Local PK-5115 (Il est possible d'y assister en virtuel en vous inscrivant ici)
RÉSUMÉ
Coherence theory postulates that each unit of a discourse stands in specific pragmatic relations to other parts of the discourse, with each relation involving its own information goals and inferential connections. I will sketch how it can be used to characterize a wide range of communicative contributions to multimodal interaction, including co-verbal gesture, practical demonstration, and situated inquiry. As an illustration, I take text–image coherence as a case study: text accompanying an image may characterize what's visible in it, explain how it was obtained, or offer the author's reaction — an insight leading to new methods for image–text inference, caption generation, and caption evaluation.
BIOGRAPHIE
Matthew STONE is Professor of Computer Science and Cognitive Science at Rutgers—New Brunswick and Dean for Mathematical and Physical Sciences in the School of Arts and Sciences. He has served as program chair for the Conference of the North American Chapter of the Association for Computational Linguistics (NAACL) and general chair of the meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL). He was chair of the Computer Science department from 2019 to 2023 and has helped to organize interdisciplinary training programs at Rutgers in Perceptual Science, Data Science, and Socially Cognizant Robotics. His work was recognized with the IFAAMAS Influential Paper Award in 2017.
RÉFÉRENCES
Date / heure
Lieu
Montréal (QC)
Prix
Renseignements
- Mylène Dagenais
- dic@uqam.ca
- https://www.dic.uqam.ca