Displaying 1 - 32 of 32
-
Dockendorff, M., Holler, J., & Knoblich, G. (2023). Saying things with actions — or how instrumental actions can take on a communicative function. Talk presented at the 9th bi-annual Joint Action Meeting (JAM). Budapest, Hungary. 2023-07-10 - 2023-07-12.
-
Emmendorfer, A. K., Banovac, L., Gorter, A., & Holler, J. (2023). Visual signals as response mobilization cues in face-to-face conversation. Talk presented at the 8th Gesture and Speech in Interaction (GESPIN 2023). Nijmegen, The Netherlands. 2023-09-13 - 2023-09-15.
-
Emmendorfer, A. K., & Holler, J. (2023). Addressee gaze direction and response timing signal upcoming response preference: Evidence from behavioral and EEG experiments. Poster presented at the 15th Annual Meeting of the Society for the Neurobiology of Language (SNL 2023), Marseille, France.
-
Emmendorfer, A. K., & Holler, J. (2023). The influence of speaker gaze on addressees’ response planning: Evidence from behavioral and EEG data. Poster presented at the 15th Annual Meeting of the Society for the Neurobiology of Language (SNL 2023), Marseille, France.
-
Holler, J. (2023). Multimodal addressee responses as tools for coordination and adaptation in conversational interaction. Talk presented at the 9th bi-annual Joint Action Meeting (JAM). Budapest, Hungary. 2023-07-10 - 2023-07-12.
-
Holler, J. (2023). Human language processing as a multimodal, situated activity. Talk presented at the 21st International Multisensory Research Forum (IRMF 2023). Brussels, Belgium. 2023-06-23 - 2023-06-30.
-
Mazzini, S., Holler, J., Hagoort, P., & Drijvers, L. (2023). Investigating inter-brain synchrony during (un-)successful face-to-face communication. Poster presented at the 9th bi-annual Joint Action Meeting (JAM), Budapest, Hungary.
-
Mazzini, S., Holler, J., Hagoort, P., & Drijvers, L. (2023). Inter-brain synchrony during (un)successful face-to-face communication. Poster presented at the 15th Annual Meeting of the Society for the Neurobiology of Language (SNL 2023), Marseille, France.
-
Mazzini, S., Holler, J., Hagoort, P., & Drijvers, L. (2023). Studying the association between co-speech gestures, mutual understanding and inter-brain synchrony in face-to-face conversations. Poster presented at the 15th Annual Meeting of the Society for the Neurobiology of Language (SNL 2023), Marseille, France.
-
Mazzini, S., Holler, J., Hagoort, P., & Drijvers, L. (2023). Inter-brain synchrony during (un)successful face-to-face communication. Poster presented at the 19th NVP Winter Conference on Brain and Cognition, Egmond aan Zee, The Netherlands.
Abstract
Human communication requires interlocutors to mutually understand each other. Previous research has suggested inter-brain synchrony as an important feature of social interaction, since it has been observed during joint attention, speech interactions and cooperative tasks. Nonetheless, it is still unknown whether inter-brain synchrony is actually related to successful face-to-face communication. Here, we use dual-EEG to study if inter-brain synchrony is modulated during episodes of successful and unsuccessful communication in clear and noisy communication settings. Dyads performed a tangram-based referential communication task with and without background noise, while both their EEG and audiovisual behavior was recorded. Other-initiated repairs were annotated in the audiovisual data and were used as indexes of unsuccessful and successful communication. More specifically, we compared inter-brain synchrony during episodes of miscommunication (repair initiations) and episodes of mutual understanding (repair solutions and acceptance phases) in the clear and the noise condition. We expect that when communication is successful, inter-brain synchrony will be stronger than when communication is unsuccessful, and we expect that these patterns will be most pronounced in the noise condition. Results are currently being analyzed and will be presented and discussed with respect to the inter-brain neural signatures underlying the process of mutual understanding in face-to-face conversation. -
Ter Bekke, M., Holler, J., & Drijvers, L. (2023). Do listeners use speakers’ iconic hand gestures to predict upcoming words?. Talk presented at the 9th bi-annual Joint Action Meeting (JAM). Budapest, Hungary. 2023-07-10 - 2023-07-12.
-
Ter Bekke, M., Drijvers, L., & Holler, J. (2023). Do listeners use speakers’ iconic gestures to predict upcoming words?. Poster presented at the 8th Gesture and Speech in Interaction (GESPIN 2023), Nijmegen, The Netherlands.
-
Ter Bekke, M., Drijvers, L., & Holler, J. (2023). Gestures speed up responses to questions. Poster presented at the 8th Gesture and Speech in Interaction (GESPIN 2023), Nijmegen, The Netherlands.
-
Ter Bekke, M., Drijvers, L., & Holler, J. (2023). Do listeners use speakers’ iconic hand gestures to predict upcoming words?. Poster presented at the 15th Annual Meeting of the Society for the Neurobiology of Language (SNL 2023), Marseille, France.
-
Trujillo, J. P., & Holler, J. (2023). Investigating the multimodal compositionality and comprehension of intended meanings using virtual agents. Talk presented at the 9th bi-annual Joint Action Meeting (JAM). Budapest, Hungary. 2023-07-10 - 2023-07-12.
-
Trujillo, J. P., Dyer, R. M. K., & Holler, J. (2023). Differences in partner empathy are associated with interpersonal kinetic and prosodic entrainment during conversation. Poster presented at the 9th bi-annual Joint Action Meeting (JAM), Budapest, Hungary.
-
Drijvers, L., & Holler, J. (2022). Spatial orientation influences cognitive processing in conversation. Talk presented at the 18th NVP Winter Conference on Brain and Cognition. Egmond aan Zee, The Netherlands. 2022-04-28 - 2022-04-30.
-
Drijvers, L., & Holler, J. (2022). Face-to-face spatial orientation fine-tunes the brain for neurocognitive processing in conversation. Poster presented at the 14th Annual Meeting of the Society for the Neurobiology of Language (SNL 2022), Philadelphia, PA, USA.
-
Emmendorfer, A. K., Gorter, A., & Holler, J. (2022). Interactive gestures as response mobilizing cues? Evidence from corpus, behavioral, and EEG data. Poster presented at the 14th Annual Meeting of the Society for the Neurobiology of Language (SNL 2022), Philadelphia, PA, USA.
-
Emmendorfer, A. K., Banovac, L., & Holler, J. (2022). Investigating the role of speaker gaze in response mobilization: Evidence from corpus, behavioral, and EEG data. Poster presented at the 14th Annual Meeting of the Society for the Neurobiology of Language (SNL 2022), Philadelphia, PA, USA.
-
Mazzini, S., Holler, J., Hagoort, P., & Drijvers, L. (2022). Intra- and inter-brain synchrony during (un)successful face-to-face communication. Poster presented at the 18th NVP Winter Conference on Brain and Cognition, Egmond aan Zee, The Netherlands.
-
Mazzini, S., Holler, J., Hagoort, P., & Drijvers, L. (2022). Intra- and inter-brain synchrony during (un)successful face-to-face communication. Poster presented at Neurobiology of Language: Key Issues and Ways Forward II, online.
-
Mazzini, S., Holler, J., Hagoort, P., & Drijvers, L. (2022). Intra- and inter-brain synchrony during (un)successful face-to-face communication. Poster presented at the 14th Annual Meeting of the Society for the Neurobiology of Language (SNL 2022), Philadelphia, PA, USA.
-
Nota, N., Trujillo, J. P., & Holler, J. (2022). Facial signals in multimodal communication: The effect of eyebrow movements on social action attribution. Poster presented at the 18th NVP Winter Conference on Brain and Cognition, Egmond aan Zee, The Netherlands.
-
Nota, N., Trujillo, J. P., & Holler, J. (2022). Conversational eyebrow frowns facilitate question identification: An online VR study. Talk presented at the 9th International Society for Gesture Studies conference (ISGS 2022). Chicago, IL, USA. 2022-07-12 - 2022-07-15.
-
Nota, N., Trujillo, J. P., & Holler, J. (2022). Conversational eyebrow frowns facilitate question identification: An online VR study. Poster presented at the IMPRS Conference 2022, Nijmegen, the Netherlands.
-
Nota, N., Trujillo, J. P., & Holler, J. (2022). Specific facial signals associate with subcategories of social actions conveyed through questions. Poster presented at the Face2face: Advancing the science of social interaction Royal Society London discussion meeting, online.
-
Nota, N., Trujillo, J. P., & Holler, J. (2022). Specific facial signals associate with subcategories of social actions conveyed through questions. Poster presented at the Donders Poster Sessions 2022, Nijmegen, The Netherlands.
-
Ter Bekke, M., Drijvers, L., & Holler, J. (2022). Hand gestures speed up responses to questions. Poster presented at the 18th NVP Winter Conference on Brain and Cognition, Egmond aan Zee, The Netherlands.
-
Trujillo, J. P., Levinson, S. C., & Holler, J. (2022). Multimodal adaptation is a two-way street: A multiscale investigation of the human communication system's response to visual disruption. Talk presented at the 9th International Society for Gesture Studies conference (ISGS 2022). Chicago, IL, USA. 2022-07-12 - 2022-07-15.
-
Trujillo, J. P., Levinson, S. C., & Holler, J. (2022). Multimodal adaptation is a two-way street: A multiscale investigation of the human communication system's response to visual disruption. Poster presented at the Face2face: Advancing the science of social interaction Royal Society London discussion meeting, online.
-
Trujillo, J. P., & Holler, J. (2022). The bodily kinematics of signaling conversational social action. Poster presented at the 9th International Society for Gesture Studies conference (ISGS 2022), Chicago, IL, USA.
Share this page