Children benefit from gestures to understand degraded speech but to a lesser extent than adults

被引:0
|
作者
Sekine, Kazuki [1 ]
Ozyurek, Asli [2 ,3 ,4 ]
机构
[1] Waseda Univ, Fac Human Sci, Tokorozawa, Japan
[2] Radboud Univ Nijmegen, Ctr Language Studies, Nijmegen, Netherlands
[3] Max Planck Inst Psycholinguist, Nijmegen, Netherlands
[4] Radboud Univ Nijmegen, Donders Inst Brain Cognit & Behav, Nijmegen, Netherlands
来源
FRONTIERS IN PSYCHOLOGY | 2024年 / 14卷
基金
欧盟地平线“2020”;
关键词
co-speech gestures; degraded speech; primary school children; multimodal integration; speech comprehension; ICONIC GESTURES; RECOGNITION; INTEGRATION; INFORMATION; COMMUNICATION; HEARING; HAND;
D O I
10.3389/fpsyg.2023.1305562
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
The present study investigated to what extent children, compared to adults, benefit from gestures to disambiguate degraded speech by manipulating speech signals and manual modality. Dutch-speaking adults (N = 20) and 6- and 7-year-old children (N = 15) were presented with a series of video clips in which an actor produced a Dutch action verb with or without an accompanying iconic gesture. Participants were then asked to repeat what they had heard. The speech signal was either clear or altered into 4- or 8-band noise-vocoded speech. Children had more difficulty than adults in disambiguating degraded speech in the speech-only condition. However, when presented with both speech and gestures, children reached a comparable level of accuracy to that of adults in the degraded-speech-only condition. Furthermore, for adults, the enhancement of gestures was greater in the 4-band condition than in the 8-band condition, whereas children showed the opposite pattern. Gestures help children to disambiguate degraded speech, but children need more phonological information than adults to benefit from use of gestures. Children's multimodal language integration needs to further develop to adapt flexibly to challenging situations such as degraded speech, as tested in our study, or instances where speech is heard with environmental noise or through a face mask.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Autistic individuals benefit from gestures during degraded speech comprehension
    Mazzini, Sara
    Seijdel, Noor
    Drijvers, Linda
    AUTISM, 2024,
  • [2] Non-native Listeners Benefit Less from Gestures and Visible Speech than Native Listeners During Degraded Speech Comprehension
    Drijvers, Linda
    Ozyurek, Asli
    LANGUAGE AND SPEECH, 2020, 63 (02) : 209 - 220
  • [3] Timing of Gestures: Gestures Anticipating or Simultaneous With Speech as Indexes of Text Comprehension in Children and Adults
    Iani, Francesco
    Cutica, Ilaria
    Bucciarelli, Monica
    COGNITIVE SCIENCE, 2017, 41 : 1549 - 1566
  • [4] How early do children understand gesture-speech combinations with iconic gestures?
    Stanfield, Carmen
    Williamson, Rebecca
    Ozcaliskan, Seyda
    JOURNAL OF CHILD LANGUAGE, 2014, 41 (02) : 462 - 471
  • [5] Sign advantage: Both children and adults' spatial expressions in sign are more informative than those in speech and gestures combined
    Karadoller, Dilay Z.
    Sumer, Beyza
    Unal, Ercenur
    Ozyurek, Asli
    JOURNAL OF CHILD LANGUAGE, 2024, 51 (04) : 876 - 902
  • [6] Perceptual anchoring: Children with dyslexia benefit less than controls from contextual repetitions in speech processing
    Maennel, Claudia
    Ramos-Sanchez, Jessica
    Obrig, Hellmuth
    Ahissar, Merav
    Schaadt, Gesa
    CLINICAL NEUROPHYSIOLOGY, 2024, 166 : 117 - 128
  • [7] Aging and working memory modulate the ability to benefit from visible speech and iconic gestures during speech-in-noise comprehension
    Schubotz, Louise
    Holler, Judith
    Drijvers, Linda
    ozyurek, Asli
    PSYCHOLOGICAL RESEARCH-PSYCHOLOGISCHE FORSCHUNG, 2021, 85 (05): : 1997 - 2011
  • [8] Aging and working memory modulate the ability to benefit from visible speech and iconic gestures during speech-in-noise comprehension
    Louise Schubotz
    Judith Holler
    Linda Drijvers
    Aslı Özyürek
    Psychological Research, 2021, 85 : 1997 - 2011
  • [9] Gesture-speech integration in narrative Are children less redundant than adults?
    Alibali, Martha W.
    Evans, Julia L.
    Hostetter, Autumn B.
    Ryan, Kristin
    Mainela-Arnold, Elina
    GESTURE, 2009, 9 (03) : 290 - 311
  • [10] Plant Sterols Increased IL-6 and TNF-α Secretion from Macrophages, but to a Lesser Extent than Cholesterol
    Kurano, Makoto
    Iso-O, Naoyuki
    Hara, Masumi
    Noiri, Eisei
    Koike, Kazuhiko
    Kadowaki, Takashi
    Tsukamoto, Kazuhisa
    JOURNAL OF ATHEROSCLEROSIS AND THROMBOSIS, 2011, 18 (05) : 373 - 383