Learning Across Senses: Cross-Modal Effects in Multisensory Statistical Learning

被引:56
|
作者
Mitchel, Aaron D. [1 ]
Weiss, Daniel J. [1 ]
机构
[1] Penn State Univ, Dept Psychol, University Pk, PA 16802 USA
基金
美国国家卫生研究院;
关键词
multimodal statistical learning; multisensory perception; speech segmentation; WORD SEGMENTATION; SPEECH SEGMENTATION; VISUAL INFORMATION; TONE SEQUENCES; INFANTS; CUES; CONSTRAINTS; PERFORMANCE; ATTENTION; LANGUAGE;
D O I
10.1037/a0023700
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
It is currently unknown whether statistical learning is supported by modality-general or modality-specific mechanisms. One issue within this debate concerns the independence of learning in one modality from learning in other modalities. In the present study, the authors examined the extent to which statistical learning across modalities is independent by simultaneously presenting learners with auditory and visual streams. After establishing baseline rates of learning for each stream independently, they systematically varied the amount of audiovisual correspondence across 3 experiments. They found that learners were able to segment both streams successfully only when the boundaries of the audio and visual triplets were in alignment. This pattern of results suggests that learners are able to extract multiple statistical regularities across modalities provided that there is some degree of cross-modal coherence. They discuss the implications of their results in light of recent claims that multisensory statistical learning is guided by modality-independent mechanisms.
引用
收藏
页码:1081 / 1091
页数:11
相关论文
共 50 条
  • [1] Multisensory learning binds neurons into a cross-modal memory engram
    Okray, Zeynep
    Jacob, Pedro F. F.
    Stern, Ciara
    Desmond, Kieran
    Otto, Nils
    Talbot, Clifford B. B.
    Vargas-Gutierrez, Paola
    Waddell, Scott
    NATURE, 2023, 617 (7962) : 777 - +
  • [2] The role of cross-modal associations in statistical learning
    Arit Glicksohn
    Asher Cohen
    Psychonomic Bulletin & Review, 2013, 20 : 1161 - 1169
  • [3] The role of cross-modal associations in statistical learning
    Glicksohn, Arit
    Cohen, Asher
    PSYCHONOMIC BULLETIN & REVIEW, 2013, 20 (06) : 1161 - 1169
  • [4] Multisensory learning binds neurons into a cross-modal memory engram
    Zeynep Okray
    Pedro F. Jacob
    Ciara Stern
    Kieran Desmond
    Nils Otto
    Clifford B. Talbot
    Paola Vargas-Gutierrez
    Scott Waddell
    Nature, 2023, 617 : 777 - 784
  • [5] Multisensory integration and cross-modal learning in synaesthesia: A unifying model
    Newell, Fiona N.
    Mitchell, Kevin J.
    NEUROPSYCHOLOGIA, 2016, 88 : 140 - 150
  • [6] Cross-modal and multisensory training may distinctively shape restored senses
    Noel, Jean-Paul
    Thelen, Antonia
    FRONTIERS IN NEUROSCIENCE, 2015, 8
  • [7] A Cross-Modal Investigation of Statistical Learning in Developmental Dyslexia
    Kligler, Nitzan
    Gabay, Yafit
    SCIENTIFIC STUDIES OF READING, 2023, 27 (04) : 334 - 354
  • [8] Lack of Cross-Modal Effects in Dual-Modality Implicit Statistical Learning
    Li, Xiujun
    Zhao, Xudong
    Shi, Wendian
    Lu, Yang
    Conway, Christopher M.
    FRONTIERS IN PSYCHOLOGY, 2018, 9
  • [9] Infant cross-modal learning
    Chow, Hiu Mei
    Tsui, Angeline Sin-Mei
    Ma, Yuen Ki
    Yat, Mei Ying
    Tseng, Chia-huei
    I-PERCEPTION, 2014, 5 (04): : 463 - 463
  • [10] Understanding across the senses: cross-modal studies of cognition in cetaceans
    Bruck, Jason N.
    Pack, Adam A.
    ANIMAL COGNITION, 2022, 25 (05) : 1059 - 1075