Cross-modal psychological refractory period in vision, audition, and haptics

被引:0
|
作者
Pei-Luen Patrick Rau
Jian Zheng
机构
[1] Tsinghua University,Institute of Human Factors and Ergonomics, Department of Industrial Engineering
来源
关键词
Psychological refractory period; Central bottleneck; Dual-task; Multisensory perception; Multimodal display;
D O I
暂无
中图分类号
学科分类号
摘要
People’s parallel-processing ability is limited, as demonstrated by the psychological refractory period (PRP) effect: The reaction time to the second stimulus (RT2) increases as the stimulus onset asynchrony (SOA) between two stimuli decreases. Most theoretical models of PRP are independent of modalities. Previous research on PRP mainly focused on vision and audition as input modalities; tactile stimuli have not been fully explored. Research using other paradigms and involving tactile stimuli, however, found that dual-task performance depended on input modalities. This study explored PRP with all the combinations of input modalities. Thirty participants judged the magnitude (small or large) of two stimuli presented in different modalities with an SOA of 75–1,200 ms. PRP effect was observed, i.e., RT2 increased with a decreasing SOA, in all the modalities. Only in the auditory-tactile condition did the accuracy of Task 2 decrease with a decreasing SOA. In the auditory-tactile and tactile-visual conditions, RT to the first stimulus also increased with a decreasing SOA. Current models could only explain part of the results, and modality characteristics help to explain the overall data pattern better. Limitations and directions for future studies regarding reaction time, task difficulty, and response modalities are discussed.
引用
收藏
页码:1573 / 1585
页数:12
相关论文
共 50 条
  • [21] When audition alters vision: an event-related potential study of the cross-modal interactions between faces and voices
    Joassin, F
    Maurage, P
    Bruyer, R
    Crommelinck, M
    Campanella, S
    NEUROSCIENCE LETTERS, 2004, 369 (02) : 132 - 137
  • [22] Cross-modal plasticity in the blind: A critical period
    不详
    NEUROSCIENTIST, 1999, 5 (05): : 273 - 273
  • [23] Period of susceptibility for cross-modal plasticity in the blind
    Cohen, LG
    Weeks, RA
    Sadato, N
    Celnik, P
    Ishii, K
    Hallett, M
    ANNALS OF NEUROLOGY, 1999, 45 (04) : 451 - 460
  • [24] What sound does that taste? Cross-modal mappings across gustation and audition
    Simner, Julia
    Cuskley, Christine
    Kirby, Simon
    PERCEPTION, 2010, 39 (04) : 553 - 569
  • [25] Cross-modal adapter for vision-language retrieval
    Jiang, Haojun
    Zhang, Jianke
    Huang, Rui
    Ge, Chunjiang
    Ni, Zanlin
    Song, Shiji
    Huang, Gao
    PATTERN RECOGNITION, 2025, 159
  • [26] CROSS-MODAL TRANSFER OF FORMS BETWEEN VISION AND TOUCH
    JUURMAA, J
    LEHTINENRAILO, S
    SCANDINAVIAN JOURNAL OF PSYCHOLOGY, 1988, 29 (02) : 95 - 110
  • [27] A cross-modal aftereffect reveals merging of proprioception and vision
    Bertamini, M.
    Thraves, E.
    Bruno, N.
    PERCEPTION, 2007, 36 (09) : 1404 - 1404
  • [28] Cross-modal illusory conjunctions between vision and touch
    Cinel, C
    Humphreys, GW
    Poli, R
    JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 2002, 28 (05) : 1243 - 1266
  • [29] Cross-modal Map Learning for Vision and Language Navigation
    Georgakis, Georgios
    Schmeckpeper, Karl
    Wanchoo, Karan
    Dan, Soham
    Miltsakaki, Eleni
    Roth, Dan
    Daniilidis, Kostas
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 15439 - 15449
  • [30] Connecting Touch and Vision via Cross-Modal Prediction
    Li, Yunzhu
    Zhu, Jun-Yan
    Tedrake, Russ
    Torralba, Antonio
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 10601 - 10610