Cross-modal psychological refractory period in vision, audition, and haptics

被引:0
|
作者
Pei-Luen Patrick Rau
Jian Zheng
机构
[1] Tsinghua University,Institute of Human Factors and Ergonomics, Department of Industrial Engineering
来源
关键词
Psychological refractory period; Central bottleneck; Dual-task; Multisensory perception; Multimodal display;
D O I
暂无
中图分类号
学科分类号
摘要
People’s parallel-processing ability is limited, as demonstrated by the psychological refractory period (PRP) effect: The reaction time to the second stimulus (RT2) increases as the stimulus onset asynchrony (SOA) between two stimuli decreases. Most theoretical models of PRP are independent of modalities. Previous research on PRP mainly focused on vision and audition as input modalities; tactile stimuli have not been fully explored. Research using other paradigms and involving tactile stimuli, however, found that dual-task performance depended on input modalities. This study explored PRP with all the combinations of input modalities. Thirty participants judged the magnitude (small or large) of two stimuli presented in different modalities with an SOA of 75–1,200 ms. PRP effect was observed, i.e., RT2 increased with a decreasing SOA, in all the modalities. Only in the auditory-tactile condition did the accuracy of Task 2 decrease with a decreasing SOA. In the auditory-tactile and tactile-visual conditions, RT to the first stimulus also increased with a decreasing SOA. Current models could only explain part of the results, and modality characteristics help to explain the overall data pattern better. Limitations and directions for future studies regarding reaction time, task difficulty, and response modalities are discussed.
引用
收藏
页码:1573 / 1585
页数:12
相关论文
共 50 条
  • [31] Cross-modal interactions between audition, touch, and vision in endogenous spatial attention: ERP evidence on preparatory states and sensory modulations
    Eimer, M
    van Velzen, J
    Driver, J
    JOURNAL OF COGNITIVE NEUROSCIENCE, 2002, 14 (02) : 254 - 271
  • [32] The leftward cradling bias and audition: Cross-modal confusion? A response to Sieratzki, Roy, and Woll
    Turnbull, OH
    LATERALITY, 2002, 7 (04): : 355 - 357
  • [33] The Cross-Modal Effects of Sensory Deprivation on Spatial and Temporal Processes in Vision and Audition: A Systematic Review on Behavioral and Neuroimaging Research since 2000
    Bell, Laura
    Wagels, Lisa
    Neuschaefer-Rube, Christiane
    Fels, Janina
    Gur, Raquel E.
    Konrad, Kerstin
    NEURAL PLASTICITY, 2019, 2019
  • [34] ViSTA: Vision and Scene Text Aggregation for Cross-Modal Retrieval
    Cheng, Mengjun
    Sun, Yipeng
    Wang, Longchao
    Zhu, Xiongwei
    Yao, Kun
    Chen, Jie
    Song, Guoli
    Han, Junyu
    Liu, Jingtuo
    Ding, Errui
    Wang, Jingdong
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5174 - 5183
  • [35] Cross-Modal Transfer of the Tilt Aftereffect From Vision to Touch
    Krystallidou, Dafni
    Thompson, Peter
    I-PERCEPTION, 2016, 7 (05): : 1 - 10
  • [36] The condition of cross-modal illusory conjunctions between vision and touch
    Wang, W
    Liu, ZH
    INTERNATIONAL JOURNAL OF PSYCHOLOGY, 2004, 39 (5-6) : 179 - 179
  • [37] Cross-modal interactions between olfaction and vision when grasping
    Castiello, Umberto
    Zucco, Gesualdo M.
    Parma, Valentina
    Ansuini, Caterina
    Tirindelli, Roberto
    CHEMICAL SENSES, 2006, 31 (07) : 665 - 671
  • [38] Cross-modal correspondence between vision and olfaction: The color of smells
    Gilbert, AN
    Martin, R
    Kemp, SE
    AMERICAN JOURNAL OF PSYCHOLOGY, 1996, 109 (03): : 335 - 351
  • [39] Transformer-Exclusive Cross-Modal Representation for Vision and Language
    Shin, Andrew
    Narihira, Takuya
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, 2021, : 2719 - 2725
  • [40] Cross-modal exogenous attention and distance effects in vision and hearing
    Schmitt, M
    Postma, A
    de Haan, EHF
    EUROPEAN JOURNAL OF COGNITIVE PSYCHOLOGY, 2001, 13 (03): : 343 - 368