Multimodal saliency-based bottom-up attention a framework for the humanoid robot iCub

被引:66
|
作者
Ruesch, Jonas [1 ]
Lopes, Manuel [2 ]
Bernardino, Alexandre [2 ]
Hoernstein, Jonas [2 ]
Santos-Victor, Jose [2 ]
Pfeifer, Rolf [1 ]
机构
[1] Univ Zurich, Dept Informat, Artificial Intelligence Lab, CH-8006 Zurich, Switzerland
[2] Inst Super Tecn, Inst Syst & Robot, Lisbon, Portugal
关键词
D O I
10.1109/ROBOT.2008.4543329
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This work presents a multimodal bottom-up attention system for the humanoid robot iCub where the robot's decisions to move eyes and neck are based on visual and acoustic saliency maps. We introduce a modular and distributed software architecture which is capable of fusing visual and acoustic saliency maps into one egocentric frame of reference. This system endows the With with an emergent exploratory behavior reacting to combined visual and auditory saliency. The developed software modules provide a flexible foundation for the open iCub platform and for further experiments and developments, including higher levels of attention and representation of the peripersonal space.
引用
收藏
页码:962 / +
页数:2
相关论文
共 50 条
  • [31] Awareness-Dependent Normalization Framework of Visual Bottom-up Attention
    Wang, Shiyu
    Huang, Ling
    Chen, Qinglin
    Wang, Jingyi
    Xu, Siting
    Zhang, Xilin
    JOURNAL OF NEUROSCIENCE, 2021, 41 (46): : 9593 - 9607
  • [32] Saliency-based framework for facial expression recognition
    Rizwan Ahmed Khan
    Alexandre Meyer
    Hubert Konik
    Saida Bouakaz
    Frontiers of Computer Science, 2019, 13 : 183 - 198
  • [33] Saliency-based framework for facial expression recognition
    Khan, Rizwan Ahmed
    Meyer, Alexandre
    Konik, Hubert
    Bouakaz, Saida
    FRONTIERS OF COMPUTER SCIENCE, 2019, 13 (01) : 183 - 198
  • [34] A Teleoperation System Utilizing Saliency-Based Visual Attention
    Teng, Wei-Chung
    Kuo, Yi-Ching
    Tara, Rayi Yanu
    2013 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC 2013), 2013, : 139 - 144
  • [35] Improving Bottom-up Saliency Detection by Looking into Neighbors
    Lang, Congyan
    Feng, Jiashi
    Liu, Guangcan
    Tang, Jinhui
    Yan, Shuicheng
    Luo, Jiebo
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2013, 23 (06) : 1016 - 1028
  • [36] Investigating bottom-up auditory attention
    Kaya, Emine Merve
    Elhilali, Mounya
    FRONTIERS IN HUMAN NEUROSCIENCE, 2014, 8
  • [37] Interaction between Attention and Bottom-Up Saliency Mediates the Representation of Foreground and Background in an Auditory Scene
    Elhilali, Mounya
    Xiang, Juanjuan
    Shamma, Shihab A.
    Simon, Jonathan Z.
    PLOS BIOLOGY, 2009, 7 (06)
  • [38] Bottom-up saliency and top-down attention interact inhuman primary visual cortex
    Hopf, JM
    Noesselt, T
    Tempelmann, C
    Kai, B
    Hans-Jochen, H
    Jochen, B
    JOURNAL OF COGNITIVE NEUROSCIENCE, 2002, : 97 - 98
  • [39] A spiking model of superior colliculus for bottom-up saliency
    Micah Richert
    Jayram Moorkanikara Nageswaran
    Sach Sokol
    Botond Szatmary
    Csaba Petre
    Filip Piekniewski
    Eugene Izhikevich
    BMC Neuroscience, 14 (Suppl 1)
  • [40] The Gaze of Schizophrenia Patients Captured by Bottom-up Saliency
    Adamek, Petr
    Grygarova, Dominika
    Jajcay, Lucia
    Bakstein, Eduard
    Furstova, Petra
    Jurickova, Veronika
    Jonas, Juraj
    Langova, Veronika
    Neskoroana, Iryna
    Kesner, Ladislav
    Horacek, Jiri
    SCHIZOPHRENIA, 2024, 10 (01)