Estimating speaker direction on a humanoid robot with binaural acoustic signals

被引:0
|
作者
Barot, Pranav [1 ]
Mombaur, Katja [1 ,2 ]
Macdonald, Ewen N. [1 ]
机构
[1] Univ Waterloo, Dept Syst Design Engn, Waterloo, ON, Canada
[2] Inst Anthropomat & Robot IAR, Karlsruhe Inst Technol KIT, Optimizat & Biomech Human Centred Robot, Karlsruhe, Germany
来源
PLOS ONE | 2024年 / 19卷 / 01期
基金
加拿大自然科学与工程研究理事会;
关键词
D O I
10.1371/journal.pone.0296452
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
To achieve human-like behaviour during speech interactions, it is necessary for a humanoid robot to estimate the location of a human talker. Here, we present a method to optimize the parameters used for the direction of arrival (DOA) estimation, while also considering real-time applications for human-robot interaction scenarios. This method is applied to binaural sound source localization framework on a humanoid robotic head. Real data is collected and annotated for this work. Optimizations are performed via a brute force method and a Bayesian model based method, results are validated and discussed, and effects on latency for real-time use are also explored.
引用
收藏
页数:27
相关论文
共 50 条
  • [31] Development of humanoid robot motion control algorithm using brain wave measurement signals
    Park, Jun-Young
    Hwang, Young Hyun
    Shin, Sangho
    Ju, Byeong-Kwon
    17TH ACM INTERNATIONAL CONFERENCE ON PERVASIVE TECHNOLOGIES RELATED TO ASSISTIVE ENVIRONMENTS, PETRA 2024, 2024, : 678 - 679
  • [32] IMPACT TASK MODEL AND ACOUSTIC RECOGNITION SYSTEM WITH A HUMANOID ROBOT FOR AN AUTOMATION OF HAMMERING TEST
    Hayashi, Kento
    Hirogaki, Toshiki
    Aoyama, Eiichi
    Sugiura, Yoshihisa
    PROCEEDINGS OF THE ASME INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES AND COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE, 2014, VOL 5B, 2014,
  • [34] MetaSonic: Advancing Robot Localization With Directional Embedded Acoustic Signals
    Wang, Junling
    An, Zhenlin
    Guo, Yi
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2025, 10 (02): : 1704 - 1711
  • [35] A pipeline for estimating human attention toward objects with on-board cameras on the iCub humanoid robot
    Hanifi, Shiva
    Maiettini, Elisa
    Lombardi, Maria
    Natale, Lorenzo
    FRONTIERS IN ROBOTICS AND AI, 2024, 11
  • [36] A Robot Humanoid Control Framework Through Human Arm Active Endpoint Stiffness and Direction Adaptive Compensation
    Zhang, Chaoyi
    Liu, Shiyang
    Zeng, Chao
    Jiang, Yiming
    Luo, Jing
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (09): : 7557 - 7564
  • [37] Recognition of simultaneous speech by estimating reliability of separated signals for robot audition
    Yamamoto, Shun'ichi
    Takeda, Ryu
    Nakadai, Kazuhiro
    Nakano, Mikio
    Tsujino, Hiroshi
    Valin, Jean-Marc
    Komatani, Kazunori
    Ogata, Tetsuya
    Okuno, Hiroshi G.
    PRICAI 2006: TRENDS IN ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2006, 4099 : 484 - 494
  • [38] Estimating atmospheric turbulence parameters from the envelopes of radio acoustic signals
    Kartashov, V.M.
    Telecommunications and Radio Engineering (English translation of Elektrosvyaz and Radiotekhnika), 2001, 55 (08): : 24 - 28
  • [39] Benefits to Speech Perception in Noise From the Binaural Integration of Electric and Acoustic Signals in Simulated Unilateral Deafness
    Ma, Ning
    Morris, Saffron
    Kitterick, Padraig Thomas
    EAR AND HEARING, 2016, 37 (03): : 248 - 259
  • [40] Milling depth control of lamina for orthopedic robot based on acoustic signals
    Xia G.
    Dai Y.
    Zhang J.
    Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2021, 42 (02): : 144 - 154