Integration of Work Operation and Embodied Multimodal Interaction in Task Modeling for Collaborative Robot Development

被引:0
|
作者
Tan, Jeffrey Too Chuan [1 ]
Okuno, Keisuke [2 ]
Inamura, Tetsunari [3 ]
机构
[1] Univ Tokyo, Inst Ind Sci, Tokyo, Japan
[2] Inst Syst Informat Technol & Nanotechnol, Fukuoka, Japan
[3] Grad Univ Adv Studies, Natl Inst Informat, Tokyo, Japan
来源
2014 IEEE 4TH ANNUAL INTERNATIONAL CONFERENCE ON CYBER TECHNOLOGY IN AUTOMATION, CONTROL, AND INTELLIGENT SYSTEMS (CYBER) | 2014年
关键词
collaborative robot; work operation; embodied multimodal interaction; task modeling; human-robot interaction;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In a collaborative robot development, the robot is required to understand both the content of the work operation, and the current condition of the working environment and the progress of the human, in order to provide exact assistance in the correct timing. This work aims to integrate together both robot knowledge in work operation and embodied multimodal interaction for collaborative robot development. A task modeling approach is proposed to build a hierarchical task model of the entire work operation and grounding with the actual condition ("state") of the objects and environment, and the action ("transition") of work in the embodied dimension. The system is implemented in a simulation environment with human interaction in both structured (collaborative cooking task) and unstructured (clean up task) operations.
引用
收藏
页码:615 / 618
页数:4
相关论文
共 50 条
  • [1] Integration of Work Sequence and Embodied Interaction for Collaborative Work Based Human-Robot Interaction
    Tan, Jeffrey Too Chuan
    Inamura, Tetsunari
    PROCEEDINGS OF THE 8TH ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION (HRI 2013), 2013, : 239 - 240
  • [2] Using Embodied Multimodal Fusion to Perform Supportive and Instructive Robot Roles in Human-Robot Interaction
    Giuliani, Manuel
    Knoll, Alois
    INTERNATIONAL JOURNAL OF SOCIAL ROBOTICS, 2013, 5 (03) : 345 - 356
  • [3] Embodied Collaborative Referring Expression Generation in Situated Human-Robot Interaction
    Fang, Rui
    Doering, Malcolm
    Chai, Joyce Y.
    PROCEEDINGS OF THE 2015 ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION (HRI'15), 2015, : 271 - 278
  • [4] Using Embodied Multimodal Fusion to Perform Supportive and Instructive Robot Roles in Human-Robot Interaction
    Manuel Giuliani
    Alois Knoll
    International Journal of Social Robotics, 2013, 5 : 345 - 356
  • [5] Some remarks on humanoid robot development and preliminary work on multimodal human-humanoid interaction
    Knoll, A
    Zhang, J
    2001 INTERNATIONAL WORKSHOP ON BIO-ROBOTICS AND TELEOPERATION, PROCEEDINGS, 2001, : 28 - 38
  • [6] Programming robot work flows with a task modeling approach
    Indri, Marina
    Trapani, Stefano
    IECON 2018 - 44TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, 2018, : 2619 - 2624
  • [7] Development of a Platform for RNN Driven Multimodal Interaction with Embodied Conversational Agents
    Huang, Hung-Hsuan
    Fukuda, Masato
    Nishida, Toyoaki
    PROCEEDINGS OF THE 19TH ACM INTERNATIONAL CONFERENCE ON INTELLIGENT VIRTUAL AGENTS (IVA' 19), 2019, : 200 - 202
  • [8] Task-Learning Policies for Collaborative Task Solving in Human-Robot Interaction
    Park, Hae Won
    ICMI '12: PROCEEDINGS OF THE ACM INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, 2012, : 341 - 344
  • [9] Probabilistic Multimodal Modeling for Human-Robot Interaction Tasks
    Campbell, Joseph
    Stepputtis, Simon
    Amor, Heni Ben
    ROBOTICS: SCIENCE AND SYSTEMS XV, 2019,
  • [10] Human-Robot Interaction and Collaborative Manipulation with Multimodal Perception Interface for Human
    Huang, Shouren
    Ishikawa, Masatoshi
    Yamakawa, Yuji
    PROCEEDINGS OF THE 7TH INTERNATIONAL CONFERENCE ON HUMAN-AGENT INTERACTION (HAI'19), 2019, : 289 - 291