Construction of a robot control system which understands a voice and pointing actions

This research was aimed at making a robot that can go and get an object designated by the user. We produced a robot control system that uses pointing and voice control. This control system is composed of two systems. One system is the object instruction system that uses pointing, and the other is the object instruction system that uses voice. The approximate position of a designated object is recognized by the object instruction system that uses pointing, and information about the object and instructions about the operation are conveyed by the object instruction system that uses voice. This time, the object instruction system that uses pointing has been designed and verified as the first step. A calculation resource to calculate the approximate position of the designated object is obtained when the user points directly at the object. A robot can be moved around a designated object by using this system. The object instruction system that uses voice will be constructed in future work.