Omnidirectional Mobile Robot Control based on Mixed Reality and sEMG Signals

Robots are an important part of social production now, and their control methods have become an important research topic. There is a greater need for remote control and richer ways of interacting. In this paper, virtual reality and the surface electromyography(sEMG) signals are combined with the control of the omnidirectional mobile robot(OMR), and the programs of two devices, the HoloLens and the MYO armband, are respectively programmed and developed, so that they can work together to control the OMR. The basic control method is that HoloLens wearer controls the movement direction of the OMR through gesture or gaze. MYO armband wearer generate different sEMG signals through different gesture to control the velocity of the OMR. When two devices are used together, they can control all the motion of the OMR.