New hybrid vision-based control approach for automated guided vehicles

Automated guided vehicles (AGVs) are a common choice made by many companies for material handling (MH) in manufacturing systems. AGV-based internal transport of raw materials, goods, and parts is becoming improved with advances in technology. Demands for fast, efficient, and reliable transport imply the usage of the flexible AGVs with onboard sensing and special kinds of algorithms needed for daily operations. So far, the majority of these transport solutions have not considered the modern techniques for visual servoing, monocular SLAM, and consequently, the usage of camera as onboard sensor for AGVs. In this research, a new hybrid control of AGV is proposed. The main control algorithm consists of two independent control loops: position-based control (PBC) for global navigation and image based visual seroving (IBVS) for fine motions needed for accurate steering towards loading/unloading point. By separating the initial transportation task into two parts (global navigation towards the goal pose near the loading/unloading point and fine motion from the goal pose to the loading/unloading point), the proposed hybrid control bypasses the need for artificial landmarks or accurate map of the environment. The state estimation of the robot pose is determined in terms of monocular SLAM, via extended Kalman filter coupled with feedforward neural network—the neural extended Kalman filter (NEKF). NEKF is used to model unknown disturbances and to improve the robot state transition model. The integration of the new hybrid control and NEKF has been tested in laboratory with the mobile robot and simple camera. Experimental results present the effectiveness of the proposed hybrid control approach.