Cyber-Physical Signage Interacting With Gesture-Based Human-Machine Interfaces Through Mobile Cloud Computing

In this paper, we propose a cyber-physical signage interacting framework for the interaction between digital signage and mobile users using smart handheld devices, such as smartphones and tablets. The proposed framework can provide diverse multimedia/feedback services to mobile users interacting with digital signage through face detection, classification, and recognition techniques based on mobile cloud computing. Mobile users only need to click and drag the interested service over the face of advertising celebrities/endorsers displayed on digital signage and can obtain supplementary multimedia information or feedback related comments. Using the intuitive way of gesture-based operations, mobile users can directly interact with digital signage through their handheld devices. Our framework reveals an innovative human machine interface for signage interacting between digital signage and mobile users. In addition, we integrate our framework with a face cache mechanism that can make the interaction delay as small as possible for popular signage. Furthermore, an Android-based signage interacting system is implemented to verify the feasibility and superiority of our framework. Experimental results show that our approach outperforms the existing methods and can significantly reduce the average consumption time of obtaining interested multimedia contents from digital signage.