VitaSi: A real-time contactless vital signs estimation system

The non-contact monitoring of vital signs, especially the Heart Rate (HR) and Breathing Rate (BR), using facial video is becoming increasingly important. Although, researchers have made considerable progress in the past few years, there are still some limitations to the technology, such as the lack of challenging datasets, the time consuming nature of the estimation process, and non-portability of the system. In this paper, we proposed a new framework for estimating HRs and BRs by combining a Convolutional Neural Network (CNN) with the Phase-based Video Motion Processing (PVMP) algorithm. The experimental results show that our approach achieves better performance. Meanwhile, we introduce a new challenging dataset with fewer constraints, such as large movements, facial expressions and light interference. In addition, we developed a new Android application, which works in real time and offline, based on a CNN for HR and BR estimations.