Texting and Driving Recognition leveraging the Front Camera of Smartphones

• Published in: IEEE Consumer Communications and Networking Conference pp. 1098 - 1103
• Main Authors: Montori, Federico, Spallone, Marco, Bedogni, Luca
• Format: Conference Proceeding
• Language: English
• Published: IEEE 08.01.2023
• Subjects: Automobiles; Belts; Cameras; Classification algorithms; Image recognition; internet of things; object detection; Prediction algorithms; Security
• ISSN: 2331-9860
• DOI: 10.1109/CCNC51644.2023.10060838

The recognition of the activity of texting while driving is an open problem in literature and it is crucial for the security within the scope of automotive. This can bring to life new insurance policies and increase the overall safety on the roads. Many works in literature leverage smartphone sensors for this purpose, however it is shown that these methods take a considerable amount of time to perform a recognition with sufficient confidence. In this paper we propose to leverage the smartphone front camera to perform an image classification and recognize whether the subject is seated in the driver position or in the passenger position. We first applied standalone Convolutional Neural Networks with poor results, then we focused on object detection-based algorithms to detect the presence and the position of discriminant objects (i.e. the security belts and the car win-dow). We then applied the model over short videos by classifying frame by frame until reaching a satisfactory confidence. Results show that we are able to reach around 90 % accuracy in only few seconds of the video, demonstrating the applicability of our method in the real world.