Frame Elimination for Recordings of Bat Flight Kinematics from a High-Speed Video Array

• Published in: 2023 IEEE Asia-Pacific Conference on Computer Science and Data Engineering (CSDE) pp. 1 - 5
• Main Authors: Jayathunga, D.P., Ramashini, M., Zaini, Juliana, De Silva, Liyanage C., Muller, R.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 04.12.2023
• Subjects: Adaptation models; Cameras; CNN; Deep learning; Frame elimination; Location awareness; Pre-trained models; Shape; Software; Transfer Learning; YOLO; YOLOv5
• DOI: 10.1109/CSDE59766.2023.10487739

Bat flight is complex because they have the ability to change the shape of their wings while in flight to perform manoeuvres. To accurately capture the subject's complexity, we have set up a synchronized array of 50\text{high} -speed cameras. This array is capable of capturing over 50,000 images per second. The video array is designed to cover a large imaging volume that allows bats to perform full-flight manoeuvres. As a result, many video frames do not show the entire bat. Hence, this study uses deep learning techniques to develop an accurate frame elimination process. Until the controlled environment is set up, we used simulated data created from the blender. For the frame elimination purpose, images needed to be classified based on the location of the bat, where it could be fully or partially presented within the frame or maybe not presented. We used different deep learning techniques, including the ordinary CNN, pretrained models, and object detection model - YOLOv5, to achieve this target. Among all the models, we noted that YOLOv5 gave the best accurate unwanted frame elimination results, where the mAP0.5 value is 0.99 .