Using mobile-based augmented reality and object detection for real-time Abalone growth monitoring

• Published in: Computers and electronics in agriculture Vol. 207; p. 107744
• Main Authors: Napier, Thomas, Lee, Ickjai
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.04.2023
• Subjects: Aquaculture; Augmented reality; Deep learning; Greenlip Abalone; Object detection; Deep learning; Greenlip Abalone; Augmented reality; Object detection; Aquaculture
• ISSN: 0168-1699; 1872-7107
• DOI: 10.1016/j.compag.2023.107744

Abalone are becoming increasingly popular for human consumption. Whilst their popularity has risen, measuring the number and size distribution of Abalone at various stages of growth in existing farms remains a significant challenge. Current Abalone stock management techniques rely on manual inspection which is time consuming, causes stress to the animal, and results in mediocre data quality. To rectify this, we propose a novel mobile-based tool which combines object detection and augmented reality for the real-time counting and measuring of Abalone, that is both network and location independent. We applied our portable handset tool to both measure and count Abalone at various growth stages, and performed extended measuring evaluation to assess the robustness of our proposed approach. Our experimental results revealed that the proposed tool greatly outperforms traditional approaches and was able to successfully count up to 15 Abalone at various life stages with above 95% accuracy, as well as significantly decrease the time taken to measure Abalone while still maintaining an accuracy within a maximum error range of 2.5% of the Abalone’s actual size. •We propose a mobile-based real-time Abalone counting and measuring framework.•A mobile-based augmented reality approach is proposed for Abalone measurement.•A portable app is developed to identify and count Abalone at various stages.