Automated Zebrafish Spine Scoring System Based on Instance Segmentation

• Published in: IEEE access Vol. 13; pp. 18814 - 18826
• Main Authors: Chen, Wen-Hsin, Kuo, Tien-Ying, Wei, Yu-Jen, Ho, Cheng-Jung, Lin, Ming-der, Chen, Huan, Lin, Wen-Ying
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 2025; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Accuracy; Algorithms; Artificial neural networks; Classification algorithms; Computer architecture; Deep learning; Effectiveness; Feature extraction; image analysis; Image segmentation; Instance segmentation; Machine learning; Micromechanical devices; Object recognition; object segmentation; Osteoporosis; Prediction algorithms; Proposals; Spine; Vertebrae; Zebrafish
• ISSN: 2169-3536; 2169-3536
• DOI: 10.1109/ACCESS.2025.3532680

In studying new medicines for osteoporosis, researchers use zebrafish as animal subjects to test drugs and observe the growth situation of their vertebrae in the spine to confirm the efficacy of new medicines. However, the current method for evaluating efficacy is time-consuming and labor-intensive, requiring manual observation. Taking advantage of advancements in deep learning technology, we propose an automatic method for detecting and recognizing zebrafish vertebrae of the images captured from image sensors to solve this problem. Our method was designed using Mask R-CNN as the instance segmentation backbone, enhanced with a mask enhancement module and a small object preprocessing approach to strengthen its detection abilities. Compared to the original Mask R-CNN architecture, our method improved the mean average precision (mAP) score for vertebra bounding box and mask detection by 7.1% to 97.7% and by 1.2% to 96.6%, respectively. Additionally, we developed a system using these detection algorithms to automatically calculate spinal vertebra growth scores, providing a valuable tool for researchers to assess drug efficacy.