Automatic localization and segmentation of adherent microplastics in optical micrographs based on improved YOLOv5 and adaptive perceptual UNET 3

• Published in: Biomedical signal processing and control Vol. 95; p. 106399
• Main Authors: Hao, Yue, Wang, Peng, Cui, Minrou, zeng, Zhenhua, Ma, Sha, Li, Yixi, Zou, Tu, Fang, Xianglin, Lin, Lin
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 01.09.2024
• Subjects: Carp whole blood; Deep learning; Micrograph segmentation; Microplastics; Target detection; Deep learning; Microplastics; Micrograph segmentation; Target detection; Carp whole blood
• ISSN: 1746-8094; 1746-8108
• DOI: 10.1016/j.bspc.2024.106399

[Display omitted] •First high-performance segmentation of adherent microplastics in whole blood micrographs of carp with mIOU up to 96%•A microplastic micrograph target detection dataset and a microplastic micrograph semantic segmentation dataset were constructed.•The RS_YOLOv5 model and the adaptive perceptual UNET3+++ model are constructed, and a two-level fusion network detection and segmentation method is proposed. Rapid and accurate measurements of microplastic residues in biological tissues are crucial for determining exposure levels and studying microplastic invasion mechanisms. However, manual extraction of microplastics from micrographs is labor-intensive, especially for small, irregularly shaped adhesive particles from the whole blood of carp with complex backgrounds. This study proposed a detection and segmentation approach of a two-level fusion network with a variable universe, which can simultaneously achieve accurate segmentation and counting of adherent microplastics of different shapes and scales. In the target detection model, YOLOv5 serves as a prototype, and the RS adaptive structure is introduced, which improves the accuracy by 4.9 %, the mAP by 4.4 %, and the computation amount is reduced by 22.8 % compared with the traditional YOLOv5 model. In the segmentation model, with UNet3 + as the prototype, ECA (Efficient Channel Attention) is introduced in the last two layers of the full-scale inter-skip connection, and DANet(Dual Attention Network) is integrated into the last layer of the encoder, the average F1 score achieved on a dataset of 2831 microplastic images was 99.65 %. This result effectively meets the requirement for accurate extraction of each microplastic particle. Overall, the extraction of adherent microplastics from the whole blood of carp validates the potential of optical microimaging and two-level fusion network-based detection and segmentation methods for the extraction of adherent microplastics from human blood.