StripeRust-Pocket: A Mobile-Based Deep Learning Application for Efficient Disease Severity Assessment of Wheat Stripe Rust

• Published in: Plant phenomics Vol. 6; no. 3; pp. 201 - 786
• Main Authors: Liu, Weizhen, Chen, Yuxi, Lu, Zhaoxin, Lu, Xiaoyu, Wu, Ze, Zheng, Ziyao, Suo, Yongqiang, Lan, Caixia, Yuan, Xiaohui
• Format: Journal Article
• Language: English
• Published: United States Sanya Science and Education Innovation Park of Wuhan University of Technology,Sanya,Hainan 572025,China%School of Computer Science and Artificial Intelligence,Wuhan University of Technology,Wuhan,Hubei 430070,China%Hubei Hongshan Laboratory,College of Plant Science and Technology,Huazhong Agricultural University,Wuhan 430070,Hubei,China%School of Computer Science and Artificial Intelligence,Wuhan University of Technology,Wuhan,Hubei 430070,China 2024; Wuhan University of Technology Chongqing Research Institute,Chongqing 401120,China; School of Computer Science and Artificial Intelligence,Wuhan University of Technology,Wuhan,Hubei 430070,China; Engineering Research Centre of Chinese Ministry of Education for Edible and Medicinal Fungi,Jilin Agricultural University,Changchun,Jilin 130118,China; Sanya Science and Education Innovation Park of Wuhan University of Technology,Sanya,Hainan 572025,China%School of Computer Science and Artificial Intelligence,Wuhan University of Technology,Wuhan,Hubei 430070,China; AAAS; American Association for the Advancement of Science (AAAS)
• Subjects: Database/Software
• ISSN: 2643-6515; 2643-6515
• DOI: 10.34133/plantphenomics.0201

Wheat stripe rust poses a marked threat to global wheat production. Accurate and effective disease severity assessments are crucial for disease resistance breeding and timely management of field diseases. In this study, we propose a practical solution using mobile-based deep learning and model-assisted labeling. StripeRust-Pocket, a user-friendly mobile application developed based on deep learning models, accurately quantifies disease severity in wheat stripe rust leaf images, even under complex backgrounds. Additionally, StripeRust-Pocket facilitates image acquisition, result storage, organization, and sharing. The underlying model employed by StripeRust-Pocket, called StripeRustNet, is a balanced lightweight 2-stage model. The first stage utilizes MobileNetV2-DeepLabV3+ for leaf segmentation, followed by ResNet50-DeepLabV3+ in the second stage for lesion segmentation. Disease severity is estimated by calculating the ratio of the lesion pixel area to the leaf pixel area. StripeRustNet achieves 98.65% mean intersection over union (MIoU) for leaf segmentation and 86.08% MIoU for lesion segmentation. Validation using an additional 100 field images demonstrated a mean correlation of over 0.964 with 3 expert visual scores. To address the challenges in manual labeling, we introduce a 2-stage labeling pipeline that combines model-assisted labeling, manual correction, and spatial complementarity. We apply this pipeline to our self-collected dataset, reducing the annotation time from 20 min to 3 min per image. Our method provides an efficient and practical solution for wheat stripe rust severity assessments, empowering wheat breeders and pathologists to implement timely disease management. It also demonstrates how to address the "last mile" challenge of applying computer vision technology to plant phenomics.