Assessing the accuracy of free automated plant identification applications

• Published in: People and nature (Hoboken, N.J.) Vol. 5; no. 3; pp. 929 - 937
• Main Authors: Hart, Adam G., Bosley, Hayley, Hooper, Chloe, Perry, Jessica, Sellors‐Moore, Joel, Moore, Oliver, Goodenough, Anne E.
• Format: Journal Article
• Language: English
• Published: London John Wiley & Sons, Inc 01.06.2023; Wiley
• Subjects: Accuracy; automated identification; Automation; Birds; Cell phones; Cellular telephones; Data collection; Deep learning; Ecologists; Ecology; Ferns; Flowers & plants; Forbs; Google Lens; Identification; Identification keys; iNaturalist Seek; LeafSnap; Machine learning; Pandemics; plant identification; PlantNet; PlantSnap; species ID; Taxonomy; Trends; United Kingdom > UK
• ISSN: 2575-8314; 2575-8314
• DOI: 10.1002/pan3.10460

Widely available and inexpensive mobile phone applications offer users, whether professional ecologists or interested amateurs, the potential for simple and rapid automated identification of species, without the need to use field guides and identification keys. The increasing accuracy of machine learning is well established, but it is currently unclear if, and under what circumstances, free‐to‐use mobile phone applications are accurate for identifying plants to species level in real‐world field conditions. We test five popular and free identification applications for plants using 857 professionally identified images of 277 species from 204 genera. Across all applications, 85% of images were identified correctly in the top five suggestions, and 69% were correct with the first suggestion. Plant type (woody, forbs, grasses, rushes/sedges, ferns/horsetails) was a significant determinant of identification performance for each application. For some applications, image saliency was also important; exposure and focus were not significant. Applications performed well, with at least one of the three best‐performing applications identifying 96% of images correctly as their first suggestion. We conclude that, subject to some caveats, free phone‐based plant identification applications are valid and useful tools for those wanting rapid identification and for anyone wanting to engage with the natural world. Read the free Plain Language Summary for this article on the Journal blog. Read the free Plain Language Summary for this article on the Journal blog.