Plant Identification: Experts vs. Machines in the Era of Deep Learning Deep Learning Techniques Challenge Flora Experts

• Published in: Multimedia Tools and Applications for Environmental & Biodiversity Informatics Vol. Chapter 8; pp. 131 - 149
• Main Authors: Bonnet, Pierre, Goëau, Hervé, Hang, Siang Thye, Lasseck, Mario, Šulc, Milan, Malécot, Valéry, Jauzein, Philippe, Melet, Jean-Claude, You, Christian, Joly, Alexis
• Format: Book Chapter
• Language: English
• Published: Cham Springer International Publishing 20.06.2018; Editions Springer
• Series: Multimedia Systems and Applications
• Subjects: Computer Science; Environmental Sciences
• ISBN: 3319764446; 9783319764443
• DOI: 10.1007/978-3-319-76445-0_8

Automated identification of plants and animals have improved considerably in the last few years, in particular thanks to the recent advances in deep learning. The next big question is how far such automated systems are from the human expertise. Indeed, even the best experts are sometimes confused and/or disagree between each others when validating visual or audio observations of living organism. A picture or a sound actually contains only a partial information that is usually not sufficient to determine the right species with certainty. Quantifying this uncertainty and comparing it to the performance of automated systems is of high interest for both computer scientists and expert naturalists. This chapter reports an experimental study following this idea in the plant domain. In total, nine deep-learning systems implemented by three different research teams were evaluated with regard to nine expert botanists of the French flora. Therefore, we created a small set of plant observations that were identified in the field and revised by experts in order to have a near-perfect golden standard. The main outcome of this work is that the performance of state-of-the-art deep learning models is now close to the most advanced human expertise. This shows that automated plant identification systems are now mature enough for several routine tasks, and can offer very promising tools for autonomous ecological surveillance systems.