The development of food image detection and recognition model of Korean food for mobile dietary management

• Published in: Nutrition research and practice Vol. 13; no. 6; pp. 521 - 528
• Main Authors: Park, Seon-Joo, Palvanov, Akmaljon, Lee, Chang-Ho, Jeong, Nanoom, Cho, Young-Im, Lee, Hae-Jeung
• Format: Journal Article
• Language: English
• Published: Korea (South) 한국영양학회 01.12.2019; Korean Nutrition Society; The Korean Nutrition Society and the Korean Society of Community Nutrition
• Subjects: Datasets; Dietary intake; Food; Neural networks; Original Research; 생활과학; mobile device; deep convolutional neural networks (DCNN); dietary assessment; Food recognition
• DOI: 10.4162/nrp.2019.13.6.521
• ISSN: 1976-1457

The aim of this study was to develop Korean food image detection and recognition model for use in mobile devices for accurate estimation of dietary intake. We collected food images by taking pictures or by searching web images and built an image dataset for use in training a complex recognition model for Korean food. Augmentation techniques were performed in order to increase the dataset size. The dataset for training contained more than 92,000 images categorized into 23 groups of Korean food. All images were down-sampled to a fixed resolution of 150 × 150 and then randomly divided into training and testing groups at a ratio of 3:1, resulting in 69,000 training images and 23,000 test images. We used a Deep Convolutional Neural Network (DCNN) for the complex recognition model and compared the results with those of other networks: AlexNet, GoogLeNet, Very Deep Convolutional Neural Network, VGG and ResNet, for large-scale image recognition. Our complex food recognition model, K-foodNet, had higher test accuracy (91.3%) and faster recognition time (0.4 ms) than those of the other networks. The results showed that K-foodNet achieved better performance in detecting and recognizing Korean food compared to other state-of-the-art models.