Recognition of Oracle Bone Inscriptions by using Two Deep Learning Models

• Published in: International journal of digital humanities Vol. 5; no. 2-3; pp. 65 - 79
• Main Authors: Fujikawa, Yoshiyuki, Li, Hengyi, Yue, Xuebin, Aravinda, C. V., Prabhu, G. Amar, Meng, Lin
• Format: Journal Article
• Language: English
• Published: Cham Springer International Publishing 2023
• Subjects: Applied Statistics; Computational Linguistics; Cultural Studies; Digital/New Media; Mathematics and Statistics; Natural Language Processing (NLP); Original Paper; Statistics; Deep learning; Application Programming Interface; Oracle bone inscriptions recognition
• ISSN: 2524-7840; 2524-7840
• DOI: 10.1007/s42803-022-00044-9

Oracle bone inscriptions (OBIs) contain some of the oldest characters in the world and were used in China about 3000 years ago. As an ancient form of literature, OBIs store a lot of information that can help us understand world history, character evaluations, and more. However, as OBIs were only discovered about 120 years ago, few studies have described them, and the aging process has made the inscriptions less legible. Hence, automatic character detection and recognition have become important issues. This paper aims to design an online OBI recognition system for helping cultural heritage preservation and organization. We have evaluated two deep learning models for OBI recognition and designed an application programming interface (API) that can be accessed online for the recognition. In the first stage, You Only Look Once (YOLO) is applied for detecting and recognizing OBIs. However, since not all of the OBIs can be detected correctly by YOLO in the first stage, we then utilize MobileNet to recognize the undetected OBIs by manually cropping the undetected OBIs in the image. MobileNet is selected for the second stage of recognition as our evaluation of ten state-of-the-art deep learning models showed that it is the best network for OBI recognition due to its superior performance in terms of accuracy, loss and time consumption. We have installed our system on a server as an API and opened it for OBI detection and recognition.