Automatic Annotation of Images in Persian Scientific Documents Based on Text Analysis Methods

• Published in: Pizhūhishnāmah-i pardāzish va mudiriyyat-i iṭṭilāʻāt (Online) Vol. 37; no. 3; pp. 895 - 918
• Main Authors: Azadeh fakhrzadeh, Mohadeseh Rahnama, Jalal A Nasiri
• Format: Journal Article
• Language: Persian
• Published: Iranian Research Institute for Information and Technology 01.03.2022
• Subjects: image annotation; image retrieval; image tagging; information technology; metadata extraction; text analysis
• ISSN: 2251-8223; 2251-8231

In this paper a new method for annotating images in Persian scientific documents is suggested. Images in scientific documents contain valuable information. In many cases, by analyzing images one can understand the main idea and important results of the document. Due to explosive growth of image data, automatic image annotation has attracted extensive attention and become one of the growing subjects in the literature. Image annotation is the first step in image retrieval methods, in which descriptive tags are assigned to each image. Here, for image annotation the associated text is used. The caption and the part of the document that includes the reference to the image are considered. None phrases in the associated text are ranked based on five different methods: term frequency, inverse document frequency, term frequency–inverse document frequency, cosine similarity between word embedding of noun phrases in the text and the caption and using both term frequency–inverse document frequency and cosine similarity methods. Image tags in every method are the noun phrases with the highest rank. Suggested methods are evaluated on the test data from Iran scientific information database (Ganj), the main database of Persian scientific documents. Term frequency–inverse document frequency method gives the best results.