A multimedia ontology model based on linguistic properties and audio-visual features

• Published in: Information sciences Vol. 277; pp. 234 - 246
• Main Author: Rinaldi, Antonio M.
• Format: Journal Article
• Language: English
• Published: Elsevier Inc 01.09.2014
• Subjects: Multimedia ontology; OWL; P2P; Semantic network; WordNet; Multimedia ontology; OWL; WordNet; Semantic network; P2P
• ISSN: 0020-0255; 1872-6291
• DOI: 10.1016/j.ins.2014.02.017

•We define an ontology model based on linguistic properties and low-level audio visual features.•We use standard techniques and descriptors to model knowledge.•Multimodal features increase the quality of representation in knowledge base information systems.•The use of peer2peer paradigm increases sharing and reusability of knowledge. The exponential growth of informative contents needs intelligent information systems able to use data to create information. To aim this goal, these systems should have formal models to represent knowledge. In this way complex data can be managed and used to perform new tasks and implement innovative functionalities. This article describes a general and formal ontology model to represent knowledge using multimedia data and linguistic properties to bridge the gap between the target semantic classes and the available low-level multimedia descriptors. This model has been implemented in a system to edit, manage and share ontology in the WEB. The system provides a graphical interface to add multimedia objects by means of user interaction. The multimedia features are automatically extracted using algorithms based on MPEG-7 descriptors.