Harvesting models from web 2.0 databases

• Published in: Software and systems modeling Vol. 12; no. 1; pp. 15 - 34
• Main Authors: Díaz, Oscar, Puente, Gorka, Cánovas Izquierdo, Javier Luis, García Molina, Jesús
• Format: Journal Article
• Language: English
• Published: Berlin/Heidelberg Springer-Verlag 01.02.2013; Springer Nature B.V; Springer Verlag
• Subjects: Compilers; Computer Science; Engines; Extraction; Harvesting; Information Systems Applications (incl.Internet); Interpreters; IT in Business; Other; Programming Languages; Programming Techniques; Query languages; Software Engineering; Software Engineering/Programming and Operating Systems; Subscriber line; Tables (data); Theme Section; Websites; Model-driven engineering; Web2.0; Databases; Data re-engineering; Harvesting
• ISSN: 1619-1366; 1619-1374
• DOI: 10.1007/s10270-011-0194-z

Data rather than functionality are the sources of competitive advantage for Web2.0 applications such as wikis, blogs and social networking websites. This valuable information might need to be capitalized by third-party applications or be subject to migration or data analysis. Model-Driven Engineering (MDE) can be used for these purposes. However, MDE first requires obtaining models from the wiki/blog/website database (a.k.a. model harvesting). This can be achieved through SQL scripts embedded in a program. However, this approach leads to laborious code that exposes the iterations and table joins that serve to build the model. By contrast, a Domain-Specific Language (DSL) can hide these “how” concerns, leaving the designer to focus on the “what”, i.e. the mapping of database schemas to model classes. This paper introduces Schemol , a DSL tailored for extracting models out of databases which considers Web2.0 specifics. Web2.0 applications are often built on top of general frameworks (a.k.a. engines) that set the database schema (e.g., MediaWiki, Blojsom ). Hence, table names offer little help in automating the extraction process. In addition, Web2.0 data tend to be annotated. User-provided data (e.g., wiki articles, blog entries) might contain semantic markups which provide helpful hints for model extraction. Unfortunately, these data end up being stored as opaque strings. Therefore, there exists a considerable conceptual gap between the source database and the target metamodel. Schemol offers extractive functions and view-like mechanisms to confront these issues. Examples using Blojsom as the blog engine are available for download.