CiteSeerx: A Scholarly Big Dataset

• Published in: Advances in Information Retrieval pp. 311 - 322
• Main Authors: Caragea, Cornelia, Wu, Jian, Ciobanu, Alina, Williams, Kyle, Fernández-Ramírez, Juan, Chen, Hung-Hsuan, Wu, Zhaohui, Giles, Lee
• Format: Book Chapter
• Language: English
• Published: Cham Springer International Publishing
• Series: Lecture Notes in Computer Science
• Subjects: CiteSeer; Record Linkage; Scholarly Big Data
• ISBN: 9783319060279; 3319060279
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/978-3-319-06028-6_26

The CiteSeerx digital library stores and indexes research articles in Computer Science and related fields. Although its main purpose is to make it easier for researchers to search for scientific information, CiteSeerx has been proven as a powerful resource in many data mining, machine learning and information retrieval applications that use rich metadata, e.g., titles, abstracts, authors, venues, references lists, etc. The metadata extraction in CiteSeerx is done using automated techniques. Although fairly accurate, these techniques still result in noisy metadata. Since the performance of models trained on these data highly depends on the quality of the data, we propose an approach to CiteSeerx metadata cleaning that incorporates information from an external data source. The result is a subset of CiteSeerx, which is substantially cleaner than the entire set. Our goal is to make the new dataset available to the research community to facilitate future work in Information Retrieval.