A citation-based approach to automatic topical indexing of scientific literature

• Published in: Journal of information science Vol. 36; no. 6; pp. 798 - 811
• Main Authors: Mahdi, Abdulhussain E., Joorabchi, Arash
• Format: Journal Article
• Language: English
• Published: London, England SAGE Publications 01.12.2010; Sage Publications; Bowker-Saur Ltd
• Subjects: Automatic indexing; Citation indexes; Consistency; Content analysis; Data mining; Exact sciences and technology; Extraction; Human; Indexing; Indexing. Classification. Abstracting; Indexing. Classification. Abstracting. Syntheses; Information and communication sciences; Information and document structure and analysis; Information processing and retrieval; Information retrieval; Information science. Documentation; Information systems; Performance evaluation; Readers; Sciences and techniques of general use; Search engines; State of the art; Studies; keyphrase extraction; citation-based indexing; topical indexing; data mining; Automatic indexing; Scientific communication; Natural language processing; Citation; Knowledge extraction
• ISSN: 0165-5515; 1741-6485
• DOI: 10.1177/0165551510388080

Topical indexing of documents with keyphrases is a common method used for revealing the subject of scientific and research documents to both human readers and information retrieval tools, such as search engines. However, scientific documents that are manually indexed with keyphrases are still in the minority. This article describes a new unsupervised method for automatic keyphrase extraction from scientific documents which yields a performance on a par with human indexers. The method is based on identifying references cited in the document to be indexed and, using the keyphrases assigned to those references, for generating a set of high-likelihood keyphrases for the document. We have evaluated the performance of the proposed method by using it to automatically index a third-party testset of research documents. Reported experimental results show that the performance of our method, measured in terms of consistency with human indexers, is competitive with that achieved by state-of-the-art supervised methods.