Algorithmically generated subject categories based on citation relations: An empirical micro study using papers on overall water splitting

• Published in: Journal of informetrics Vol. 12; no. 2; pp. 436 - 447
• Main Authors: Haunschild, Robin, Schier, Hermann, Marx, Werner, Bornmann, Lutz
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 01.05.2018
• Subjects: Algorithmically constructed classification systems; Bibliometrics; Field categorization; Subject categories; Field categorization; Subject categories; Algorithmically constructed classification systems; Bibliometrics
• ISSN: 1751-1577; 1875-5879
• DOI: 10.1016/j.joi.2018.03.004

•The Centre for Science and Technology Studies introduced an algorithmically constructed field classification system (ACCS).•The discriminatory power of the ACCS has been empirically investigated in a case study.•The ACCS has been compared to journal-based and intellectually assigned field classification systems on the paper basis.•One possible interpretation of our results is that the ACCS is not able to distinguish properly between scientific fields.•Since it is not clear whether the results can be generalized, we recommend larger follow-up studies on broad datasets. One important reason for the use of field categorization in bibliometrics is the necessity to make citation impact of papers published in different scientific fields comparable with each other. Raw citations are normalized by using field-categorization schemes to achieve comparable citation scores. There are different approaches to field categorization available. They can be broadly classified as intellectual and algorithmic approaches. A paper-based algorithmically constructed classification system (ACCS) was proposed which is based on citation relations. Using a few ACCS field-specific clusters, we investigate the discriminatory power of the ACCS. The micro study focusses on the topic ‘overall water splitting’ and related topics. The first part of the study investigates intellectually whether the ACCS is able to identify papers on overall water splitting reliably and validly. Next, we compare the ACCS with (1) a paper-based intellectual (INSPEC) classification and (2) a journal-based intellectual classification (Web of Science, WoS, subject categories). In the last part of our case study, we compare the average number of citations in selected ACCS clusters (on overall water splitting and related topics) with the average citation count of publications in WoS subject categories related to these clusters. The results of this micro study question the discriminatory power of the ACCS. We recommend larger follow-up studies on broad datasets.