The Google scholar experiment: How to index false papers and manipulate bibliometric indicators

• Published in: Journal of the Association for Information Science and Technology Vol. 65; no. 3; pp. 446 - 454
• Main Authors: Delgado López-Cózar, Emilio, Robinson-García, Nicolás, Torres-Salinas, Daniel
• Format: Journal Article
• Language: English
• Published: Malden, MA Blackwell Publishing Ltd 01.03.2014; Wiley
• Subjects: Bibliometrics; Bibliometrics. Scientometrics; Bibliometrics. Scientometrics. Evaluation; Citation analysis; Citation indexes; Communities; Errors; Exact sciences and technology; Indicators; Information and communication sciences; Information science. Documentation; Library and information science. General aspects; Multidisciplinary; Perception; Sciences and techniques of general use; Scientific papers; Search engines; Scientific literature; Bibliometrics; Periodical; Database; Metric; Citation; Bibliometric analysis; Indicator
• ISSN: 2330-1635; 2330-1643
• DOI: 10.1002/asi.23056

Google Scholar has been well received by the research community. Its promises of free, universal, and easy access to scientific literature coupled with the perception that it covers the social sciences and the humanities better than other traditional multidisciplinary databases have contributed to the quick expansion of Google Scholar Citations and Google Scholar Metrics: 2 new bibliometric products that offer citation data at the individual level and at journal level. In this article, we show the results of an experiment undertaken to analyze Google Scholar's capacity to detect citation‐counting manipulation. For this, we uploaded 6 documents to an institutional web domain that were authored by a fictitious researcher and referenced all the publications of the members of the EC3 research group at the University of Granada. The detection by Google Scholar of these papers caused an outburst in the number of citations included in the Google Scholar Citations profiles of the authors. We discuss the effects of such an outburst and how it could affect the future development of such products, at both the individual level and the journal level, especially if Google Scholar persists with its lack of transparency.