On the credibility of QS and THE ranking by subject area: misalignment of subject mapping to academic disciplines
In this study, we point the attention to some inaccuracies in the mapping between the journal subject classification by Elsevier and the narrow subject field used by QS (Quacquarelli Symonds) and THE (Times Higher Education) in their World University Rankings by subject. We noticed that inaccuracies...
Saved in:
Published in | Scientometrics Vol. 130; no. 4; pp. 2237 - 2272 |
---|---|
Main Authors | , |
Format | Journal Article |
Language | English |
Published |
Cham
Springer International Publishing
01.04.2025
Springer Nature B.V |
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | In this study, we point the attention to some inaccuracies in the mapping between the journal subject classification by Elsevier and the narrow subject field used by QS (Quacquarelli Symonds) and THE (Times Higher Education) in their World University Rankings by subject. We noticed that inaccuracies in this mapping will result in classifying some publications under far disciplines, rendering the announced subject ranking inaccurate. To give an example of these inaccuracies, publications on fuel technology, nuclear engineering, and all energy-related studies are classified under Civil Engineering in THE ranking and under Electrical and Electronics Engineering under the QS ranking. This is completely unfair as many of these studies are conducted by researchers in Mechanical or Chemical engineering disciplines. To demonstrate the effect of this erroneous mapping on the final ranking, we obtained the publications data for 13 institutions from the top 20 institutions in the Arab World from 2017 to 021 and their citations until mid-2022 as indexed in Scopus. Following QS and THE subject ranking methodology, we then re-ranked these institutions based on citations per paper and h-index indicators based on a modified subject mapping suggested by a sample of 12 faculty members from 6 different engineering departments at the authors’ institution. We found that the new ranking differed considerably from the one calculated by QS and THE based on their controversial subject mapping. Many institutions (sometimes 10 out of 13) had their rank change in some subject areas with the rank of some institutions dropping 6 ranks out of 13 in some cases! We believe this study sheds light on the inaccuracies in subject rankings and the importance of coming up with a unified subject mapping to be used by the different ranking bodies. |
---|---|
AbstractList | In this study, we point the attention to some inaccuracies in the mapping between the journal subject classification by Elsevier and the narrow subject field used by QS (Quacquarelli Symonds) and THE (Times Higher Education) in their World University Rankings by subject. We noticed that inaccuracies in this mapping will result in classifying some publications under far disciplines, rendering the announced subject ranking inaccurate. To give an example of these inaccuracies, publications on fuel technology, nuclear engineering, and all energy-related studies are classified under Civil Engineering in THE ranking and under Electrical and Electronics Engineering under the QS ranking. This is completely unfair as many of these studies are conducted by researchers in Mechanical or Chemical engineering disciplines. To demonstrate the effect of this erroneous mapping on the final ranking, we obtained the publications data for 13 institutions from the top 20 institutions in the Arab World from 2017 to 021 and their citations until mid-2022 as indexed in Scopus. Following QS and THE subject ranking methodology, we then re-ranked these institutions based on citations per paper and h-index indicators based on a modified subject mapping suggested by a sample of 12 faculty members from 6 different engineering departments at the authors’ institution. We found that the new ranking differed considerably from the one calculated by QS and THE based on their controversial subject mapping. Many institutions (sometimes 10 out of 13) had their rank change in some subject areas with the rank of some institutions dropping 6 ranks out of 13 in some cases! We believe this study sheds light on the inaccuracies in subject rankings and the importance of coming up with a unified subject mapping to be used by the different ranking bodies. |
Author | Alshraideh, Hussam Abdelgawad, Mohamed |
Author_xml | – sequence: 1 givenname: Hussam surname: Alshraideh fullname: Alshraideh, Hussam organization: Department of Industrial Engineering, The American University of Sharjah, Industrial Engineering Department, Jordan University of Science and Technology – sequence: 2 givenname: Mohamed orcidid: 0000-0001-6711-1336 surname: Abdelgawad fullname: Abdelgawad, Mohamed email: mabdelgawad@aus.edu organization: Department of Mechanical Engineering, The American University of Sharjah, Department of Mechanical Engineering, Assiut University |
BookMark | eNp9kD1PwzAURS1UJNrCH2CyxGzwR-LEbKgqFKkSQpTZcpyX4pI4qZ0O_fekBMTG9IZ7z33SmaGJbz0gdM3oLaM0u4uMMcUJ5SmhKZeSyDM0ZWmeE55LNkFTykROFBP0As1i3NEBEjSfov2Lx_0HYBugdIWrXX_EbYVf37DxJd6sljgY_-n8FhdHHA_FDmyPTQBzjxsXTe22vgHfn5jftDFddwL6FhtrSmicxaWL1nW18xAv0Xll6ghXP3eO3h-Xm8WKrF-enhcPa2J5xnsigCtmbWIhBcGVFKAsqCyByorMUgABSQK5rBIj81SYwgheKWl5YU0Gkok5uhl3u9DuDxB7vWsPwQ8vtWAqE2nKpBpafGzZ0MYYoNJdcI0JR82oPqnVo1o9qNXfarUcIDFCcSj7LYS_6X-oL2NXfsg |
Cites_doi | 10.3390/publications9010012 10.5530/jscires.12.1.009 10.1108/AAAJ-01-2023-183 10.1080/08841241.2012.737870 10.1016/j.joi.2016.02.003 10.1086/517897 10.1038/d41586-023-00639-4 10.1007/s11192-023-04901-4 10.1097/ACM.0000000000003084 10.3390/educsci12040229 10.1007/s11192-014-1355-y 10.1371/journal.pone.0111530 10.1057/hep.2008.1 |
ContentType | Journal Article |
Copyright | Akadémiai Kiadó Zrt 2025 Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law. Copyright Springer Nature B.V. 2025 |
Copyright_xml | – notice: Akadémiai Kiadó Zrt 2025 Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law. – notice: Copyright Springer Nature B.V. 2025 |
DBID | AAYXX CITATION E3H F2A |
DOI | 10.1007/s11192-025-05266-6 |
DatabaseName | CrossRef Library & Information Sciences Abstracts (LISA) Library & Information Science Abstracts (LISA) |
DatabaseTitle | CrossRef Library and Information Science Abstracts (LISA) |
DatabaseTitleList | Library and Information Science Abstracts (LISA) |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Sciences (General) Computer Science Education |
EISSN | 1588-2861 |
EndPage | 2272 |
ExternalDocumentID | 10_1007_s11192_025_05266_6 |
GroupedDBID | --K -Y2 -~C -~X .86 .DC .VR 06D 0R~ 0VY 123 1B1 1N0 1SB 2.D 203 28- 2J2 2JN 2JY 2KG 2KM 2LR 2P1 2VQ 2~H 30V 4.4 406 408 409 40D 40E 53G 5QI 5VS 67Z 6NX 77K 8TC 8UJ 95- 95. 95~ 96X AAAVM AABHQ AACDK AAHNG AAIAL AAJBT AANZL AAOBN AAPKM AARHV AARTL AASML AATNV AATVU AAUYE AAWCG AAWTL AAYIU AAYQN AAYTO AAYZH ABAKF ABBBX ABBRH ABBXA ABDBE ABDZT ABECU ABFTV ABHLI ABHQN ABJNI ABJOX ABKCH ABKTR ABMNI ABMQK ABNWP ABQBU ABQSL ABSXP ABTEG ABTHY ABTKH ABTMW ABULA ABWNU ABXPI ACAOD ACBXY ACDTI ACGFS ACHQT ACHSB ACHXU ACIWK ACKNC ACMDZ ACMLO ACOKC ACOMO ACPIV ACPRK ACSNA ACYUM ACZOJ ADHHG ADHIR ADHKG ADIMF ADKNI ADKPE ADMLS ADRFC ADTPH ADURQ ADYFF ADZKW AEBTG AEFIE AEFQL AEGAL AEGNC AEJHL AEJRE AEKMD AEMSY AENEX AEOHA AEPYU AESKC AETLH AEVLU AEXYK AFBBN AFDZB AFEXP AFGCZ AFLOW AFOHR AFQWF AFRAH AFWTZ AFZKB AGAYW AGDGC AGGDS AGJBK AGMZJ AGQEE AGQMX AGQPQ AGRTI AGWIL AGWZB AGYKE AHAVH AHBYD AHPBZ AHSBF AHYZX AIAKS AIGIU AIIXL AILAN AITGF AJBLW AJRNO AJZVZ ALMA_UNASSIGNED_HOLDINGS ALWAN AMKLP AMXSW AMYLF AMYQR AOCGG ARMRJ ASPBG AVWKF AXYYD AYFIA AYJHY AZFZN B-. BA0 BBWZM BDATZ BGNMA BSONS CAG COF CS3 CSCUP DDRTE DL5 DNIVK DPUIP DU5 EBLON EBS EIOEI EJD ESBYG F5P FEDTE FERAY FFXSO FIGPU FINBP FNLPD FRRFC FSGXE FWDCC GGCAI GGRSB GJIRD GNWQR GQ7 GQ8 GXS H13 HF~ HG5 HG6 HMJXF HQYDN HRMNR HVGLF HZ~ IHE IJ- IKXTQ ITM IWAJR IXC IZIGR IZQ I~X I~Y I~Z J-C J0Z JBSCW JCJTX JZLTJ KDC KOV KOW LLZTM M4Y MA- MET MKB N2Q N9A NB0 NDZJH NPVJJ NQ- NQJWS NU0 O-J O9- O93 O9G O9I O9J OAM OVD P19 P9O PF0 PT4 PT5 QOK QOS R-Y R4E R89 R9I RHV RIG RKA RNI ROL RPX RPZ RSV RZC RZE RZK S16 S1Z S26 S27 S28 S3B SAP SCJ SCLPG SCO SDH SDM SHX SISQX SJYHP SNE SNPRN SNX SOHCF SOJ SPISZ SRMVM SSLCW STPWE SZN T13 T16 TEORI TN5 TSG TSK TSV TUC U2A UG4 UOJIU UTJUX UZXMN VC2 VFIZW W23 W48 WH7 WHG WK6 WK8 YLTOR Z45 ZMTXR ~A9 ~EX AAYXX ABFSG ACSTC AEZWR AFHIU AHWEU AIXLP ATHPR CITATION ABRTQ E3H F2A |
ID | FETCH-LOGICAL-c272t-3e291cc4ce5e32963e9ce974efc37c0ee3e44e86f4a6853aba32f96c2bca7e613 |
IEDL.DBID | U2A |
ISSN | 0138-9130 |
IngestDate | Fri Jul 25 11:00:18 EDT 2025 Sun Jul 06 05:06:44 EDT 2025 Wed Apr 30 01:18:06 EDT 2025 |
IsPeerReviewed | true |
IsScholarly | true |
Issue | 4 |
Keywords | Arab world THE subject ranking QS subject ranking Subject mapping University ranking |
Language | English |
LinkModel | DirectLink |
MergedId | FETCHMERGED-LOGICAL-c272t-3e291cc4ce5e32963e9ce974efc37c0ee3e44e86f4a6853aba32f96c2bca7e613 |
Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 |
ORCID | 0000-0001-6711-1336 |
PQID | 3197355169 |
PQPubID | 2043823 |
PageCount | 36 |
ParticipantIDs | proquest_journals_3197355169 crossref_primary_10_1007_s11192_025_05266_6 springer_journals_10_1007_s11192_025_05266_6 |
PublicationCentury | 2000 |
PublicationDate | 2025-04-01 |
PublicationDateYYYYMMDD | 2025-04-01 |
PublicationDate_xml | – month: 04 year: 2025 text: 2025-04-01 day: 01 |
PublicationDecade | 2020 |
PublicationPlace | Cham |
PublicationPlace_xml | – name: Cham – name: Dordrecht |
PublicationSubtitle | An International Journal for all Quantitative Aspects of the Science of Science, Communication in Science and Science Policy |
PublicationTitle | Scientometrics |
PublicationTitleAbbrev | Scientometrics |
PublicationYear | 2025 |
Publisher | Springer International Publishing Springer Nature B.V |
Publisher_xml | – name: Springer International Publishing – name: Springer Nature B.V |
References | 5266_CR2 CM Weston (5266_CR15) 2020; 95 GD Carnegie (5266_CR1) 2023; 36 5266_CR3 WN Espeland (5266_CR4) 2007; 113 E Hazelkorn (5266_CR5) 2008; 21 5266_CR6 M Karlovčec (5266_CR7) 2015; 102 5266_CR8 K Obermeit (5266_CR9) 2012; 22 L Waltman (5266_CR13) 2014; 9 R Pranckutė (5266_CR11) 2021; 9 M Thelwall (5266_CR12) 2024; 129 Q Wang (5266_CR14) 2016; 10 TM Wut (5266_CR16) 2022; 12 F Osareh (5266_CR10) 2023; 12 |
References_xml | – volume: 9 start-page: 12 issue: 1 year: 2021 ident: 5266_CR11 publication-title: Publications doi: 10.3390/publications9010012 – ident: 5266_CR6 – ident: 5266_CR2 – volume: 12 start-page: 54 issue: 1 year: 2023 ident: 5266_CR10 publication-title: Journal of Scientometric Research doi: 10.5530/jscires.12.1.009 – volume: 36 start-page: 430 issue: 1 year: 2023 ident: 5266_CR1 publication-title: Accounting, Auditing and Accountability Journal doi: 10.1108/AAAJ-01-2023-183 – ident: 5266_CR8 – volume: 22 start-page: 206 issue: 2 year: 2012 ident: 5266_CR9 publication-title: Journal of Marketing for Higher Education doi: 10.1080/08841241.2012.737870 – volume: 10 start-page: 347 issue: 2 year: 2016 ident: 5266_CR14 publication-title: Journal of Informetrics doi: 10.1016/j.joi.2016.02.003 – volume: 113 start-page: 1 issue: 1 year: 2007 ident: 5266_CR4 publication-title: American Journal of Sociology doi: 10.1086/517897 – ident: 5266_CR3 doi: 10.1038/d41586-023-00639-4 – volume: 129 start-page: 1097 issue: 2 year: 2024 ident: 5266_CR12 publication-title: Scientometrics doi: 10.1007/s11192-023-04901-4 – volume: 95 start-page: 637 issue: 4 year: 2020 ident: 5266_CR15 publication-title: Academic Medicine doi: 10.1097/ACM.0000000000003084 – volume: 12 start-page: 229 issue: 4 year: 2022 ident: 5266_CR16 publication-title: Education Sciences doi: 10.3390/educsci12040229 – volume: 102 start-page: 433 issue: 1 year: 2015 ident: 5266_CR7 publication-title: Scientometrics doi: 10.1007/s11192-014-1355-y – volume: 9 start-page: e111530 issue: 10 year: 2014 ident: 5266_CR13 publication-title: PLoS ONE doi: 10.1371/journal.pone.0111530 – volume: 21 start-page: 193 year: 2008 ident: 5266_CR5 publication-title: Higher Education Policy doi: 10.1057/hep.2008.1 |
SSID | ssj0007308 |
Score | 2.4298918 |
Snippet | In this study, we point the attention to some inaccuracies in the mapping between the journal subject classification by Elsevier and the narrow subject field... |
SourceID | proquest crossref springer |
SourceType | Aggregation Database Index Database Publisher |
StartPage | 2237 |
SubjectTerms | Academic disciplines Chemical engineering Civil engineering Classification Colleges & universities Computer Science Education Fuel technology Information Storage and Retrieval Institutions Library Science Mapping Misalignment Nuclear engineering Nuclear power plants Ranking |
Title | On the credibility of QS and THE ranking by subject area: misalignment of subject mapping to academic disciplines |
URI | https://link.springer.com/article/10.1007/s11192-025-05266-6 https://www.proquest.com/docview/3197355169 |
Volume | 130 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3BbtQwEB3R9sKl0JaKhVLNgQMVRGpsx85y26JdViCKqnalcopsZ9xTs0C2h_49Y6_TFQgOnBIpiSPlzYzfxDPPAK-1cVElynP0IyoUtbJwwbmiNTJUxirR2tjg_OVczxfq03V1nZvC-qHafViSTJF60-xWlrFSUlRF1CjRhd6CnSrm7mzFCzF5iL9ssyn-lsmV5Wlulfn7GL9PRxuO-ceyaJptZk9hN9NEnKxx3YNH1O3Dk2ELBsweuQ97-azHN1lA-uQAfnztkHkdRjHQdfHrPS4DXlyi7Vq8mk8x7tTO70V3j_2di79i0DJ7fI-MOhPzm1QiEJ8Zrt7aqONwg6sl2lxRjw8NvdQ_g8VsevVhXuStFQovjFgVksS49F55qkgKdkIae-LUgoKXxjNskpSiWgdlNU_o1lkpwlh74bw1xBTgELa7ZUfPAevQVroeV0Sm5myLahWMdsIFTpVEqfwI3g5fuPm-VtBoNlrJEY-G8WgSHo0ewdEAQpO9qW84TBiZVvRG8G4AZnP536O9-L_bX8JjkWwjFuYcwfbq5x29Ys6xcsewM5mdnZ3H48dvn6fHyeR-AfEs0Pg |
linkProvider | Springer Nature |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1Nb9QwEB1BOZQL0BbEQj_mwIEKIhHbsbPcqqrV9hOh7kq9RbYz7qlZINtD_z1jr9MVCA69RXLiSHme8XP85hnggzYuukR5zn5EhaJWFi44V7RGhspYJVobC5wvLvVkpk6vq-tcFNYPavdhSzJl6lWxW1lGpaSoiuhRogv9FJ4xGaijkGsmDh7yL4_ZlH_LFMrySy6V-Xcff05HK47517Zomm2OX8GLTBPxYInrBjyhbhNeDkcwYI7ITdjIVz1-zAbS-1vw81uHzOswmoEuxa_3OA_4_Qpt1-J0coTxpHZ-L7p77O9c_BWDltnjV2TUmZjfJIlAfGZovbXRx-EGF3O0WVGPDwW91L-G2fHR9HBS5KMVCi-MWBSSxLj0XnmqSAoOQhp74qUFBS-NZ9gkKUW1DspqntCts1KEsfbCeWuIKcAbWOvmHb0FrENb6XpcEZmaV1tUq2C0Ey7wUkmUyo_g0_CFmx9LB41m5ZUc8WgYjybh0egRbA8gNDma-obThJFpR28EnwdgVs3_7-3d427fg_XJ9OK8OT-5PHsPz0UaJ1Gksw1ri193tMP8Y-F203D7Dddf0Ns |
linkToPdf | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1Nb9QwEB3BIiEu0A8QCy3MgUOrErWxHTvLrYKuFugHqF2pt8h2xj2RLWx62H_P2Jt0aQUHbpGcOFLezPg5M_MM8E4bF1WiPEc_okxRLTMXnMtqI0NhrBK1jQ3OJ6d6MlVfLovLP7r4U7V7n5Jc9jRElaam3b-uw_6q8S3PY9WkKLKoV6Iz_RAecTjOo11PxeFtLGb7TbE4T24tD7q2mb_PcXdpWvHNeynStPKM1-BpRxnxcInxOjygZgOe9ccxYOedG7DeXc1xpxOT3t2En2cNMsfDKAy6LIRd4Czg93O0TY0XkyOMp7bze9EtcH7j4m8ZtMwkPyBbAJP0q1QuEJ_pR3_YqOlwhe0MbVddj7fNvTR_DtPx0cXHSdYds5B5YUSbSRKj3HvlqSAp2CFp5Im3GRS8NJ4hlKQUlTooq3lxt85KEUbaC-etIaYDL2DQzBp6CViGutDlqCAyJe-8qFTBaCdc4G2TyJUfwl7_havrpZpGtdJNjnhUjEeV8Kj0ELZ6EKrOs-YVY2xkyu4N4X0PzGr437O9-r_b38Ljb5_G1fHn06-v4YlIZhLrdbZg0P66oW2mIq17k6ztNxqM1Rc |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=On+the+credibility+of+QS+and+THE+ranking+by+subject+area%3A+misalignment+of+subject+mapping+to+academic+disciplines&rft.jtitle=Scientometrics&rft.date=2025-04-01&rft.pub=Springer+Nature+B.V&rft.issn=0138-9130&rft.eissn=1588-2861&rft.volume=130&rft.issue=4&rft.spage=2237&rft.epage=2272&rft_id=info:doi/10.1007%2Fs11192-025-05266-6&rft.externalDBID=NO_FULL_TEXT |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0138-9130&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0138-9130&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0138-9130&client=summon |