Multifaceted Evaluation Criteria of Digital Libraries in Academic Settings: Similarities and Differences From Different Stakeholders
Digital library (DL) evaluation is essential to the success and enhancement of DLs. However, there is a lack of research on the assessment of comprehensive evaluation criteria across multiple dimensions of DLs. In particular, limited research is available on criteria prioritization to determine whic...
Saved in:
| Published in | The Journal of academic librarianship Vol. 44; no. 6; pp. 854 - 863 |
|---|---|
| Main Authors | , , |
| Format | Journal Article |
| Language | English |
| Published |
Ann Arbor
Elsevier Inc
01.11.2018
Elsevier Science Ltd |
| Subjects | |
| Online Access | Get full text |
Cover
Loading…
| Abstract | Digital library (DL) evaluation is essential to the success and enhancement of DLs. However, there is a lack of research on the assessment of comprehensive evaluation criteria across multiple dimensions of DLs. In particular, limited research is available on criteria prioritization to determine which criteria are perceived important by different stakeholders. This study was conducted to compare similarities and differences in perceptions of the importance of different DL evaluation criteria by heterogeneous stakeholders in academic settings. Ninety subjects were recruited with 30 from each of the group representing DL scholars, DL librarians, and DL users. Subjects were instructed to fill in an in-depth survey consisting of 10 evaluation dimensions with 94 criteria. ANOVA and t-test were applied to examine the similarities and differences among the three groups. This study reveals consensus and divergence in perceptions of criteria importance among the three groups, and indicates an inherent tension among the stakeholders. Moreover, the differences identify gaps not only between user expectations and the DL practice but also between what's desirable and what's possible in the academic environment. The findings provide a comprehensive list of criteria to guide practical evaluation of DLs, and contribute to the narrowing of the identified gaps. |
|---|---|
| AbstractList | Digital library (DL) evaluation is essential to the success and enhancement of DLs. However, there is a lack of research on the assessment of comprehensive evaluation criteria across multiple dimensions of DLs. In particular, limited research is available on criteria prioritization to determine which criteria are perceived important by different stakeholders. This study was conducted to compare similarities and differences in perceptions of the importance of different DL evaluation criteria by heterogeneous stakeholders in academic settings. Ninety subjects were recruited with 30 from each of the group representing DL scholars, DL librarians, and DL users. Subjects were instructed to fill in an in-depth survey consisting of 10 evaluation dimensions with 94 criteria. ANOVA and t-test were applied to examine the similarities and differences among the three groups. This study reveals consensus and divergence in perceptions of criteria importance among the three groups, and indicates an inherent tension among the stakeholders. Moreover, the differences identify gaps not only between user expectations and the DL practice but also between what's desirable and what's possible in the academic environment. The findings provide a comprehensive list of criteria to guide practical evaluation of DLs, and contribute to the narrowing of the identified gaps. |
| Author | Matusiak, Krystyna K. Xie, Iris Joo, Soohyung |
| Author_xml | – sequence: 1 givenname: Iris surname: Xie fullname: Xie, Iris email: hiris@uwm.edu organization: School of Information Studies, University of Wisconsin–Milwaukee, Northwest Quad Building B, 2025 E. Newport, Milwaukee, WI 53211, United States of America – sequence: 2 givenname: Soohyung surname: Joo fullname: Joo, Soohyung email: soohyug.joo@uky.edu organization: School of Information Science, University of Kentucky, 320 Little Library Bldg., Lexington, KY 40506, United States of America – sequence: 3 givenname: Krystyna K. orcidid: 0000-0003-2713-866X surname: Matusiak fullname: Matusiak, Krystyna K. email: krystyna.matusiak@du.edu organization: Research Methods and Information Science Department, University of Denver, 1999 East Evans Avenue, Denver, CO 80208, United States of America |
| BookMark | eNqFkE1vEzEQhi3USqSFf8DBEucs_lhv7B6QqtAWpCAOKWfLscdlwmZdbKcSd354vQriwAF8scd6nxnNc0HOpjQBIW846zjjw7t957wbcdcJxnXHTMeYeEEWXK_MkhtjzsiCMdPeUsqX5KKUPWuHC7Ugvz4fx4rReagQ6M2TG4-uYproOmOFjI6mSD_gA1Y30g3usssIheJEr70LcEBPt1ArTg_lim7xgGML1DniptDAGCHD5Ft9m9Phz0el2-q-w7c0BsjlFTmPbizw-vd9Sb7e3tyvPy43X-4-ra83Sy9lX5chCsnYKhi5k0oZpo0DgBh7yRUXUnnDgIH2qhegRNwNahhC1EEL8EoNXl6St6e-jzn9OEKpdp-OeWojreBqpXuumW6pq1PK51RKhmh9236WUrPD0XJmZ-t2b0_W7WzdMmOb9Qb3f8GPGQ8u__wf9v6EQVv_CSHb4nH2FjCDrzYk_HeDZ_bGock |
| CitedBy_id | crossref_primary_10_1016_j_acalib_2019_102072 crossref_primary_10_1108_AJIM_08_2019_0213 crossref_primary_10_1177_0961000620935505 crossref_primary_10_1108_EL_05_2022_0126 crossref_primary_10_1016_j_lisr_2022_101159 crossref_primary_10_1016_j_acalib_2019_102045 crossref_primary_10_1108_OIR_07_2020_0295 crossref_primary_10_1108_EL_01_2023_0013 crossref_primary_10_1108_EL_06_2024_0166 crossref_primary_10_1007_s00799_020_00292_6 crossref_primary_10_1108_LHT_07_2021_0226 |
| Cites_doi | 10.1080/13614560701709846 10.1007/s00799-007-0011-z 10.1108/NLW-07-2014-0087 10.1108/00220410410522043 10.1515/LIBR.2005.96 10.1007/s00799-014-0116-0 10.1080/13614576.2012.679446 10.1080/1941126X.2016.1200927 10.1108/JD-08-2016-0099 10.1108/PROG-09-2014-0070 10.1080/19322909.2014.954740 10.1108/EL-05-2012-0046 10.1108/DLP-07-2016-0026 10.1108/AJIM-09-2017-0216 10.1108/DLP-08-2016-0030 10.1108/02640471111156777 10.1016/j.lisr.2006.06.002 10.1016/j.ipm.2007.10.003 10.1045/september2006-recker 10.1002/asi.21220 10.1108/DLP-07-2016-0025 10.1080/01639374.2013.848316 10.1016/j.acalib.2009.11.005 10.1108/OCLC-06-2013-0019 10.1108/14684520610686292 10.1108/00220411011023625 |
| ContentType | Journal Article |
| Copyright | 2018 Elsevier Inc. Copyright Elsevier Science Ltd. Nov 2018 |
| Copyright_xml | – notice: 2018 Elsevier Inc. – notice: Copyright Elsevier Science Ltd. Nov 2018 |
| DBID | AAYXX CITATION E3H F2A |
| DOI | 10.1016/j.acalib.2018.09.002 |
| DatabaseName | CrossRef Library & Information Sciences Abstracts (LISA) Library & Information Science Abstracts (LISA) |
| DatabaseTitle | CrossRef Library and Information Science Abstracts (LISA) |
| DatabaseTitleList | Library and Information Science Abstracts (LISA) |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Library & Information Science |
| EISSN | 1879-1999 |
| EndPage | 863 |
| ExternalDocumentID | 10_1016_j_acalib_2018_09_002 S0099133318301459 |
| GroupedDBID | --K --M -ET -W8 -~X .4I .GJ .~1 0B8 0R~ 123 186 1B1 1RT 1~. 1~5 29J 4.4 41~ 457 4G. 5VS 6TJ 7-5 71M 77K 85S 8P~ 8VB 9JO AABNK AACTN AAEDT AAEDW AAFJI AAIAV AAIKJ AAKOC AALRI AAOAW AAQFI AAQXK AAXUO AAYOK ABDBF ABFNM ABJNI ABLJU ABMAC ABMMH ABPPZ ABSRN ABXDB ABYKQ ACDAQ ACGFS ACHQT ACNCT ACRLP ADBBV ADEZE ADIYS ADMHC ADMUD AEBSH AEKER AEMOZ AETEA AFDAS AFFDN AFFNX AFKWA AFTJW AGHFR AGHSJ AGNAY AGUBO AGYEJ AHHHB AI. AIEXJ AIKHN AITUG AJBFU AJOXV AKVCP AKYCK ALMA_UNASSIGNED_HOLDINGS AMFUW AMRAJ AOMHK ASPBG AVARZ AVWKF AXJTR AZFZN B0M BKOJK BKOMP BLXMC CS3 DO4 DU5 EAP EAS EAU EBE EBR EBS EBU EDJ EFJIC EFLBG EJD ELW EMF EMG EMH EMK EO8 EO9 EP2 EP3 ESO ESX FDB FEDTE FGOYB FIRID FNPLU FYGXN G-2 G-Q G8K GBLVA HMY HVGLF HZ~ IHE J1W K1G KOM LPU M3Y M41 MO0 MVM N9A NEJ NHB O-L O9- OAUVE OHT OZT P-8 P-9 P2P PC. PQQKQ PRBVW Q38 QJJ QWB R2- RIG ROL RPD RPZ S10 SCU SDF SDG SDP SES SEW SPCBC SSB SSO SSS SSZ T5K TH9 TN5 TWZ UBC UHS UKR ULY UNMZH UPT VH1 VQA WH7 WUQ XFK XPP XSW XZL YCJ YCV YQJ YQT YZZ ZCA ZCG ZHY ZL0 ~8M ~G- AAHSB AATTM AAXKI AAYWO AAYXX ABDPE ABWVN ACRPL ACUHS ACVFH ADCNI ADMHG ADNMO AEIPS AEUPX AFJKZ AFPUW AFXIZ AGCQF AGQPQ AGRNS AHQJS AIGII AIIUN AKBMS AKRWK AKYEP ANKPU APXCP BNPGV CITATION SSH E3H EFKBS F2A |
| ID | FETCH-LOGICAL-c334t-df23007d93b3559089aeeeff43151235c90e0e8c542e52fb6566df8d82ec556c3 |
| IEDL.DBID | .~1 |
| ISSN | 0099-1333 |
| IngestDate | Wed Aug 13 06:13:16 EDT 2025 Thu Apr 24 22:51:14 EDT 2025 Tue Jul 01 01:31:45 EDT 2025 Fri Feb 23 02:32:58 EST 2024 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 6 |
| Keywords | Stakeholders Digital libraries Academic libraries Evaluation criteria Evaluation dimensions |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c334t-df23007d93b3559089aeeeff43151235c90e0e8c542e52fb6566df8d82ec556c3 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 |
| ORCID | 0000-0003-2713-866X |
| PQID | 2157841808 |
| PQPubID | 47870 |
| PageCount | 10 |
| ParticipantIDs | proquest_journals_2157841808 crossref_citationtrail_10_1016_j_acalib_2018_09_002 crossref_primary_10_1016_j_acalib_2018_09_002 elsevier_sciencedirect_doi_10_1016_j_acalib_2018_09_002 |
| ProviderPackageCode | CITATION AAYXX |
| PublicationCentury | 2000 |
| PublicationDate | November 2018 2018-11-00 20181101 |
| PublicationDateYYYYMMDD | 2018-11-01 |
| PublicationDate_xml | – month: 11 year: 2018 text: November 2018 |
| PublicationDecade | 2010 |
| PublicationPlace | Ann Arbor |
| PublicationPlace_xml | – name: Ann Arbor |
| PublicationTitle | The Journal of academic librarianship |
| PublicationYear | 2018 |
| Publisher | Elsevier Inc Elsevier Science Ltd |
| Publisher_xml | – name: Elsevier Inc – name: Elsevier Science Ltd |
| References | Xie (bb0270) 2006; 28 Xu, Recker (bb0300) 2012; 15 Chowdhury (bb0065) 2014; 14 Field (bb0085) 2013 Joo, Lee (bb0115) 2011; 29 Greenstein (bb0100) 2000; 49 Joo, Xie (bb0120) 2013 Fuhr, Tsakonas, Aalberg, Agosti, Hansen, Kapidakis, Sølvberg (bb0090) 2007; 8 Xie, Babu, Joo, Fuller (bb0285) 2015; 20 Miller (bb0185) 2017; 33 Noonan (bb0225) 2014; 49 Gkoumas, Lazarinis (bb0095) 2015; 49 Kelly (bb0130) 2014; 8 Zavalina (bb0305) 2014; 52 Beaudoin (bb0015) 2012; 18(11) Carr (bb0055) 2006; 46 Chowdhury (bb0060) 2010; 66 Kyrillidou, Giersch (bb0150) 2005 Mune, Agee (bb0195) 2016; 28 Lesk (bb0165) 2005 Dobreva, Chowdhury (bb0070) 2010 Nielsen (bb0205) 1995 Lai, Chiu, Huang, Chen, Huang (bb0155) 2014; 32 Ferati, Beyene (bb0080) 2017 Matusiak, Taylor, Newton, Polepeddi (bb0180) 2017; 33 Scrivin (bb0260) 1991 Bui, Park (bb0045) 2006 Nicholson (bb0200) 2004; 60 Ross (bb0250) 2012; 17 Petras, Stiller (bb0230) 2017 Matusiak (bb0175) 2017; 12 Dressler (bb0075) 2017; 33 Inal (bb0105) 2018; 70 Borgman (bb0040) 1999; 35 Rinehart, Prud'homme, Huot (bb0245) 2014; 30 Jeng (bb0110) 2005; 55 Behnert, Lewandowski (bb0025) 2017; 73 Candela, Castelli, Pagano, Thanos, Ioannidis, Koutrika, Schuldt (bb0050) 2007; 13(3/4) Xie, Matusiak (bb0290) 2016 Noh (bb0220) 2010; 36 Recker, Walker, Giersch, Mao, Halioris, Palmer, Robertshaw (bb0235) 2007; 13 Weiss (bb1000) 2014 Saracevic (bb0255) 2004 Beaudoin (bb0020) 2012; 18(11/12) Xie (bb0275) 2008; 44 Albertson (bb0005) 2015; 116 Zhang (bb0310) 2010; 61 Miller (bb0190) 2011 Recker (bb2000) 2006; 12 Kani-Zabihi, Ghinea, Chen (bb0125) 2006; 30 Beaudoin (10.1016/j.acalib.2018.09.002_bb0020) 2012; 18(11/12) Noonan (10.1016/j.acalib.2018.09.002_bb0225) 2014; 49 Petras (10.1016/j.acalib.2018.09.002_bb0230) 2017 Zavalina (10.1016/j.acalib.2018.09.002_bb0305) 2014; 52 Saracevic (10.1016/j.acalib.2018.09.002_bb0255) 2004 Albertson (10.1016/j.acalib.2018.09.002_bb0005) 2015; 116 Miller (10.1016/j.acalib.2018.09.002_bb0190) 2011 Borgman (10.1016/j.acalib.2018.09.002_bb0040) 1999; 35 Jeng (10.1016/j.acalib.2018.09.002_bb0110) 2005; 55 Candela (10.1016/j.acalib.2018.09.002_bb0050) 2007; 13(3/4) Noh (10.1016/j.acalib.2018.09.002_bb0220) 2010; 36 Zhang (10.1016/j.acalib.2018.09.002_bb0310) 2010; 61 Bui (10.1016/j.acalib.2018.09.002_bb0045) 2006 Matusiak (10.1016/j.acalib.2018.09.002_bb0180) 2017; 33 Nielsen (10.1016/j.acalib.2018.09.002_bb0205) Gkoumas (10.1016/j.acalib.2018.09.002_bb0095) 2015; 49 Recker (10.1016/j.acalib.2018.09.002_bb2000) 2006; 12 Kani-Zabihi (10.1016/j.acalib.2018.09.002_bb0125) 2006; 30 Lai (10.1016/j.acalib.2018.09.002_bb0155) 2014; 32 Chowdhury (10.1016/j.acalib.2018.09.002_bb0060) 2010; 66 Beaudoin (10.1016/j.acalib.2018.09.002_bb0015) 2012; 18(11) Behnert (10.1016/j.acalib.2018.09.002_bb0025) 2017; 73 Miller (10.1016/j.acalib.2018.09.002_bb0185) 2017; 33 Recker (10.1016/j.acalib.2018.09.002_bb0235) 2007; 13 Carr (10.1016/j.acalib.2018.09.002_bb0055) 2006; 46 Joo (10.1016/j.acalib.2018.09.002_bb0115) 2011; 29 Dressler (10.1016/j.acalib.2018.09.002_bb0075) 2017; 33 Matusiak (10.1016/j.acalib.2018.09.002_bb0175) 2017; 12 Xie (10.1016/j.acalib.2018.09.002_bb0290) 2016 Greenstein (10.1016/j.acalib.2018.09.002_bb0100) 2000; 49 Fuhr (10.1016/j.acalib.2018.09.002_bb0090) 2007; 8 Nicholson (10.1016/j.acalib.2018.09.002_bb0200) 2004; 60 Weiss (10.1016/j.acalib.2018.09.002_bb1000) 2014 Dobreva (10.1016/j.acalib.2018.09.002_bb0070) 2010 Ferati (10.1016/j.acalib.2018.09.002_bb0080) 2017 Joo (10.1016/j.acalib.2018.09.002_bb0120) 2013 Inal (10.1016/j.acalib.2018.09.002_bb0105) 2018; 70 Xie (10.1016/j.acalib.2018.09.002_bb0285) 2015; 20 Field (10.1016/j.acalib.2018.09.002_bb0085) 2013 Xie (10.1016/j.acalib.2018.09.002_bb0275) 2008; 44 Scrivin (10.1016/j.acalib.2018.09.002_bb0260) 1991 Xu (10.1016/j.acalib.2018.09.002_bb0300) 2012; 15 Chowdhury (10.1016/j.acalib.2018.09.002_bb0065) 2014; 14 Ross (10.1016/j.acalib.2018.09.002_bb0250) 2012; 17 Rinehart (10.1016/j.acalib.2018.09.002_bb0245) 2014; 30 Mune (10.1016/j.acalib.2018.09.002_bb0195) 2016; 28 Lesk (10.1016/j.acalib.2018.09.002_bb0165) 2005 Kelly (10.1016/j.acalib.2018.09.002_bb0130) 2014; 8 Kyrillidou (10.1016/j.acalib.2018.09.002_bb0150) 2005 Xie (10.1016/j.acalib.2018.09.002_bb0270) 2006; 28 |
| References_xml | – volume: 12 start-page: 1 year: 2017 end-page: 15 ident: bb0175 article-title: User navigation in large-scale distributed digital libraries: The case of the digital public library of America publication-title: Journal of Web Librarianship – volume: 13(3/4) year: 2007 ident: bb0050 article-title: Setting the foundations of digital libraries: The DELOS manifesto – year: 2004 ident: bb0255 article-title: Evaluation of digital libraries: An overview publication-title: Notes of the DELOS WP7 workshop on the evaluation of digital libraries, Padua, Italy – year: 2014 ident: bb1000 article-title: Using massive digital libraries: a LITA guide – volume: 30 start-page: 396 year: 2006 end-page: 412 ident: bb0125 article-title: Digital libraries: What do users want? publication-title: Online Information Review – volume: 30 start-page: 28 year: 2014 end-page: 42 ident: bb0245 article-title: Overwhelmed to action: Digital preservation challenges at the under-resourced institution publication-title: OCLC Systems & Services – volume: 44 start-page: 1346 year: 2008 end-page: 1373 ident: bb0275 article-title: Users' evaluation of digital libraries: Their uses, their criteria, and their assessment publication-title: Information Processing & Management – volume: 18(11/12) start-page: 3 year: 2012 ident: bb0020 article-title: A framework for contextual metadata used in the digital preservation of cultural objects – volume: 55 start-page: 96 year: 2005 end-page: 121 ident: bb0110 article-title: Usability assessment of academic digital libraries: Effectiveness, efficiency, satisfaction, and learnability publication-title: Libri – year: 1991 ident: bb0260 article-title: Evaluation thesaurus – volume: 33 start-page: 88 year: 2017 end-page: 99 ident: bb0180 article-title: Finding access and digital preservation solutions for a digitized oral history project: A case study publication-title: Digital Library Perspectives – year: 2005 ident: bb0165 article-title: Understanding Digital Libraries – volume: 17 start-page: 43 year: 2012 end-page: 68 ident: bb0250 article-title: Digital preservation, archival science and methodological foundations for digital libraries publication-title: New Review of Information Networking – volume: 33 start-page: 63 year: 2017 end-page: 76 ident: bb0185 article-title: A case study in institutional repository content curation publication-title: Digital Library Perspectives – start-page: 126 year: 2013 end-page: 140 ident: bb0120 article-title: Evaluation constructs and criteria for digital libraries: A document analysis publication-title: Recent developments in the design, construction and evaluation of digital libraries – volume: 60 start-page: 164 year: 2004 end-page: 182 ident: bb0200 article-title: A conceptual framework for the holistic measurement and cumulative evaluation of library services publication-title: Journal of Documentation – start-page: 233 year: 2017 end-page: 245 ident: bb0230 publication-title: A decade of evaluating Europeana-constructs, contexts, methods & criteria – volume: 18(11) start-page: 1 year: 2012 ident: bb0015 article-title: Context and its role in the digital preservation of cultural objects – volume: 49 start-page: 290 year: 2000 end-page: 303 ident: bb0100 article-title: Digital libraries and their challenges publication-title: Library Trends – volume: 33 start-page: 137 year: 2017 end-page: 155 ident: bb0075 article-title: The state of affairs with digital preservation at ARL member libraries publication-title: Digital Library Perspectives – volume: 8 start-page: 21 year: 2007 end-page: 38 ident: bb0090 article-title: Evaluation of digital libraries publication-title: International Journal on Digital Libraries – year: 2013 ident: bb0085 article-title: Discovering statistics using IBM SPSS statistics – volume: 13 start-page: 117 year: 2007 end-page: 134 ident: bb0235 article-title: A study of teachers' use of online learning resources to design classroom activities publication-title: New Review of Hypermedia and Multimedia – volume: 15 start-page: 103 year: 2012 ident: bb0300 article-title: Teaching analytics: A clustering and triangulation study of digital library user data publication-title: Journal of Educational Technology & Society – volume: 8 start-page: 384 year: 2014 end-page: 403 ident: bb0130 article-title: Assessment of digitized library and archives materials: A literature review publication-title: Journal of Web Librarianship – volume: 73 start-page: 509 year: 2017 end-page: 527 ident: bb0025 article-title: A framework for designing retrieval effectiveness studies of library information systems using human relevance assessments publication-title: Journal of Documentation – volume: 49 year: 2014 ident: bb0225 article-title: Digital preservation policy framework: A case study publication-title: Educause Review – year: 2006 ident: bb0045 article-title: An assessment of metadata quality: A case study of the national science digital library metadata repository publication-title: CAIS/ACSI 2006 information science revisited: Approaches to innovation – volume: 35 start-page: 227 year: 1999 end-page: 243 ident: bb0040 article-title: What are digital libraries? Competing visions publication-title: Information Processing and Management – year: 2011 ident: bb0190 article-title: Metadata for digital collections: A how-to-do-it manual – year: 2016 ident: bb0290 article-title: Discover digital libraries: Theory and practice – volume: 29 start-page: 523 year: 2011 end-page: 537 ident: bb0115 article-title: Measuring the usability of academic digital libraries: Instrument development and validation publication-title: The Electronic Library – volume: 28 start-page: 433 year: 2006 end-page: 452 ident: bb0270 article-title: Evaluation of digital libraries: Criteria and problems from users' perspectives publication-title: Library & Information Science Research – volume: 70 start-page: 66 year: 2018 end-page: 77 ident: bb0105 article-title: University students' heuristic usability inspection of the National Library of Turkey website publication-title: Aslib Journal of Information Management – volume: 12 year: 2006 ident: bb2000 article-title: Perspectives on Teachers as Digital Library Users publication-title: D-Lib Magazine – year: 1995 ident: bb0205 article-title: 10 usability heuristics for user interface design – volume: 116 start-page: 122 year: 2015 end-page: 135 ident: bb0005 article-title: Synthesizing visual digital library research to formulate a user-centered evaluation framework publication-title: New Library World – volume: 14 start-page: 181 year: 2014 end-page: 195 ident: bb0065 article-title: Sustainability of digital libraries: A conceptual model and a research framework publication-title: International Journal on Digital Libraries – volume: 32 start-page: 83 year: 2014 end-page: 95 ident: bb0155 article-title: An evaluation model for digital libraries' user interfaces using fuzzy AHP publication-title: The Electronic Library – volume: 36 start-page: 41 year: 2010 end-page: 52 ident: bb0220 article-title: A study on developing evaluation criteria for electronic resources in evaluation indicators of libraries publication-title: Journal of Academic Librarianship – volume: 61 start-page: 88 year: 2010 end-page: 110 ident: bb0310 article-title: Developing a holistic model for digital library evaluation publication-title: Journal of the American Society for Information Science and Technology – volume: 66 start-page: 207 year: 2010 end-page: 223 ident: bb0060 article-title: From digital libraries to preservation research: The importance of users and context publication-title: Journal of Documentation – volume: 28 start-page: 172 year: 2016 end-page: 182 ident: bb0195 article-title: Are e-books for everyone? An evaluation of academic e-book platforms' accessibility features publication-title: Journal of Electronic Resources Librarianship – volume: 20 year: 2015 ident: bb0285 article-title: Using digital libraries non-visually: Understanding the help-seeking situations of blind users publication-title: Information Research: An International Electronic Journal – start-page: 148 year: 2010 end-page: 157 ident: bb0070 article-title: A user-centric evaluation of the Europeana digital library publication-title: The role of digital libraries in a time of global change – start-page: 172 year: 2005 end-page: 173 ident: bb0150 article-title: Developing the DigiQUAL protocol for digital library evaluation publication-title: Proceedings of the fifth ACM/IEEE-CS joint conference on digital libraries – volume: 49 start-page: 226 year: 2015 end-page: 241 ident: bb0095 article-title: Evaluation and usage scenarios of open source digital library and collection management tools publication-title: Program – start-page: 171 year: 2017 end-page: 181 ident: bb0080 article-title: Developing heuristics for evaluating the accessibility of digital library interfaces publication-title: Universal access in human–computer interaction. Design and development approaches and methods – volume: 52 start-page: 77 year: 2014 end-page: 89 ident: bb0305 article-title: Complementarity in subject metadata in large-scale digital libraries: A comparative analysis publication-title: Cataloging & Classification Quarterly – volume: 46 year: 2006 ident: bb0055 article-title: What users want: An academic ‘hybrid’ library perspective – volume: 13 start-page: 117 issue: 2 year: 2007 ident: 10.1016/j.acalib.2018.09.002_bb0235 article-title: A study of teachers' use of online learning resources to design classroom activities publication-title: New Review of Hypermedia and Multimedia doi: 10.1080/13614560701709846 – volume: 35 start-page: 227 issue: 3 year: 1999 ident: 10.1016/j.acalib.2018.09.002_bb0040 article-title: What are digital libraries? Competing visions publication-title: Information Processing and Management – start-page: 148 year: 2010 ident: 10.1016/j.acalib.2018.09.002_bb0070 article-title: A user-centric evaluation of the Europeana digital library – volume: 8 start-page: 21 year: 2007 ident: 10.1016/j.acalib.2018.09.002_bb0090 article-title: Evaluation of digital libraries publication-title: International Journal on Digital Libraries doi: 10.1007/s00799-007-0011-z – volume: 116 start-page: 122 issue: 3/4 year: 2015 ident: 10.1016/j.acalib.2018.09.002_bb0005 article-title: Synthesizing visual digital library research to formulate a user-centered evaluation framework publication-title: New Library World doi: 10.1108/NLW-07-2014-0087 – volume: 18(11) start-page: 1 year: 2012 ident: 10.1016/j.acalib.2018.09.002_bb0015 – year: 2005 ident: 10.1016/j.acalib.2018.09.002_bb0165 – year: 2014 ident: 10.1016/j.acalib.2018.09.002_bb1000 – volume: 20 issue: 2 year: 2015 ident: 10.1016/j.acalib.2018.09.002_bb0285 article-title: Using digital libraries non-visually: Understanding the help-seeking situations of blind users publication-title: Information Research: An International Electronic Journal – year: 2013 ident: 10.1016/j.acalib.2018.09.002_bb0085 – volume: 60 start-page: 164 issue: 2 year: 2004 ident: 10.1016/j.acalib.2018.09.002_bb0200 article-title: A conceptual framework for the holistic measurement and cumulative evaluation of library services publication-title: Journal of Documentation doi: 10.1108/00220410410522043 – volume: 46 year: 2006 ident: 10.1016/j.acalib.2018.09.002_bb0055 – year: 2011 ident: 10.1016/j.acalib.2018.09.002_bb0190 – ident: 10.1016/j.acalib.2018.09.002_bb0205 – volume: 13(3/4) year: 2007 ident: 10.1016/j.acalib.2018.09.002_bb0050 – year: 2004 ident: 10.1016/j.acalib.2018.09.002_bb0255 article-title: Evaluation of digital libraries: An overview – volume: 55 start-page: 96 year: 2005 ident: 10.1016/j.acalib.2018.09.002_bb0110 article-title: Usability assessment of academic digital libraries: Effectiveness, efficiency, satisfaction, and learnability publication-title: Libri doi: 10.1515/LIBR.2005.96 – volume: 14 start-page: 181 issue: 3–4 year: 2014 ident: 10.1016/j.acalib.2018.09.002_bb0065 article-title: Sustainability of digital libraries: A conceptual model and a research framework publication-title: International Journal on Digital Libraries doi: 10.1007/s00799-014-0116-0 – volume: 17 start-page: 43 issue: 1 year: 2012 ident: 10.1016/j.acalib.2018.09.002_bb0250 article-title: Digital preservation, archival science and methodological foundations for digital libraries publication-title: New Review of Information Networking doi: 10.1080/13614576.2012.679446 – volume: 28 start-page: 172 issue: 3 year: 2016 ident: 10.1016/j.acalib.2018.09.002_bb0195 article-title: Are e-books for everyone? An evaluation of academic e-book platforms' accessibility features publication-title: Journal of Electronic Resources Librarianship doi: 10.1080/1941126X.2016.1200927 – year: 2006 ident: 10.1016/j.acalib.2018.09.002_bb0045 article-title: An assessment of metadata quality: A case study of the national science digital library metadata repository – volume: 73 start-page: 509 issue: 3 year: 2017 ident: 10.1016/j.acalib.2018.09.002_bb0025 article-title: A framework for designing retrieval effectiveness studies of library information systems using human relevance assessments publication-title: Journal of Documentation doi: 10.1108/JD-08-2016-0099 – volume: 49 start-page: 226 issue: 3 year: 2015 ident: 10.1016/j.acalib.2018.09.002_bb0095 article-title: Evaluation and usage scenarios of open source digital library and collection management tools publication-title: Program doi: 10.1108/PROG-09-2014-0070 – volume: 8 start-page: 384 issue: 4 year: 2014 ident: 10.1016/j.acalib.2018.09.002_bb0130 article-title: Assessment of digitized library and archives materials: A literature review publication-title: Journal of Web Librarianship doi: 10.1080/19322909.2014.954740 – volume: 32 start-page: 83 issue: 1 year: 2014 ident: 10.1016/j.acalib.2018.09.002_bb0155 article-title: An evaluation model for digital libraries' user interfaces using fuzzy AHP publication-title: The Electronic Library doi: 10.1108/EL-05-2012-0046 – volume: 33 start-page: 63 issue: 1 year: 2017 ident: 10.1016/j.acalib.2018.09.002_bb0185 article-title: A case study in institutional repository content curation publication-title: Digital Library Perspectives doi: 10.1108/DLP-07-2016-0026 – start-page: 233 year: 2017 ident: 10.1016/j.acalib.2018.09.002_bb0230 – volume: 18(11/12) start-page: 3 year: 2012 ident: 10.1016/j.acalib.2018.09.002_bb0020 – year: 1991 ident: 10.1016/j.acalib.2018.09.002_bb0260 – volume: 70 start-page: 66 issue: 1 year: 2018 ident: 10.1016/j.acalib.2018.09.002_bb0105 article-title: University students' heuristic usability inspection of the National Library of Turkey website publication-title: Aslib Journal of Information Management doi: 10.1108/AJIM-09-2017-0216 – volume: 49 issue: 4 year: 2014 ident: 10.1016/j.acalib.2018.09.002_bb0225 article-title: Digital preservation policy framework: A case study publication-title: Educause Review – volume: 33 start-page: 137 issue: 2 year: 2017 ident: 10.1016/j.acalib.2018.09.002_bb0075 article-title: The state of affairs with digital preservation at ARL member libraries publication-title: Digital Library Perspectives doi: 10.1108/DLP-08-2016-0030 – volume: 29 start-page: 523 issue: 4 year: 2011 ident: 10.1016/j.acalib.2018.09.002_bb0115 article-title: Measuring the usability of academic digital libraries: Instrument development and validation publication-title: The Electronic Library doi: 10.1108/02640471111156777 – start-page: 171 year: 2017 ident: 10.1016/j.acalib.2018.09.002_bb0080 article-title: Developing heuristics for evaluating the accessibility of digital library interfaces – volume: 28 start-page: 433 issue: 3 year: 2006 ident: 10.1016/j.acalib.2018.09.002_bb0270 article-title: Evaluation of digital libraries: Criteria and problems from users' perspectives publication-title: Library & Information Science Research doi: 10.1016/j.lisr.2006.06.002 – volume: 44 start-page: 1346 issue: 3 year: 2008 ident: 10.1016/j.acalib.2018.09.002_bb0275 article-title: Users' evaluation of digital libraries: Their uses, their criteria, and their assessment publication-title: Information Processing & Management doi: 10.1016/j.ipm.2007.10.003 – volume: 12 issue: 9 year: 2006 ident: 10.1016/j.acalib.2018.09.002_bb2000 article-title: Perspectives on Teachers as Digital Library Users publication-title: D-Lib Magazine doi: 10.1045/september2006-recker – volume: 61 start-page: 88 issue: 1 year: 2010 ident: 10.1016/j.acalib.2018.09.002_bb0310 article-title: Developing a holistic model for digital library evaluation publication-title: Journal of the American Society for Information Science and Technology doi: 10.1002/asi.21220 – volume: 33 start-page: 88 issue: 2 year: 2017 ident: 10.1016/j.acalib.2018.09.002_bb0180 article-title: Finding access and digital preservation solutions for a digitized oral history project: A case study publication-title: Digital Library Perspectives doi: 10.1108/DLP-07-2016-0025 – volume: 52 start-page: 77 issue: 1 year: 2014 ident: 10.1016/j.acalib.2018.09.002_bb0305 article-title: Complementarity in subject metadata in large-scale digital libraries: A comparative analysis publication-title: Cataloging & Classification Quarterly doi: 10.1080/01639374.2013.848316 – volume: 36 start-page: 41 issue: 1 year: 2010 ident: 10.1016/j.acalib.2018.09.002_bb0220 article-title: A study on developing evaluation criteria for electronic resources in evaluation indicators of libraries publication-title: Journal of Academic Librarianship doi: 10.1016/j.acalib.2009.11.005 – start-page: 126 year: 2013 ident: 10.1016/j.acalib.2018.09.002_bb0120 article-title: Evaluation constructs and criteria for digital libraries: A document analysis – start-page: 172 year: 2005 ident: 10.1016/j.acalib.2018.09.002_bb0150 article-title: Developing the DigiQUAL protocol for digital library evaluation – volume: 12 start-page: 1 issue: 3 year: 2017 ident: 10.1016/j.acalib.2018.09.002_bb0175 article-title: User navigation in large-scale distributed digital libraries: The case of the digital public library of America publication-title: Journal of Web Librarianship – year: 2016 ident: 10.1016/j.acalib.2018.09.002_bb0290 – volume: 49 start-page: 290 issue: 2 year: 2000 ident: 10.1016/j.acalib.2018.09.002_bb0100 article-title: Digital libraries and their challenges publication-title: Library Trends – volume: 15 start-page: 103 issue: 3 year: 2012 ident: 10.1016/j.acalib.2018.09.002_bb0300 article-title: Teaching analytics: A clustering and triangulation study of digital library user data publication-title: Journal of Educational Technology & Society – volume: 30 start-page: 28 issue: 1 year: 2014 ident: 10.1016/j.acalib.2018.09.002_bb0245 article-title: Overwhelmed to action: Digital preservation challenges at the under-resourced institution publication-title: OCLC Systems & Services doi: 10.1108/OCLC-06-2013-0019 – volume: 30 start-page: 396 issue: 4 year: 2006 ident: 10.1016/j.acalib.2018.09.002_bb0125 article-title: Digital libraries: What do users want? publication-title: Online Information Review doi: 10.1108/14684520610686292 – volume: 66 start-page: 207 issue: 2 year: 2010 ident: 10.1016/j.acalib.2018.09.002_bb0060 article-title: From digital libraries to preservation research: The importance of users and context publication-title: Journal of Documentation doi: 10.1108/00220411011023625 |
| SSID | ssj0000125 |
| Score | 2.2591553 |
| Snippet | Digital library (DL) evaluation is essential to the success and enhancement of DLs. However, there is a lack of research on the assessment of comprehensive... |
| SourceID | proquest crossref elsevier |
| SourceType | Aggregation Database Enrichment Source Index Database Publisher |
| StartPage | 854 |
| SubjectTerms | Academic libraries Digital libraries Educational Environment Electronic Libraries Evaluation criteria Evaluation dimensions Librarians Stakeholders |
| Title | Multifaceted Evaluation Criteria of Digital Libraries in Academic Settings: Similarities and Differences From Different Stakeholders |
| URI | https://dx.doi.org/10.1016/j.acalib.2018.09.002 https://www.proquest.com/docview/2157841808 |
| Volume | 44 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1LS8QwEA6iFy_iE18rcxBv1W6TbFpvi7qsz4sK3kKbh9RHV9z16skfbiZNFhVB8NjQhDIzmXzpzDdDyK5SXWGFqJJMsyJheaWTokptYm1FqbBdy30ppcur3vCWnd3xuxlyFLkwmFYZfH_r0723DiMHQZoHL3WNHF-HbShFo8TYGJL4GBNo5fvv3S8lpDIeK1Hi25E-53O8SieHusIEr9xXOw0_V345nn44an_6DBbJQoCN0G-_bInMmGaZdALpAPYgsIpQyhC26wr58OxaWyoHjDWcTOt6A_Y3QMuDkYXj-h77hsBFvDdD3UDMmodr4_Oix4dwXT_X7hbsC7BC2Wg30Qau4BgGr6Pn6cAEHIJ9NBjXcthyldwOTm6OhknoupAoStkk0dbdSlKhC1o5LIJhwdIYY61DGhyJtapITWpyxVlmeGYrBITa5jrPjOK8p-gamW1GjVknkCnD09KtI6xmQvcKZZgSucKkwUyLcoPQKGypQkly7IzxJGPu2YNsVSRRRTItpFPRBkmms17akhx_vC-iHuU305Lu1Phj5nZUuwxbeywdRsJYbZ7mm_9eeIvM41PLadwms5PXN9Nx4GZS7Xjr3SFz_dPz4dUne6T7Ww |
| linkProvider | Elsevier |
| linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1LT-MwEB6x7WH3smJfWqAsc0B7iwhxXCfcEFC128cFkLhZiR-rAE1R2_0H_HA8iV3BCgmJqxNbkccef87M9w3AoVLHwgpRRolO8yjNSh3lZWwja0vGhD22vJFSms76w-v0zw2_2YKzwIWhtErv-1uf3nhr33LkZ_PooaqI4-uwDWO0KCk2ln-ALqlT8Q50T0fj4eyZilTCgxgldQgMuibNq3BTUZWU45U1gqf-_8orJ9R_vro5gAbb8NkjRzxtP-4LbJn6K-x73gH-Rk8soolGv2O_wWNDsLWFcthY48VG2hupxAEtPlxYPK_-UukQnISrM1Y1hsR5vDRNavTqBC-reeUuwo0GKxa1dh2tpwuucLBczDcNa3Qg9s5QaMvBy-9wPbi4OhtGvvBCpBhL15G27mISC52z0sERigwWxhhrHdjgxK1VeWxikymeJoYntiRMqG2ms8QozvuK_YBOvajNT8BEGR4XbhxhdSp0P1cmVSJTlDeYaFHsAAuTLZVXJafiGPcypJ_dytZEkkwk41w6E-1AtOn10KpyvPG-CHaUL1aXdAfHGz17wezS7-6VdDCJwrVZnO2-e-AD-Di8mk7kZDQb78EnetJSHHvQWS__mX2HddblL7-WnwAR6f4M |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Multifaceted+Evaluation+Criteria+of+Digital+Libraries+in+Academic+Settings%3A+Similarities+and+Differences+From+Different+Stakeholders&rft.jtitle=The+Journal+of+academic+librarianship&rft.au=Xie%2C+Iris&rft.au=Joo%2C+Soohyung&rft.au=Matusiak%2C+Krystyna+K.&rft.date=2018-11-01&rft.pub=Elsevier+Inc&rft.issn=0099-1333&rft.eissn=1879-1999&rft.volume=44&rft.issue=6&rft.spage=854&rft.epage=863&rft_id=info:doi/10.1016%2Fj.acalib.2018.09.002&rft.externalDocID=S0099133318301459 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0099-1333&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0099-1333&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0099-1333&client=summon |