Controlled user evaluations of information visualization interfaces for text retrieval: Literature review and meta-analysis
This review describes experimental designs (users, search tasks, measures, etc.) used by 31 controlled user studies of information visualization (IV) tools for textual information retrieval (IR) and a meta‐analysis of the reported statistical effects. Comparable experimental designs allow research d...
Saved in:
| Published in | Journal of the American Society for Information Science and Technology Vol. 59; no. 6; pp. 1012 - 1024 |
|---|---|
| Main Authors | , , |
| Format | Journal Article |
| Language | English |
| Published |
Hoboken
Wiley Subscription Services, Inc., A Wiley Company
01.04.2008
Wiley Wiley Periodicals Inc |
| Subjects | |
| Online Access | Get full text |
| ISSN | 1532-2882 2330-1635 1532-2890 2330-1643 |
| DOI | 10.1002/asi.20786 |
Cover
Loading…
| Abstract | This review describes experimental designs (users, search tasks, measures, etc.) used by 31 controlled user studies of information visualization (IV) tools for textual information retrieval (IR) and a meta‐analysis of the reported statistical effects. Comparable experimental designs allow research designers to compare their results with other reports, and support the development of experimentally verified design guidelines concerning which IV techniques are better suited to which types of IR tasks. The studies generally use a within‐subject design with 15 or more undergraduate students performing browsing to known‐item tasks on sets of at least 1,000 full‐text articles or Web pages on topics of general interest/news. Results of the meta‐analysis (N = 8) showed no significant effects of the IV tool as compared with a text‐only equivalent, but the set shows great variability suggesting an inadequate basis of comparison. Experimental design recommendations are provided which would support comparison of existing IV tools for IR usability testing. |
|---|---|
| AbstractList | This review describes experimental designs (users, search tasks, measures, etc.) used by 31 controlled user studies of information visualization (IV) tools for textual information retrieval (IR) and a meta-analysis of the reported statistical effects. Comparable experimental designs allow research designers to compare their results with other reports, and support the development of experimentally verified design guidelines concerning which IV techniques are better suited to which types of IR tasks. The studies generally use a within-subject design with 15 or more undergraduate students performing browsing to known-item tasks on sets of at least 1,000 full-text articles or Web pages on topics of general interest/news. Results of the meta-analysis (N = 8) showed no significant effects of the IV tool as compared with a text-only equivalent, but the set shows great variability suggesting an inadequate basis of comparison. Experimental design recommendations are provided which would support comparison of existing IV tools for IR usability testing. This review describes experimental designs (users, search tasks, measures, etc.) used by 31 controlled user studies of information visualization (IV) tools for textual information retrieval (IR) and a meta-analysis of the reported statistical effects. Comparable experimental designs allow research designers to compare their results with other reports, and support the development of experimentally verified design guidelines concerning which IV techniques are better suited to which types of IR tasks. The studies generally use a within-subject design with 15 or more undergraduate students performing browsing to known-item tasks on sets of at least 1,000 full-text articles or Web pages on topics of general interest/news. Results of the meta-analysis (N = 8) showed no significant effects of the IV tool as compared with a text-only equivalent, but the set shows great variability suggesting an inadequate basis of comparison. Experimental design recommendations are provided which would support comparison of existing IV tools for IR usability testing. [Copyright 2008 Wiley Periodicals Inc.] This review describes experimental designs (users, search tasks, measures, etc.) used by 31 controlled user studies of information visualization (IV) tools for textual information retrieval (IR) and a meta-analysis of the reported statistical effects. Comparable experimental designs allow research designers to compare their results with other reports, and support the development of experimentally verified design guidelines concerning which IV techniques are better suited to which types of IR tasks. The studies generally use a within-subject design with 15 or more undergraduate students performing browsing to known-item tasks on sets of at least 1,000 full-text articles or Web pages on topics of general interest/news. Results of the meta-analysis (N = 8) showed no significant effects of the IV tool as compared with a text-only equivalent, but the set shows great variability suggesting an inadequate basis of comparison. Experimental design recommendations are provided which would support comparison of existing IV tools for IR usability testing. [PUBLICATION ABSTRACT] This review describes experimental designs (users, search tasks, measures, etc.) used by 31 controlled user studies of information visualization (IV) tools for textual information retrieval (IR) and a meta‐analysis of the reported statistical effects. Comparable experimental designs allow research designers to compare their results with other reports, and support the development of experimentally verified design guidelines concerning which IV techniques are better suited to which types of IR tasks. The studies generally use a within‐subject design with 15 or more undergraduate students performing browsing to known‐item tasks on sets of at least 1,000 full‐text articles or Web pages on topics of general interest/news. Results of the meta‐analysis ( N = 8) showed no significant effects of the IV tool as compared with a text‐only equivalent, but the set shows great variability suggesting an inadequate basis of comparison. Experimental design recommendations are provided which would support comparison of existing IV tools for IR usability testing. |
| Author | Leide, John E. Julien, Charles-Antoine Bouthillier, France |
| Author_xml | – sequence: 1 givenname: Charles-Antoine surname: Julien fullname: Julien, Charles-Antoine email: charles.julien@mcgill.ca organization: School of Information Studies, McGill University, 3459 McTavish Street, Montreal, Quebec, Canada H3A 1Y1 – sequence: 2 givenname: John E. surname: Leide fullname: Leide, John E. email: john.leide@mcgill.ca organization: School of Information Studies, McGill University, 3459 McTavish Street, Montreal, Quebec, Canada H3A 1Y1 – sequence: 3 givenname: France surname: Bouthillier fullname: Bouthillier, France email: france.bouthillier@mcgill.ca organization: School of Information Studies, McGill University, 3459 McTavish Street, Montreal, Quebec, Canada H3A 1Y1 |
| BackLink | http://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&idt=20243199$$DView record in Pascal Francis |
| BookMark | eNqFkU1rFTEUhgepYFtd-A-CoOBi2nxMkhl35aJt4VIXrbgM52bOQGpuUpPMba_-eed-tIuiuEpO8jwvJO9RdRBiwKp6y-gJo5SfQnYnnOpWvagOmRS85m1HD572LX9VHeV8SyljktHD6vcshpKi99iTMWMiuAI_QnExZBIH4sIQ03I7k5XLI3j3aze5UDANYDGTCSEFHwpJWJLbJHwiczddQxkTTqcrh_cEQk-WWKCGAH6dXX5dvRzAZ3yzX4-rb18-38wu6vnX88vZ2by2DVeqZrqXuuv6linJJWpmBbV9Z-Wip4pyGHoQ2jK7aGU74EIsmkZo3ivZD4php8Rx9WGXe5fizxFzMUuXLXoPAeOYjdSaCia7_4KCCyGp2oDvnoG3cUzTs7LhgjWq4V07Qe_3EGQLfkgQrMvmLrklpLXhlDeCdZuw0x1nU8w54WCsK9s_LgmcN4yaTbVmqtZsq52Mj8-Mx9C_sfv0e-dx_W_QnF1fPhr1znB5KvXJgPTDKC20NN-vzk3DdKOueWduxB9mY8XJ |
| CitedBy_id | crossref_primary_10_1002_asi_23479 crossref_primary_10_1016_j_lisr_2015_05_004 crossref_primary_10_1002_meet_2009_1450460269 crossref_primary_10_1108_14684521011099379 crossref_primary_10_1108_JSIT_01_2014_0003 crossref_primary_10_1108_JD_10_2012_0138 crossref_primary_10_1002_wics_89 crossref_primary_10_1002_asi_23959 crossref_primary_10_1002_asi_23659 crossref_primary_10_55741_knj_52_2_3_14225 crossref_primary_10_1002_asi_24070 |
| Cites_doi | 10.1023/A:1012968507789 10.1145/313238.313283 10.1006/ijhc.2000.0422 10.1006/ijhc.2000.0413 10.1016/j.ijhcs.2005.02.001 10.1007/1-4020-2967-5_10 10.1002/(SICI)1097-4571(19980515)49:7<582::AID-ASI2>3.0.CO;2-X 10.1117/12.424929 10.1080/07421222.2005.11045821 10.1109/IV.2004.1320234 10.1109/INFVIS.2001.963289 10.1002/asi.10197 10.1109/WPC.2005.34 10.1037/0033-295X.106.3.529 10.1145/1015530.1015552 10.1109/INFVIS.2004.70 10.1007/s10796-005-2770-7 10.1109/ITCC.2002.1000356 10.1109/ENABL.2001.953395 10.1016/B978-155860915-0/50035-4 10.4135/9781412984997 10.1145/1109540.1109551 10.1109/TPC.2006.875073 10.1145/258525.258580 10.1007/s10664-005-1290-x 10.1057/palgrave.ivs.9500017 10.1145/1121949.1121979 10.1002/(SICI)1097-4571(199701)48:1<40::AID-ASI6>3.0.CO;2-1 10.1109/IV.2000.859758 10.1016/B978-155860915-0/50046-9 10.1002/asi.20175 10.1145/985600.966013 10.1109/MC.1986.1663098 10.1109/INFVIS.2001.963290 10.1145/288392.288596 10.1006/ijhc.2000.0417 10.1006/ijhc.2000.0416 10.1007/978-1-4471-3056-7_8 |
| ContentType | Journal Article |
| Copyright | 2008 ASIS&T 2009 INIST-CNRS Copyright Wiley Periodicals Inc. Apr 2008 |
| Copyright_xml | – notice: 2008 ASIS&T – notice: 2009 INIST-CNRS – notice: Copyright Wiley Periodicals Inc. Apr 2008 |
| DBID | BSCLL AAYXX CITATION IQODW 7SC 8FD E3H F2A JQ2 L7M L~C L~D |
| DOI | 10.1002/asi.20786 |
| DatabaseName | Istex CrossRef Pascal-Francis Computer and Information Systems Abstracts Technology Research Database Library & Information Sciences Abstracts (LISA) Library & Information Science Abstracts (LISA) ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional |
| DatabaseTitle | CrossRef Technology Research Database Computer and Information Systems Abstracts – Academic Library and Information Science Abstracts (LISA) ProQuest Computer Science Collection Computer and Information Systems Abstracts Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Professional |
| DatabaseTitleList | Computer and Information Systems Abstracts Library and Information Science Abstracts (LISA) Technology Research Database CrossRef |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Engineering Library & Information Science |
| EISSN | 1532-2890 2330-1643 |
| EndPage | 1024 |
| ExternalDocumentID | 1454334911 20243199 10_1002_asi_20786 ASI20786 ark_67375_WNG_41746S29_T |
| Genre | miscellaneous |
| GroupedDBID | -~X .3N .4I .DC .GA .GJ .Y3 0-V 05W 07C 10A 186 1L6 1OC 1OL 29L 31~ 33P 3WU 4.4 4ZD 50Y 50Z 51W 51X 52M 52N 52O 52P 52S 52T 52W 52X 53G 5GY 66C 6PF 6TJ 702 77K 7PT 7WY 8-0 8-1 8-3 8-4 8-5 883 8FE 8FG 8FL 8FW 8G5 8R4 8R5 8UM 8VB 930 A03 AAEVG AAHHS AANLZ AAWTL AAXRX AAYOK AAZKR ABCQN ABCUV ABEML ABIJN ABJNI ABPPZ ABUWG ACAHQ ACBWZ ACCFJ ACCZN ACGFS ACPOU ACSCC ACXBN ACXQS ADEOM ADIZJ ADMGS ADOZA AEEZP AEIGN AEIMD AEQDE AEUQT AEUYR AFBPY AFFNX AFFPM AFGKR AFPWT AFZJQ AHBTC AI. AITYG AIURR AIWBW AJBDE AKVCP ALMA_UNASSIGNED_HOLDINGS ALSLI ALUQN AMBMR AMYDB ARALO ARAPS ASPBG ATUGU AVWKF AZBYB AZFZN AZQEC BAFTC BDRZF BENPR BEZIV BKOMP BROTX BRXPI BSCLL BY8 CJNVE CNYFK CS3 D-E D-F DCZOG DPXWK DR2 DRFUL DRSTM DU5 DWQXO EBO EBS EBU EJD ELW F00 F01 F04 F5P FEDTE FRNLG G-S G.N GNP GNUQQ GODZA GROUPED_ABI_INFORM_RESEARCH GUQSH H.T H.X HBH HCIFZ HF~ HGLYW HHY HVGLF HZ~ H~9 I-F IX1 JPC K1G K6V KQQ LATKE LAW LC2 LC3 LEEKS LH4 LITHE LOXES LP6 LP7 LUTES LW6 LYRES M0C M0F M0P M1O M2O MEWTI MK4 MK~ ML~ MRFUL MRSTM MSFUL MSSTM MVM MXFUL MXSTM N04 N05 NF~ OHT OIG P-O P2X P4D P62 Q.N Q11 Q2X QB0 QRW QWB R.K ROL RWI RX1 SUPJJ TH9 UB1 V2E VH1 W8V WH7 WIH WIK WJL WQJ WRC WXSBR XG1 XPP XV2 XZL ZL0 ~IA ~WT 1OB AAHQN AAMMB AAMNL AANHP AAYCA ACRPL ACYXJ ADNMO AEFGJ AFWVQ AGQPQ AGXDD AGYGG AHQJS AIDQK AIDYY AAYXX CITATION IQODW 7SC 8FD E3H F2A JQ2 L7M L~C L~D |
| ID | FETCH-LOGICAL-c4266-17d5799d816525e71c30cd9c5bd0602afda37c1cb858feb3b44372d65df61e963 |
| IEDL.DBID | DR2 |
| ISSN | 1532-2882 2330-1635 |
| IngestDate | Fri Jul 11 03:31:20 EDT 2025 Fri Jul 11 00:20:00 EDT 2025 Fri Jul 25 23:24:08 EDT 2025 Thu Apr 10 09:00:52 EDT 2025 Thu Apr 24 23:12:55 EDT 2025 Tue Jul 01 04:18:21 EDT 2025 Wed Aug 20 07:27:47 EDT 2025 Wed Oct 30 09:50:02 EDT 2024 |
| IsPeerReviewed | false |
| IsScholarly | false |
| Issue | 6 |
| Keywords | Information retrieval Full text Comparative study User study Information representation Result |
| Language | English |
| License | http://onlinelibrary.wiley.com/termsAndConditions#vor CC BY 4.0 |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c4266-17d5799d816525e71c30cd9c5bd0602afda37c1cb858feb3b44372d65df61e963 |
| Notes | ArticleID:ASI20786 istex:881D5BFC52CF288291B0B662F18BDC9BC6DA645A ark:/67375/WNG-41746S29-T ObjectType-Article-1 SourceType-Scholarly Journals-1 content type line 14 ObjectType-Literature Review-2 ObjectType-Article-2 ObjectType-Feature-1 content type line 23 ObjectType-Feature-2 |
| PQID | 231464298 |
| PQPubID | 26268 |
| PageCount | 13 |
| ParticipantIDs | proquest_miscellaneous_57703159 proquest_miscellaneous_32335069 proquest_journals_231464298 pascalfrancis_primary_20243199 crossref_citationtrail_10_1002_asi_20786 crossref_primary_10_1002_asi_20786 wiley_primary_10_1002_asi_20786_ASI20786 istex_primary_ark_67375_WNG_41746S29_T |
| ProviderPackageCode | CITATION AAYXX |
| PublicationCentury | 2000 |
| PublicationDate | April 2008 |
| PublicationDateYYYYMMDD | 2008-04-01 |
| PublicationDate_xml | – month: 04 year: 2008 text: April 2008 |
| PublicationDecade | 2000 |
| PublicationPlace | Hoboken |
| PublicationPlace_xml | – name: Hoboken – name: New York, NY |
| PublicationTitle | Journal of the American Society for Information Science and Technology |
| PublicationTitleAlternate | J. Am. Soc. Inf. Sci |
| PublicationYear | 2008 |
| Publisher | Wiley Subscription Services, Inc., A Wiley Company Wiley Wiley Periodicals Inc |
| Publisher_xml | – name: Wiley Subscription Services, Inc., A Wiley Company – name: Wiley – name: Wiley Periodicals Inc |
| References | Ashby, F.G., Isen, A.M., & Turken, A.U. (1999). A neuropsychological theory of positive effect and its influence on cognition. Psychological Review, 106, 529-550. Bederson, B.B., & Shneiderman, B. (2003). The craft of information visualization: Readings and reflections. Amsterdam: Kaufmann. Chen, C., & Czerwinski, M. (2000). Empirical studies of information visualization: A meta-analysis. Journal of Human-Computer Studies, 53(5), 851-866. Westerman, S.J., Collins, J., & Cribbin, T. (2005). Browsing a document collection represented in two- and three-dimensional virtual information space. Journal of Human-Computer Studies, 62(6), 713-736. Blythe, M.A., Overbeeke, K., Monk, A.F., & Wright, P.C. (2003). Funology: From usability to enjoyment. Dordrecht, The Netherlands: Kluwer. Carroll, J.M., & Mazur, S.A. (1986). "LisaLearning." IEEE Computer, 19(11), 35-49. Chen, C. (2004). Information visualization: Beyond the horizon (2nd ed.). London: Springer-Verlag. Shneiderman, B. (2004). Designing for fun: How can we design user interfaces to be more fun? Interactions, 11(5), 48-50. Marchionini, G. (2006). Exploratory search: From finding to understanding. Communications of the ACM, 49(4), 41-46. Chen, H., Houston, A.L., Sewell, R.R., & Schatz, B.R. (1998). Internet browsing and searching: User evaluations of category map and concept space techniques. Journal of the American Society of Information Science, 49(7), 582-603. Norman, D.A. (2004). Emotional design: Why we love (or hate) everyday things. New York: Basic Books. Modjeska, D., & Chignell, M. (2003). Individual differences in exploration using desktop VR. Journal of the American Society for Information Science and Technology, 54(3), 216-228. Koshman, S. (2005). Testing user interaction with a prototype visualization based information retrieval system. Journal of the American Society for Information Science and Technology, 56(8), 824-833. Sutcliffe, A.G., Ennis, M., & Hu, J. (2000). Evaluating the effectiveness of visual user interfaces for information retrieval. Journal of Human- Computer Studies, 53(5), 741-763. Westerman, S.J., & Cribbin, T. (2000). Mapping semantic information in virtual space: Dimensions, variance and individual differences. Journal of Human-Computer Studies, 53, 765-787. Risden, K., Czerwinski, M.P., Munzner, T., & Cook, D.B. (2000). An initial examination of ease of use for 2D and 3D information visualizations of web content. Journal of Human-Computer Studies, 53(5), 695-714. Turetken, O., & Sharda, R. (2005). Clustering-based visual interfaces for presentation of Web search results: An empirical investigation. Information Systems Frontiers, 7(3), 273-297. Newby, G.B. (2002). Empirical study of a 3D visualization for information retrieval tasks. Journal of Intelligent Information Systems, 18, 31-53. Lethbridge, T.C., Elliott Sim, S., & Singer, J. (2005). Studying software engineers: Data collection techniques for software field studies. Empirical Software Engineering, 10, 311-341. Lin, X. (1997). Map displays for information retrieval. Journal of the American Society for Information Science, 48, 40-54. Chung, W., Chen, H., & Nunamaker, J.F. Jr. (2005). A visual framework for knowledge discovery on the Web: An empirical study of business intelligence exploration. Journal of Management Information Systems, 21(4), 57-84. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum. Eibl, M. (2002). DEViD: A media design and software ergonomics integrating visualization for document retrieval. Information Visualization, 1(2), 139-157. Sengupta, A., & Dillon, A. (2006). Query by templates: Using the shape of information to search next-generation databases. IEEE Transactions on Professional Communication, 49(2), 128-144. 1998; 49 2002; 18 1997; 48 2002; 1 1998 2005; 62 1997 1996 1986; 19 2005; 21 2005 2004 2003 2002 1991 1999; 106 2003; 54 1999 2004; 11 2001 1990 2000 2006; 49 2000; 53 1985 2005; 7 2005; 10 2005; 56 1988 e_1_2_8_28_1 e_1_2_8_24_1 e_1_2_8_47_1 e_1_2_8_26_1 e_1_2_8_49_1 e_1_2_8_3_1 Chen C. (e_1_2_8_12_1) 2004 e_1_2_8_9_1 e_1_2_8_20_1 e_1_2_8_43_1 e_1_2_8_22_1 Dumais S.T. (e_1_2_8_19_1) 1985 Grun C. (e_1_2_8_21_1) 2005 e_1_2_8_41_1 e_1_2_8_17_1 Becks A. (e_1_2_8_5_1) 2002 e_1_2_8_13_1 e_1_2_8_36_1 e_1_2_8_15_1 e_1_2_8_38_1 e_1_2_8_57_1 Brajnik G. (e_1_2_8_8_1) 1996 Blythe M.A. (e_1_2_8_7_1) 2003 e_1_2_8_32_1 e_1_2_8_55_1 Zhang J. (e_1_2_8_59_1) 2005 e_1_2_8_11_1 e_1_2_8_34_1 e_1_2_8_53_1 e_1_2_8_51_1 Veerasamy A. (e_1_2_8_52_1) 1996 e_1_2_8_30_1 e_1_2_8_29_1 e_1_2_8_25_1 e_1_2_8_46_1 e_1_2_8_27_1 e_1_2_8_48_1 Dumais S.T. (e_1_2_8_18_1) 2005 e_1_2_8_2_1 e_1_2_8_4_1 e_1_2_8_42_1 e_1_2_8_23_1 e_1_2_8_44_1 e_1_2_8_40_1 e_1_2_8_39_1 Cohen J. (e_1_2_8_16_1) 1988 e_1_2_8_14_1 e_1_2_8_35_1 Sebrechts M.M. (e_1_2_8_45_1) 1999 e_1_2_8_37_1 e_1_2_8_58_1 Whiteside J. (e_1_2_8_56_1) 1985 Swan R.C. (e_1_2_8_50_1) 1998 Bederson B.B. (e_1_2_8_6_1) 2003 e_1_2_8_10_1 e_1_2_8_31_1 e_1_2_8_33_1 e_1_2_8_54_1 |
| References_xml | – reference: Sengupta, A., & Dillon, A. (2006). Query by templates: Using the shape of information to search next-generation databases. IEEE Transactions on Professional Communication, 49(2), 128-144. – reference: Turetken, O., & Sharda, R. (2005). Clustering-based visual interfaces for presentation of Web search results: An empirical investigation. Information Systems Frontiers, 7(3), 273-297. – reference: Koshman, S. (2005). Testing user interaction with a prototype visualization based information retrieval system. Journal of the American Society for Information Science and Technology, 56(8), 824-833. – reference: Bederson, B.B., & Shneiderman, B. (2003). The craft of information visualization: Readings and reflections. Amsterdam: Kaufmann. – reference: Ashby, F.G., Isen, A.M., & Turken, A.U. (1999). A neuropsychological theory of positive effect and its influence on cognition. Psychological Review, 106, 529-550. – reference: Chen, C. (2004). Information visualization: Beyond the horizon (2nd ed.). London: Springer-Verlag. – reference: Eibl, M. (2002). DEViD: A media design and software ergonomics integrating visualization for document retrieval. Information Visualization, 1(2), 139-157. – reference: Lethbridge, T.C., Elliott Sim, S., & Singer, J. (2005). Studying software engineers: Data collection techniques for software field studies. Empirical Software Engineering, 10, 311-341. – reference: Norman, D.A. (2004). Emotional design: Why we love (or hate) everyday things. New York: Basic Books. – reference: Modjeska, D., & Chignell, M. (2003). Individual differences in exploration using desktop VR. Journal of the American Society for Information Science and Technology, 54(3), 216-228. – reference: Blythe, M.A., Overbeeke, K., Monk, A.F., & Wright, P.C. (2003). Funology: From usability to enjoyment. Dordrecht, The Netherlands: Kluwer. – reference: Shneiderman, B. (2004). Designing for fun: How can we design user interfaces to be more fun? Interactions, 11(5), 48-50. – reference: Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum. – reference: Westerman, S.J., Collins, J., & Cribbin, T. (2005). Browsing a document collection represented in two- and three-dimensional virtual information space. Journal of Human-Computer Studies, 62(6), 713-736. – reference: Westerman, S.J., & Cribbin, T. (2000). Mapping semantic information in virtual space: Dimensions, variance and individual differences. Journal of Human-Computer Studies, 53, 765-787. – reference: Chen, C., & Czerwinski, M. (2000). Empirical studies of information visualization: A meta-analysis. Journal of Human-Computer Studies, 53(5), 851-866. – reference: Chung, W., Chen, H., & Nunamaker, J.F. Jr. (2005). A visual framework for knowledge discovery on the Web: An empirical study of business intelligence exploration. Journal of Management Information Systems, 21(4), 57-84. – reference: Sutcliffe, A.G., Ennis, M., & Hu, J. (2000). Evaluating the effectiveness of visual user interfaces for information retrieval. Journal of Human- Computer Studies, 53(5), 741-763. – reference: Carroll, J.M., & Mazur, S.A. (1986). "LisaLearning." IEEE Computer, 19(11), 35-49. – reference: Marchionini, G. (2006). Exploratory search: From finding to understanding. Communications of the ACM, 49(4), 41-46. – reference: Chen, H., Houston, A.L., Sewell, R.R., & Schatz, B.R. (1998). Internet browsing and searching: User evaluations of category map and concept space techniques. Journal of the American Society of Information Science, 49(7), 582-603. – reference: Newby, G.B. (2002). Empirical study of a 3D visualization for information retrieval tasks. Journal of Intelligent Information Systems, 18, 31-53. – reference: Risden, K., Czerwinski, M.P., Munzner, T., & Cook, D.B. (2000). An initial examination of ease of use for 2D and 3D information visualizations of web content. Journal of Human-Computer Studies, 53(5), 695-714. – reference: Lin, X. (1997). Map displays for information retrieval. Journal of the American Society for Information Science, 48, 40-54. – volume: 106 start-page: 529 year: 1999 end-page: 550 article-title: A neuropsychological theory of positive effect and its influence on cognition publication-title: Psychological Review – volume: 53 start-page: 695 issue: 5 year: 2000 end-page: 714 article-title: An initial examination of ease of use for 2D and 3D information visualizations of web content publication-title: Journal of Human–Computer Studies – volume: 53 start-page: 741 issue: 5 year: 2000 end-page: 763 article-title: Evaluating the effectiveness of visual user interfaces for information retrieval publication-title: Journal of Human– Computer Studies – volume: 49 start-page: 41 issue: 4 year: 2006 end-page: 46 article-title: Exploratory search: From finding to understanding publication-title: Communications of the ACM – start-page: 171 year: 1998 end-page: 181 – year: 2005 – volume: 21 start-page: 57 issue: 4 year: 2005 end-page: 84 article-title: A visual framework for knowledge discovery on the Web: An empirical study of business intelligence exploration publication-title: Journal of Management Information Systems – start-page: 127 year: 1985 end-page: 130 – year: 2001 – start-page: 103 year: 2003 end-page: 105 – year: 2003 – volume: 49 start-page: 128 issue: 2 year: 2006 end-page: 144 article-title: Query by templates: Using the shape of information to search next‐generation databases publication-title: IEEE Transactions on Professional Communication – year: 2000 – start-page: 153 year: 1998 end-page: 162 – volume: 7 start-page: 273 issue: 3 year: 2005 end-page: 297 article-title: Clustering‐based visual interfaces for presentation of Web search results: An empirical investigation publication-title: Information Systems Frontiers – volume: 19 start-page: 35 issue: 11 year: 1986 end-page: 49 article-title: LisaLearning publication-title: IEEE Computer – volume: 10 start-page: 311 year: 2005 end-page: 341 article-title: Studying software engineers: Data collection techniques for software field studies publication-title: Empirical Software Engineering – volume: 53 start-page: 765 year: 2000 end-page: 787 article-title: Mapping semantic information in virtual space: Dimensions, variance and individual differences publication-title: Journal of Human–Computer Studies – volume: 54 start-page: 216 issue: 3 year: 2003 end-page: 228 article-title: Individual differences in exploration using desktop VR publication-title: Journal of the American Society for Information Science and Technology – year: 1990 – start-page: 122 year: 1999 end-page: 129 – start-page: 85 year: 1996 end-page: 92 – start-page: 91 year: 2001 end-page: 95 – start-page: 3 year: 1999 end-page: 10 – start-page: 236 year: 1997 end-page: 245 – volume: 1 start-page: 139 issue: 2 year: 2002 end-page: 157 article-title: DEViD: A media design and software ergonomics integrating visualization for document retrieval publication-title: Information Visualization – start-page: 179 year: 2005 end-page: 188 – volume: 56 start-page: 824 issue: 8 year: 2005 end-page: 833 article-title: Testing user interaction with a prototype visualization based information retrieval system publication-title: Journal of the American Society for Information Science and Technology – start-page: 80 year: 2005 end-page: 87 – year: 2002 – year: 1988 – year: 2004 – start-page: 34 year: 2002 end-page: 39 – start-page: 174 year: 2005 end-page: 185 – volume: 48 start-page: 40 year: 1997 end-page: 54 article-title: Map displays for information retrieval publication-title: Journal of the American Society for Information Science – volume: 11 start-page: 48 issue: 5 year: 2004 end-page: 50 article-title: Designing for fun: How can we design user interfaces to be more fun? publication-title: Interactions – start-page: 123 year: 2005 end-page: 152 – volume: 62 start-page: 713 issue: 6 year: 2005 end-page: 736 article-title: Browsing a document collection represented in two‐ and three‐dimensional virtual information space publication-title: Journal of Human–Computer Studies – start-page: 185 year: 1985 end-page: 191 – start-page: 364 year: 2003 end-page: 371 – volume: 53 start-page: 851 issue: 5 year: 2000 end-page: 866 article-title: Empirical studies of information visualization: A meta‐analysis publication-title: Journal of Human–Computer Studies – year: 1991 – start-page: 107 year: 1996 end-page: 124 – start-page: 128 year: 1996 end-page: 136 – volume: 18 start-page: 31 year: 2002 end-page: 53 article-title: Empirical study of a 3D visualization for information retrieval tasks publication-title: Journal of Intelligent Information Systems – volume: 49 start-page: 582 issue: 7 year: 1998 end-page: 603 article-title: Internet browsing and searching: User evaluations of category map and concept space techniques publication-title: Journal of the American Society of Information Science – start-page: 621 year: 2002 end-page: 626 – year: 1999 – start-page: 179 volume-title: Proceedings of the National Conference on Digital Government Research year: 2005 ident: e_1_2_8_59_1 – volume-title: The craft of information visualization: Readings and reflections year: 2003 ident: e_1_2_8_6_1 – ident: e_1_2_8_33_1 doi: 10.1023/A:1012968507789 – ident: e_1_2_8_37_1 – ident: e_1_2_8_9_1 doi: 10.1145/313238.313283 – start-page: 3 volume-title: Proceedings of the annual International ACM SIGIR Conference year: 1999 ident: e_1_2_8_45_1 – ident: e_1_2_8_13_1 doi: 10.1006/ijhc.2000.0422 – ident: e_1_2_8_22_1 – start-page: 174 volume-title: Proceedings of the European Conference on Digital Libraries (ECDL) year: 2005 ident: e_1_2_8_21_1 – ident: e_1_2_8_40_1 doi: 10.1006/ijhc.2000.0413 – start-page: 85 volume-title: Proceedings of the annual International ACM SIGIR Conference year: 1996 ident: e_1_2_8_52_1 – ident: e_1_2_8_54_1 doi: 10.1016/j.ijhcs.2005.02.001 – ident: e_1_2_8_35_1 doi: 10.1007/1-4020-2967-5_10 – ident: e_1_2_8_14_1 doi: 10.1002/(SICI)1097-4571(19980515)49:7<582::AID-ASI2>3.0.CO;2-X – ident: e_1_2_8_17_1 doi: 10.1117/12.424929 – ident: e_1_2_8_15_1 doi: 10.1080/07421222.2005.11045821 – ident: e_1_2_8_44_1 doi: 10.1109/IV.2004.1320234 – ident: e_1_2_8_24_1 doi: 10.1109/INFVIS.2001.963289 – ident: e_1_2_8_10_1 – ident: e_1_2_8_31_1 doi: 10.1002/asi.10197 – volume-title: Funology: From usability to enjoyment year: 2003 ident: e_1_2_8_7_1 – ident: e_1_2_8_30_1 doi: 10.1109/WPC.2005.34 – start-page: 123 volume-title: TREC: Experiment and evaluation in information retrieval year: 2005 ident: e_1_2_8_18_1 – ident: e_1_2_8_3_1 doi: 10.1037/0033-295X.106.3.529 – ident: e_1_2_8_48_1 doi: 10.1145/1015530.1015552 – volume-title: Information visualization: Beyond the horizon year: 2004 ident: e_1_2_8_12_1 – ident: e_1_2_8_25_1 doi: 10.1109/INFVIS.2004.70 – ident: e_1_2_8_51_1 doi: 10.1007/s10796-005-2770-7 – ident: e_1_2_8_58_1 doi: 10.1109/ITCC.2002.1000356 – ident: e_1_2_8_34_1 doi: 10.1109/ENABL.2001.953395 – start-page: 621 volume-title: Proceedings of the ACM Symposium on Applied Computing year: 2002 ident: e_1_2_8_5_1 – ident: e_1_2_8_39_1 doi: 10.1016/B978-155860915-0/50035-4 – ident: e_1_2_8_43_1 doi: 10.4135/9781412984997 – ident: e_1_2_8_23_1 doi: 10.1145/1109540.1109551 – ident: e_1_2_8_46_1 doi: 10.1109/TPC.2006.875073 – ident: e_1_2_8_53_1 doi: 10.1145/258525.258580 – ident: e_1_2_8_27_1 doi: 10.1007/s10664-005-1290-x – ident: e_1_2_8_20_1 doi: 10.1057/palgrave.ivs.9500017 – ident: e_1_2_8_29_1 doi: 10.1145/1121949.1121979 – start-page: 128 volume-title: Proceedings of the annual International ACM SIGIR Conference year: 1996 ident: e_1_2_8_8_1 – ident: e_1_2_8_28_1 doi: 10.1002/(SICI)1097-4571(199701)48:1<40::AID-ASI6>3.0.CO;2-1 – ident: e_1_2_8_32_1 doi: 10.1109/IV.2000.859758 – ident: e_1_2_8_47_1 doi: 10.1016/B978-155860915-0/50046-9 – ident: e_1_2_8_26_1 doi: 10.1002/asi.20175 – ident: e_1_2_8_36_1 doi: 10.1145/985600.966013 – ident: e_1_2_8_11_1 doi: 10.1109/MC.1986.1663098 – start-page: 171 volume-title: Proceedings of the annual International ACM SIGIR Conference year: 1998 ident: e_1_2_8_50_1 – ident: e_1_2_8_4_1 doi: 10.1109/INFVIS.2001.963290 – start-page: 127 volume-title: Proceedings of the ACM Conference of Human Factors in Computing Systems year: 1985 ident: e_1_2_8_19_1 – ident: e_1_2_8_42_1 doi: 10.1145/288392.288596 – ident: e_1_2_8_55_1 doi: 10.1006/ijhc.2000.0417 – ident: e_1_2_8_41_1 – ident: e_1_2_8_38_1 – ident: e_1_2_8_57_1 – start-page: 185 volume-title: Proceedings of the ACM Conference on Human Factors in Computing Systems year: 1985 ident: e_1_2_8_56_1 – ident: e_1_2_8_49_1 doi: 10.1006/ijhc.2000.0416 – volume-title: Statistical power analysis for the behavioral sciences year: 1988 ident: e_1_2_8_16_1 – ident: e_1_2_8_2_1 doi: 10.1007/978-1-4471-3056-7_8 |
| SSID | ssj0011510 |
| Score | 1.6394073 |
| SecondaryResourceType | review_article |
| Snippet | This review describes experimental designs (users, search tasks, measures, etc.) used by 31 controlled user studies of information visualization (IV) tools for... |
| SourceID | proquest pascalfrancis crossref wiley istex |
| SourceType | Aggregation Database Index Database Enrichment Source Publisher |
| StartPage | 1012 |
| SubjectTerms | Browsing College students Comparative analysis Design Design of experiments Design Requirements Exact sciences and technology Information and communication sciences Information retrieval Information science. Documentation Infrared analysis Interfaces Library and information science. General aspects Literature reviews Meta Analysis Online information retrieval Research design Sciences and techniques of general use Scientific visualization Studies Undergraduate Students Usability Use and user studies. Information needs User interface Visualization Websites |
| Title | Controlled user evaluations of information visualization interfaces for text retrieval: Literature review and meta-analysis |
| URI | https://api.istex.fr/ark:/67375/WNG-41746S29-T/fulltext.pdf https://onlinelibrary.wiley.com/doi/abs/10.1002%2Fasi.20786 https://www.proquest.com/docview/231464298 https://www.proquest.com/docview/32335069 https://www.proquest.com/docview/57703159 |
| Volume | 59 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1daxQxFL2U-qIPaqviWluDSPFl2pnMZDLRp1KsVbQPtsU-CCFfA0vrrOzsigiCP8Hf6C9pbjIz3RUL4tvC3gyT5ObmJHPuuQDP_KZaGK5twrgySVEYkShhXZJqm5uUOs3D1cD7o_LwtHh7xs5W4GWfCxP1IYYLN1wZIV7jAle63b0SDVXt2B_veIVy28jVQkD0YZCO8kAnKhGwHNOPK9qrCqV0d2i5tBfdwGH9htxI1frhqWNdiyXguQhfw_5zcAc-9W8eaSfnO_OZ3jHf_xB1_M-u3YXbHS4le9GR1mDFNetwa0GtcB02uxwHsk26JCacVNJFh3vwYz_S3i-cJXj3Qa6UxFsyqcl4odHXcYvZnDEHlKBmxbRGchjxJgTJKGQaSn35J7wg7wbpZxIzbYhqLPnsZur3z1-qU1W5D6cHr072D5OuukNiEBUkGbeMC2GrrGSUOZ6ZPDVWGKZtWqZU1Vbl3GRGV6yq_ZFfF_iJ0ZbM1mXmfNx4AKvNpHEPgVTU-ChtrHZ4P2qtn27K60o4i_ipFiN43s-zNJ30OVbguJBRtJlKP-IyjPgIng6mX6Lex9-MtoOzDBZqeo4EOc7kx6PXsvCnvPKYCnkygq0lbxoaUBSCzIR_s43evWQXPFrpIXfhj4WiGsGT4V-_6vFTjmrcZN7KnOY5S0txvQXjWJmAYd-Dq13fG7l3_Cb8ePTvphtwMxJnkML0GFZn07nb9OhsprfCMrwEhy86Ug |
| linkProvider | Wiley-Blackwell |
| linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV3NbtQwEB6V9gAc-CkgtqWthVDFJW3ixHGMuFQVZQvbPdCt6AVZju1Iq5ZstdlFCAmJR-AZeRI8cZLuIiohbpEyjuLxeDwznvkG4IU7VBPNcxMwrnSQJFoEShgbhLmJdUhtzuvQwMkw7Z8l787Z-Qq8bmthPD5EF3DDnVHra9zgGJDev0YNVdXY-Xc8S2_BGnb0rh2qDx14lDN1PBYBi7EAOaMtrlBI97uhS6fRGjL2K2ZHqsoxqPCdLZZMz0UDtj6Bju7Dp_bffeLJxd58lu_pb3_AOv7v5B7AvcY0JQdelh7Cii3X4e4CYOE6bDVlDmSXNHVMuK6kURCP4Puhz3y_tIZg-INcg4lXZFKQ8cKgL-MKCzp9GShB2IppgflhxJEQzEch07rbl_vCKzLo0J-JL7YhqjTks52pXz9-qgZY5TGcHb0ZHfaDpsFDoNEwCCJuGBfCZFHKKLM80nGojdAsN2EaUlUYFXMd6TxjWeG8_jzBW0aTMlOkkXWq4wmslpPSPgWSUe0UtTa5xRCpMW69KS8yYQ2aUIXowct2oaVu0M-xCcel9LjNVDqOy5rjPXjekV55yI-_Ee3W0tJRqOkF5shxJj8O38rEOXrpKRVy1IPtJXHqBlDEgoyE-7PNVr5koz8q6azuxHmGIuvBTvfWbXy8zVGlncwrGdM4ZmEqbqZgHJsTMJx7LWs3z0YenB7XDxv_TroDt_ujk4EcHA_fb8Idn0eDGU3PYHU2ndstZ6zN8u16T_4G9cA-bQ |
| linkToPdf | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1Ra9RAEB5qC6IPVavitbZdRIovaZNNNpvVp9J6tloPsS32obBsdjdwtObK5U5EEPwJ_kZ_iTvZJL0TC-JbILMhOzszOzs78w3Ac7epJprnJmBc6SBJtAiUMDYIcxPrkNqc16GB94P04DR5e8bOFuBVWwvj8SG6gBtqRm2vUcGvTLFzDRqqqqE73vEsvQVLSRpmKNL7HzvsKOfpeCgCFmP9cUZbWKGQ7nRD5zajJeTrV0yOVJXjT-EbW8x5nrP-a70B9e_BefvrPu_kYns6ybf1tz9QHf9zbvdhuXFMya6XpAewYMsVuDsDV7gC602RA9kiTRUTrippzMND-L7n894vrSEY_CDXUOIVGRVkODPoy7DCck5fBEoQtGJcYHYYcSQEs1HIuO715b7wkhx12M_El9oQVRry2U7Urx8_VQOr8ghO-69P9g6Cpr1DoNEtCCJuGBfCZFHKKLM80nGojdAsN2EaUlUYFXMd6TxjWeHO_HmCd4wmZaZII-sMx2NYLEelfQIko9qZaW1yiwFSY9xyU15kwhp0oArRgxftOkvdYJ9jC45L6VGbqXQclzXHe_CsI73ygB9_I9qqhaWjUOMLzJDjTH4avJGJO-alx1TIkx5szElTN4AiEmQk3J-tteIlG-tRSedzJ-5cKLIebHZvndrjXY4q7WhayZjGMQtTcTMF49iagOHca1G7eTZy9_iwflj9d9JNuP1hvy-PDgfv1uCOT6LBdKansDgZT-2689Qm-Uatkb8BOYk9JQ |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Controlled+user+evaluations+of+information+visualization+interfaces+for+text+retrieval%3A+Literature+review+and+meta%E2%80%90analysis&rft.jtitle=Journal+of+the+American+Society+for+Information+Science+and+Technology&rft.au=Julien%2C+Charles%E2%80%90Antoine&rft.au=Leide%2C+John+E.&rft.au=Bouthillier%2C+France&rft.date=2008-04-01&rft.issn=1532-2882&rft.eissn=1532-2890&rft.volume=59&rft.issue=6&rft.spage=1012&rft.epage=1024&rft_id=info:doi/10.1002%2Fasi.20786&rft.externalDBID=n%2Fa&rft.externalDocID=10_1002_asi_20786 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1532-2882&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1532-2882&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1532-2882&client=summon |