EvalBench: A Software Library for Visualization Evaluation
It is generally acknowledged in visualization research that it is necessary to evaluate visualization artifacts in order to provide empirical evidence on their effectiveness and efficiency as well as their usability and utility. However, the difficulties of conducting such evaluations still remain a...
Saved in:
| Published in | Computer graphics forum Vol. 32; no. 3pt1; pp. 41 - 50 |
|---|---|
| Main Authors | , , |
| Format | Journal Article |
| Language | English |
| Published |
Oxford, UK
Blackwell Publishing Ltd
01.06.2013
|
| Subjects | |
| Online Access | Get full text |
| ISSN | 0167-7055 1467-8659 |
| DOI | 10.1111/cgf.12091 |
Cover
| Abstract | It is generally acknowledged in visualization research that it is necessary to evaluate visualization artifacts in order to provide empirical evidence on their effectiveness and efficiency as well as their usability and utility. However, the difficulties of conducting such evaluations still remain an issue. Apart from the required know‐how to appropriately design and conduct user studies, the necessary implementation effort for evaluation features in visualization software is a considerable obstacle. To mitigate this, we present EvalBench, an easy‐to‐use, flexible, and reusable software library for visualization evaluation written in Java. We describe its design choices and basic ions of our conceptual architecture and demonstrate its applicability by a number of case studies. EvalBench reduces implementation effort for evaluation features and makes conducting user studies easier. It can be used and integrated with third‐party visualization prototypes that need to be evaluated via loose coupling. EvalBench supports both, quantitative and qualitative evaluation methods such as controlled experiments, interaction logging, laboratory questionnaires, heuristic evaluations, and insight diaries. |
|---|---|
| AbstractList | It is generally acknowledged in visualization research that it is necessary to evaluate visualization artifacts in order to provide empirical evidence on their effectiveness and efficiency as well as their usability and utility. However, the difficulties of conducting such evaluations still remain an issue. Apart from the required know‐how to appropriately design and conduct user studies, the necessary implementation effort for evaluation features in visualization software is a considerable obstacle. To mitigate this, we present EvalBench, an easy‐to‐use, flexible, and reusable software library for visualization evaluation written in Java. We describe its design choices and basic abstractions of our conceptual architecture and demonstrate its applicability by a number of case studies. EvalBench reduces implementation effort for evaluation features and makes conducting user studies easier. It can be used and integrated with third‐party visualization prototypes that need to be evaluated via loose coupling. EvalBench supports both, quantitative and qualitative evaluation methods such as controlled experiments, interaction logging, laboratory questionnaires, heuristic evaluations, and insight diaries. It is generally acknowledged in visualization research that it is necessary to evaluate visualization artifacts in order to provide empirical evidence on their effectiveness and efficiency as well as their usability and utility. However, the difficulties of conducting such evaluations still remain an issue. Apart from the required know‐how to appropriately design and conduct user studies, the necessary implementation effort for evaluation features in visualization software is a considerable obstacle. To mitigate this, we present EvalBench, an easy‐to‐use, flexible, and reusable software library for visualization evaluation written in Java. We describe its design choices and basic ions of our conceptual architecture and demonstrate its applicability by a number of case studies. EvalBench reduces implementation effort for evaluation features and makes conducting user studies easier. It can be used and integrated with third‐party visualization prototypes that need to be evaluated via loose coupling. EvalBench supports both, quantitative and qualitative evaluation methods such as controlled experiments, interaction logging, laboratory questionnaires, heuristic evaluations, and insight diaries. It is generally acknowledged in visualization research that it is necessary to evaluate visualization artifacts in order to provide empirical evidence on their effectiveness and efficiency as well as their usability and utility. However, the difficulties of conducting such evaluations still remain an issue. Apart from the required know-how to appropriately design and conduct user studies, the necessary implementation effort for evaluation features in visualization software is a considerable obstacle. To mitigate this, we present EvalBench, an easy-to-use, flexible, and reusable software library for visualization evaluation written in Java. We describe its design choices and basic abstractions of our conceptual architecture and demonstrate its applicability by a number of case studies. EvalBench reduces implementation effort for evaluation features and makes conducting user studies easier. It can be used and integrated with third-party visualization prototypes that need to be evaluated via loose coupling. EvalBench supports both, quantitative and qualitative evaluation methods such as controlled experiments, interaction logging, laboratory questionnaires, heuristic evaluations, and insight diaries [PUBLICATION ABSTRACT]. |
| Author | Hoffmann, S. Aigner, W. Rind, A. |
| Author_xml | – sequence: 1 givenname: W. surname: Aigner fullname: Aigner, W. organization: Institute of Software Technology & Interactive Systems, Vienna University of Technology, Austria – sequence: 2 givenname: S. surname: Hoffmann fullname: Hoffmann, S. organization: Institute of Software Technology & Interactive Systems, Vienna University of Technology, Austria – sequence: 3 givenname: A. surname: Rind fullname: Rind, A. organization: Institute of Software Technology & Interactive Systems, Vienna University of Technology, Austria |
| BookMark | eNp1kF1PwjAUhhuDiYBe-A-WeKMXg35s3cYdEpgaookQvWy60mlxrNhuIv56y4deED0356R5npOetwUapS4lAOcIdpCrrnjJOwjDBB2BJgpo5Mc0TBqgCZGbIxiGJ6Bl7RxCGEQ0bILe8IMX17IUrz2v7010Xq24kd5YZYabtZdr4z0pW_NCffFK6dLb8PV2PAXHOS-sPNv3NpiOhtPBjT9-SG8H_bEvCI2Rn8wySRAhlMQkx8EMSorCiGPCc0EDngQZxgnMBY6RmJGQSsoRJSKLSSDcI2mDy93apdHvtbQVWygrZFHwUuraMhSgKE4oppFDLw7Qua5N6T7nKEgxxDSmjuruKGG0tUbmTKhqe1FluCoYgmwTJXNRsm2Uzrg6MJZGLVw-f7L77StVyPX_IBukox_D3xnKVvLz1-DmjbmbopA936csgo84RXcTRsk3r_2RUw |
| CitedBy_id | crossref_primary_10_1016_j_cag_2019_05_022 crossref_primary_10_1109_TVCG_2015_2467752 crossref_primary_10_1109_TVCG_2022_3231230 crossref_primary_10_1109_TVCG_2024_3456144 crossref_primary_10_1007_s10209_022_00955_y crossref_primary_10_1145_3427323 |
| Cites_doi | 10.1007/s13218-012-0167-6 10.1145/1142473.1142574 10.1016/j.artmed.2008.03.006 10.1109/MCG.2006.70 10.1109/TVCG.2007.70515 10.1109/VAST.2011.6102446 10.1145/223355.223456 10.1145/1240624.1240840 10.1109/TVCG.2011.185 10.1109/TVCG.2008.137 10.1109/MCG.2009.49 10.1111/j.1467-8659.2010.01845.x 10.1109/TVCG.2011.279 10.1145/1178657.1178662 10.1007/978-3-540-70956-5_2 10.3758/s13428-011-0168-7 10.1109/VAST.2010.5652890 10.1109/IUSER.2010.5716734 10.1145/989863.989880 10.1111/j.1467-8659.2012.03092.x |
| ContentType | Journal Article |
| Copyright | 2013 The Author(s) Computer Graphics Forum © 2013 The Eurographics Association and Blackwell Publishing Ltd. |
| Copyright_xml | – notice: 2013 The Author(s) Computer Graphics Forum © 2013 The Eurographics Association and Blackwell Publishing Ltd. |
| DBID | BSCLL AAYXX CITATION 7SC 8FD JQ2 L7M L~C L~D F28 FR3 |
| DOI | 10.1111/cgf.12091 |
| DatabaseName | Istex CrossRef Computer and Information Systems Abstracts Technology Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional ANTE: Abstracts in New Technology & Engineering Engineering Research Database |
| DatabaseTitle | CrossRef Computer and Information Systems Abstracts Technology Research Database Computer and Information Systems Abstracts – Academic Advanced Technologies Database with Aerospace ProQuest Computer Science Collection Computer and Information Systems Abstracts Professional Engineering Research Database ANTE: Abstracts in New Technology & Engineering |
| DatabaseTitleList | CrossRef Technology Research Database Computer and Information Systems Abstracts |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Engineering |
| EISSN | 1467-8659 |
| EndPage | 50 |
| ExternalDocumentID | 3024934421 10_1111_cgf_12091 CGF12091 ark_67375_WNG_70R2G1JS_6 |
| Genre | article Feature |
| GroupedDBID | .3N .4S .DC .GA .Y3 05W 0R~ 10A 15B 1OB 1OC 29F 31~ 33P 3SF 4.4 50Y 50Z 51W 51X 52M 52N 52O 52P 52S 52T 52U 52W 52X 5GY 5HH 5LA 5VS 66C 6J9 702 7PT 8-0 8-1 8-3 8-4 8-5 8UM 8VB 930 A03 AAESR AAEVG AAHHS AANLZ AAONW AASGY AAXRX AAZKR ABCQN ABCUV ABDBF ABDPE ABEML ABPVW ACAHQ ACBWZ ACCFJ ACCZN ACFBH ACGFS ACPOU ACSCC ACXBN ACXQS ADBBV ADEOM ADIZJ ADKYN ADMGS ADOZA ADXAS ADZMN ADZOD AEEZP AEGXH AEIGN AEIMD AEMOZ AENEX AEQDE AEUQT AEUYR AFBPY AFEBI AFFNX AFFPM AFGKR AFPWT AFZJQ AHBTC AHEFC AITYG AIURR AIWBW AJBDE AJXKR AKVCP ALAGY ALMA_UNASSIGNED_HOLDINGS ALUQN AMBMR AMYDB ARCSS ASPBG ATUGU AUFTA AVWKF AZBYB AZFZN AZVAB BAFTC BDRZF BFHJK BHBCM BMNLL BMXJE BNHUX BROTX BRXPI BSCLL BY8 CAG COF CS3 CWDTD D-E D-F DCZOG DPXWK DR2 DRFUL DRSTM DU5 EAD EAP EBA EBO EBR EBS EBU EDO EJD EMK EST ESX F00 F01 F04 F5P FEDTE FZ0 G-S G.N GODZA H.T H.X HF~ HGLYW HVGLF HZI HZ~ I-F IHE IX1 J0M K1G K48 LATKE LC2 LC3 LEEKS LH4 LITHE LOXES LP6 LP7 LUTES LW6 LYRES MEWTI MK4 MRFUL MRSTM MSFUL MSSTM MXFUL MXSTM N04 N05 N9A NF~ O66 O9- OIG P2W P2X P4D PALCI PQQKQ Q.N Q11 QB0 QWB R.K RDJ RIWAO RJQFR ROL RX1 SAMSI SUPJJ TH9 TN5 TUS UB1 V8K W8V W99 WBKPD WIH WIK WOHZO WQJ WRC WXSBR WYISQ WZISG XG1 ZL0 ZZTAW ~IA ~IF ~WT AAHQN AAMNL AANHP AAYCA ACRPL ACUHS ACYXJ ADNMO AFWVQ AHQJS ALVPJ AAYXX ADMLS AEYWJ AGHNM AGQPQ AGYGG CITATION 7SC 8FD AAMMB AEFGJ AGXDD AIDQK AIDYY JQ2 L7M L~C L~D F28 FR3 |
| ID | FETCH-LOGICAL-c3681-9dbe31336383f24d0e6157a23afc64a94b2290fc281cd356e6a163cb834cc283 |
| IEDL.DBID | DR2 |
| ISSN | 0167-7055 |
| IngestDate | Thu Sep 04 23:28:14 EDT 2025 Fri Jul 25 03:46:46 EDT 2025 Thu Apr 24 23:13:08 EDT 2025 Tue Jul 01 02:23:02 EDT 2025 Wed Jan 22 16:59:59 EST 2025 Wed Oct 30 09:47:47 EDT 2024 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 3pt1 |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c3681-9dbe31336383f24d0e6157a23afc64a94b2290fc281cd356e6a163cb834cc283 |
| Notes | ark:/67375/WNG-70R2G1JS-6 ArticleID:CGF12091 istex:A16DDDA26FD21011338CE6667B5C63A15EAB74C4 SourceType-Scholarly Journals-1 ObjectType-Feature-1 content type line 14 ObjectType-Article-2 content type line 23 |
| PQID | 1406202686 |
| PQPubID | 30877 |
| PageCount | 10 |
| ParticipantIDs | proquest_miscellaneous_1417896267 proquest_journals_1406202686 crossref_citationtrail_10_1111_cgf_12091 crossref_primary_10_1111_cgf_12091 wiley_primary_10_1111_cgf_12091_CGF12091 istex_primary_ark_67375_WNG_70R2G1JS_6 |
| ProviderPackageCode | CITATION AAYXX |
| PublicationCentury | 2000 |
| PublicationDate | June 2013 |
| PublicationDateYYYYMMDD | 2013-06-01 |
| PublicationDate_xml | – month: 06 year: 2013 text: June 2013 |
| PublicationDecade | 2010 |
| PublicationPlace | Oxford, UK |
| PublicationPlace_xml | – name: Oxford, UK – name: Oxford |
| PublicationTitle | Computer graphics forum |
| PublicationYear | 2013 |
| Publisher | Blackwell Publishing Ltd |
| Publisher_xml | – name: Blackwell Publishing Ltd |
| References | Yi J. S. , Kang Y. A. , Stasko J. T. , Jacko J. A. : Toward a deeper understanding of the role of interaction in information visualization . IEEE Trans. Visualization and Computer Graphics 13 , 6 ( 2007 ), 1224 - 1231 . 8 . Martins S. B. , Shahar Y. , Goren-Bar D. , Galperin M. , Kaizer H. , Basso L. V. , McNaughton D. , Goldstein M. K. : Evaluation of an architecture for intelligent query and exploration of time-oriented clinical data . Artificial Intelligence in Medicine 43 ( 2008 ), 17 - 34 . 8 . Thomas J. J. , Cook K. A. : Illuminating the Path: The Research and Development Agenda for Visual Analytics . IEEE , 2005 . 1 . Heer J. , Mackinlay J. D. , Stolte C. , Agrawala M. : Graphical histories for visualization: Supporting analysis, communication, and evaluation . IEEE Trans. Visualization and Computer Graphics 14 ( 2008 ), 1189 - 1196 . 3 . Pohl M. , Wiltner S. , Miksch S. , Aigner W. , Rind A. : Analysing interactivity in information visualisation . KI - Künstliche Intelligenz 26 ( 2012 ), 151 - 159 . 6, 7, 8 . Dou W. , Jeong D. H. , Stukes F. , Ribarsky W. , Lipford H. R. , Chang R. : Recovering reasoning processes from user interactions . IEEE Comp. Graphics and Applications 29 , 3 ( 2009 ), 52 - 61 . 3 . Lazar J. , Feng J. H. , Hochheiser H. : Research Methods in Human-Computer Interaction . John Wiley & Sons , 2010 . 2, 4, 6, 9 . Mathôt S. , Schreij D. , Theeuwes J. : OpenSesame: an open-source, graphical experiment builder for the social sciences . Behavior Research Methods 44 ( 2012 ), 314 - 324 . 2 . Keim D. , Kohlhammer J. , Ellis G. , Mansmann F. ( Eds. ): Mastering The Information Age - Solving Problems with Visual Analytics . Eurographics , 2010 . 1 . Aigner W. , Kainz C. , Ma R. , Miksch S. : Bertin was right: An empirical evaluation of indexing to compare multivariate time-series data using line plots . Comp. Graphics Forum 30 , 1 ( 2011 ), 215 - 228 . 7 . Aigner W. , Rind A. , Hoffmann S. : Comparative evaluation of an interactive time-series visualization that combines quantitative data with qualitative abstractions . Comp. Graphics Forum 31 , 3 ( 2012 ), 995 - 1004 . 7, 8 . Lam H. , Bertini E. , Isenberg P. , Plaisant C. , Carpendale S. : Empirical studies in information visualization: Seven scenarios . IEEE Trans. Visualization and Computer Graphics 18 , 9 ( 2012 ), 1520 - 1536 . 1, 2 . Bostock M. , Ogievetsky V. , Heer J. : D3: Data-driven documents . IEEE Trans. Visualization and Computer Graphics 17 , 12 ( 2011 ), 2301 - 2309 . 2 . Gamma E. , Helm R. , Johnson R. , Vlissides J. : Design patterns: elements of reusable object-oriented software . Addison-Wesley Longman , 1995 . 3, 8 . North C. : Toward measuring visualization insight . IEEE Comp. Graphics and Applications 26 , 3 ( 2006 ), 6 - 9 . 5 . 2012 2011 2010 2006; 26 2008; 14 2011; 30 2008 2007 2006 1995 2005 2012; 18 2008; 43 1994 2004 2012; 26 2011; 17 2012; 44 2007; 13 2012; 31 2009; 29 Forsell C. (e_1_2_10_14_2) 2010 e_1_2_10_20_2 e_1_2_10_21_2 e_1_2_10_40_2 Thomas J. J. (e_1_2_10_39_2) 2005 Gomez S. (e_1_2_10_16_2) 2012 e_1_2_10_19_2 Lazar J. (e_1_2_10_25_2) 2010 Andrews K. (e_1_2_10_2_2) 2007 e_1_2_10_3_2 Heer J. (e_1_2_10_18_2) 2005 e_1_2_10_5_2 e_1_2_10_37_2 e_1_2_10_7_2 e_1_2_10_13_2 e_1_2_10_6_2 e_1_2_10_9_2 e_1_2_10_11_2 e_1_2_10_34_2 e_1_2_10_8_2 e_1_2_10_33_2 Gamma E. (e_1_2_10_15_2) 1995 e_1_2_10_10_2 e_1_2_10_31_2 Rester M. (e_1_2_10_36_2) 2007 Elmqvist N. (e_1_2_10_12_2) 2012 Kim J. H. (e_1_2_10_22_2) 2008 Keim D. (e_1_2_10_23_2) 2010 Nielsen J. (e_1_2_10_30_2) 1994 Ordóñez P. (e_1_2_10_32_2) 2010 Pohl M. (e_1_2_10_35_2) 2011 Heer J. (e_1_2_10_17_2) 2010 Shrinivasan Y. B. (e_1_2_10_38_2) 2008 e_1_2_10_28_2 Aigner W. (e_1_2_10_4_2) 2005 e_1_2_10_29_2 e_1_2_10_26_2 e_1_2_10_27_2 e_1_2_10_24_2 |
| References_xml | – reference: Aigner W. , Kainz C. , Ma R. , Miksch S. : Bertin was right: An empirical evaluation of indexing to compare multivariate time-series data using line plots . Comp. Graphics Forum 30 , 1 ( 2011 ), 215 - 228 . 7 . – reference: Bostock M. , Ogievetsky V. , Heer J. : D3: Data-driven documents . IEEE Trans. Visualization and Computer Graphics 17 , 12 ( 2011 ), 2301 - 2309 . 2 . – reference: Mathôt S. , Schreij D. , Theeuwes J. : OpenSesame: an open-source, graphical experiment builder for the social sciences . Behavior Research Methods 44 ( 2012 ), 314 - 324 . 2 . – reference: Thomas J. J. , Cook K. A. : Illuminating the Path: The Research and Development Agenda for Visual Analytics . IEEE , 2005 . 1 . – reference: Yi J. S. , Kang Y. A. , Stasko J. T. , Jacko J. A. : Toward a deeper understanding of the role of interaction in information visualization . IEEE Trans. Visualization and Computer Graphics 13 , 6 ( 2007 ), 1224 - 1231 . 8 . – reference: Dou W. , Jeong D. H. , Stukes F. , Ribarsky W. , Lipford H. R. , Chang R. : Recovering reasoning processes from user interactions . IEEE Comp. Graphics and Applications 29 , 3 ( 2009 ), 52 - 61 . 3 . – reference: Lazar J. , Feng J. H. , Hochheiser H. : Research Methods in Human-Computer Interaction . John Wiley & Sons , 2010 . 2, 4, 6, 9 . – reference: Pohl M. , Wiltner S. , Miksch S. , Aigner W. , Rind A. : Analysing interactivity in information visualisation . KI - Künstliche Intelligenz 26 ( 2012 ), 151 - 159 . 6, 7, 8 . – reference: Aigner W. , Rind A. , Hoffmann S. : Comparative evaluation of an interactive time-series visualization that combines quantitative data with qualitative abstractions . Comp. Graphics Forum 31 , 3 ( 2012 ), 995 - 1004 . 7, 8 . – reference: Gamma E. , Helm R. , Johnson R. , Vlissides J. : Design patterns: elements of reusable object-oriented software . Addison-Wesley Longman , 1995 . 3, 8 . – reference: Heer J. , Mackinlay J. D. , Stolte C. , Agrawala M. : Graphical histories for visualization: Supporting analysis, communication, and evaluation . IEEE Trans. Visualization and Computer Graphics 14 ( 2008 ), 1189 - 1196 . 3 . – reference: Keim D. , Kohlhammer J. , Ellis G. , Mansmann F. ( Eds. ): Mastering The Information Age - Solving Problems with Visual Analytics . Eurographics , 2010 . 1 . – reference: Martins S. B. , Shahar Y. , Goren-Bar D. , Galperin M. , Kaizer H. , Basso L. V. , McNaughton D. , Goldstein M. K. : Evaluation of an architecture for intelligent query and exploration of time-oriented clinical data . Artificial Intelligence in Medicine 43 ( 2008 ), 17 - 34 . 8 . – reference: Lam H. , Bertini E. , Isenberg P. , Plaisant C. , Carpendale S. : Empirical studies in information visualization: Seven scenarios . IEEE Trans. Visualization and Computer Graphics 18 , 9 ( 2012 ), 1520 - 1536 . 1, 2 . – reference: North C. : Toward measuring visualization insight . IEEE Comp. Graphics and Applications 26 , 3 ( 2006 ), 6 - 9 . 5 . – start-page: 771 year: 2010 end-page: 779 – volume: 14 start-page: 1189 year: 2008 end-page: 1196 article-title: Graphical histories for visualization: Supporting analysis, communication, and evaluation publication-title: IEEE Trans. Visualization and Computer Graphics – start-page: 693 year: 2007 end-page: 700 – start-page: 1237 year: 2008 end-page: 1246 – year: 2005 – volume: 43 start-page: 17 year: 2008 end-page: 34 article-title: Evaluation of an architecture for intelligent query and exploration of time‐oriented clinical data publication-title: Artificial Intelligence in Medicine – start-page: 292 year: 2011 end-page: 299 – start-page: 91 year: 2011 end-page: 100 – start-page: 162 year: 2010 end-page: 169 – volume: 17 start-page: 2301 issue: 12 year: 2011 end-page: 2309 article-title: D3: Data‐driven documents publication-title: IEEE Trans. Visualization and Computer Graphics – start-page: 421 year: 2005 end-page: 430 – start-page: 2465 year: 2012 end-page: 2468 – start-page: 1425 year: 2007 end-page: 1434 – start-page: 413 year: 1994 end-page: 414 – volume: 30 start-page: 215 issue: 1 year: 2011 end-page: 228 article-title: Bertin was right: An empirical evaluation of indexing to compare multivariate time‐series data using line plots publication-title: Comp. Graphics Forum – volume: 26 start-page: 151 year: 2012 end-page: 159 article-title: Analysing interactivity in information visualisation publication-title: KI – Künstliche Intelligenz – start-page: 457 year: 2005 end-page: 463 – year: 2010 – volume: 26 start-page: 6 issue: 3 year: 2006 end-page: 9 article-title: Toward measuring visualization insight publication-title: IEEE Comp. Graphics and Applications – start-page: 443 year: 2008 end-page: 452 – year: 2012 – start-page: 109 year: 2004 end-page: 116 – volume: 13 start-page: 1224 issue: 6 year: 2007 end-page: 1231 article-title: Toward a deeper understanding of the role of interaction in information visualization publication-title: IEEE Trans. Visualization and Computer Graphics – volume: 18 start-page: 1520 issue: 9 year: 2012 end-page: 1536 article-title: Empirical studies in information visualization: Seven scenarios publication-title: IEEE Trans. Visualization and Computer Graphics – start-page: 110 year: 2010 end-page: 115 – start-page: 13 year: 2006 end-page: 18 – start-page: 19 year: 2008 end-page: 45 – start-page: 113 year: 1995 end-page: 114 – start-page: 745 year: 2006 end-page: 747 – year: 2008 – start-page: 163 year: 2010 end-page: 170 – year: 1995 – volume: 29 start-page: 52 issue: 3 year: 2009 end-page: 61 article-title: Recovering reasoning processes from user interactions publication-title: IEEE Comp. Graphics and Applications – volume: 44 start-page: 314 year: 2012 end-page: 324 article-title: OpenSesame: an open‐source, graphical experiment builder for the social sciences publication-title: Behavior Research Methods – start-page: 12:1 year: 2012 end-page: 12:8 – volume: 31 start-page: 995 issue: 3 year: 2012 end-page: 1004 article-title: Comparative evaluation of an interactive time‐series visualization that combines quantitative data with qualitative abstractions publication-title: Comp. Graphics Forum – start-page: 81 year: 2007 end-page: 86 – start-page: 203 year: 2010 end-page: 212 – start-page: 162 volume-title: Proc. Int. Conf. Information Visualisation, IV year: 2010 ident: e_1_2_10_14_2 – start-page: 693 volume-title: Proc. Int. Conf. Information Visualization, IV year: 2007 ident: e_1_2_10_36_2 – ident: e_1_2_10_29_2 – start-page: 81 volume-title: Proc. Int. Conf. Information Visualization, IV year: 2007 ident: e_1_2_10_2_2 – ident: e_1_2_10_34_2 doi: 10.1007/s13218-012-0167-6 – ident: e_1_2_10_9_2 doi: 10.1145/1142473.1142574 – ident: e_1_2_10_27_2 doi: 10.1016/j.artmed.2008.03.006 – start-page: 421 volume-title: Proc. SIGCHI Conf. Human Factors in Computing Systems, CHI year: 2005 ident: e_1_2_10_18_2 – ident: e_1_2_10_31_2 doi: 10.1109/MCG.2006.70 – ident: e_1_2_10_40_2 doi: 10.1109/TVCG.2007.70515 – ident: e_1_2_10_13_2 doi: 10.1109/VAST.2011.6102446 – start-page: 203 volume-title: Proc. SIGCHI Conf. Human Factors in Computing Systems, CHI year: 2010 ident: e_1_2_10_17_2 – ident: e_1_2_10_37_2 doi: 10.1145/223355.223456 – ident: e_1_2_10_26_2 doi: 10.1145/1240624.1240840 – start-page: 771 volume-title: Proc. of Int. Health Informatics Symp year: 2010 ident: e_1_2_10_32_2 – ident: e_1_2_10_7_2 doi: 10.1109/TVCG.2011.185 – volume-title: Illuminating the Path: The Research and Development Agenda for Visual Analytics year: 2005 ident: e_1_2_10_39_2 – ident: e_1_2_10_20_2 doi: 10.1109/TVCG.2008.137 – volume-title: Research Methods in Human‐Computer Interaction year: 2010 ident: e_1_2_10_25_2 – ident: e_1_2_10_11_2 doi: 10.1109/MCG.2009.49 – ident: e_1_2_10_19_2 – start-page: 2465 volume-title: Proc. SIGCHI Conf. Human Factors in Computing Systems, CHI year: 2012 ident: e_1_2_10_16_2 – ident: e_1_2_10_3_2 doi: 10.1111/j.1467-8659.2010.01845.x – ident: e_1_2_10_24_2 doi: 10.1109/TVCG.2011.279 – volume-title: Design patterns: elements of reusable object‐oriented software year: 1995 ident: e_1_2_10_15_2 – ident: e_1_2_10_10_2 doi: 10.1145/1178657.1178662 – ident: e_1_2_10_8_2 doi: 10.1007/978-3-540-70956-5_2 – start-page: 443 volume-title: Proc. SIGCHI Conf. Human Factors in Computing Systems, CHI year: 2008 ident: e_1_2_10_22_2 – ident: e_1_2_10_28_2 doi: 10.3758/s13428-011-0168-7 – start-page: 292 volume-title: Proc. IFIP Human‐Computer Interaction, INTERACT, Part IV year: 2011 ident: e_1_2_10_35_2 – start-page: 457 volume-title: Proc. Int. Conf. Information Visualisation, IV year: 2005 ident: e_1_2_10_4_2 – start-page: 12:1 volume-title: Proc. Workshop BEyond time and errors: novel evaluation methods for Information Visualization, BELIV year: 2012 ident: e_1_2_10_12_2 – ident: e_1_2_10_21_2 doi: 10.1109/VAST.2010.5652890 – start-page: 1237 volume-title: Proc. SIGCHI Conf. Human Factors in Computing Systems, CHI year: 2008 ident: e_1_2_10_38_2 – ident: e_1_2_10_6_2 doi: 10.1109/IUSER.2010.5716734 – volume-title: Mastering The Information Age – Solving Problems with Visual Analytics year: 2010 ident: e_1_2_10_23_2 – ident: e_1_2_10_33_2 doi: 10.1145/989863.989880 – ident: e_1_2_10_5_2 doi: 10.1111/j.1467-8659.2012.03092.x – start-page: 413 volume-title: Conf. Companion Human Factors in Computing Systems, CHI year: 1994 ident: e_1_2_10_30_2 |
| SSID | ssj0004765 |
| Score | 2.1695051 |
| Snippet | It is generally acknowledged in visualization research that it is necessary to evaluate visualization artifacts in order to provide empirical evidence on their... |
| SourceID | proquest crossref wiley istex |
| SourceType | Aggregation Database Enrichment Source Index Database Publisher |
| StartPage | 41 |
| SubjectTerms | Analysis Computer graphics Computer programs Conduction H.5.2 [Information Interfaces and Presentation (e.g H.5.2 [Information Interfaces and Presentation (e.g., HCI)]: User Interfaces—Evaluation/methodology HCI)]: User Interfaces-Evaluation/methodology Joining Libraries Logging Software Studies Utilities Visualization |
| Title | EvalBench: A Software Library for Visualization Evaluation |
| URI | https://api.istex.fr/ark:/67375/WNG-70R2G1JS-6/fulltext.pdf https://onlinelibrary.wiley.com/doi/abs/10.1111%2Fcgf.12091 https://www.proquest.com/docview/1406202686 https://www.proquest.com/docview/1417896267 |
| Volume | 32 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1JS8NAFB5EL3pwF6tVooh4SckyW-rJrRVBD63bQQgzkxmVlla6oPjrfZPNKgriLWReYPKWme8l732D0J7gOvISzVwjlHFxJLUrCEnchAaKSyNIkna5Xl7R8xt8cU_up9Bh0QuT8UOUH9xsZKTrtQ1wIYcTQa4eTc02ftrUxw-p5c0_bX1SR2FGScHrbRljclYhW8VTPvllL5qxan37AjQn4Wq63zQW0EMx06zMpFMbj2RNvX8jcfznqyyi-RyHOkeZ4yyhKd1bRnMT7IQrqA4ou3sMXvxUd46cNqzXr2KgnbzTwQG069w-D21TZtbK6ZyVzOGr6Lpxdn1y7uZHLbgqpNx3o0TqENJViMbQBDjxNCAdJoJQGEWxiLC0vPBGBdxXSUiopgKAnJI8xApuhmtoutfv6XXkMGI0jnwTGOFjS5ZPJTGCeYJTrjwZVdBBofNY5TTk9jSMblykI6CNONVGBe2Woi8Z98ZPQvup4UoJMejYYjVG4rurZsy8VtD0L9oxraBqYdk4j9MhJD4eDSAN5TC8Uw5DhNnfJqKn-2Mr4zMeQeLHYO6pGX-fTXzSbKQXG38X3USzQXbGhuv5VTQ9Goz1FiCdkdxOXfoDFUv3Lg |
| linkProvider | Wiley-Blackwell |
| linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1LTxsxEB4hOLQcgLYgwqNsq6rqZaN9-LWICwWSlEIOkLZckGV7bUCggEIiqv56xvtqqKhU9bZaz0rescf-PtvzGeCDEjaLcstDp4wLSaZtqCjNw5wlRminaF5kuR73We8bOTyjZzOwU-fClPoQzYKbj4xivPYB7hekp6LcXLi2z_xE7jNHEGh46rV_8ls8inBGa2VvrxlT6Qr5czzNp09moznv2J9PoOY0YC1mnM4inNd1LQ-aXLcnY902v_6Qcfzfn1mChQqKBrtl33kFM3b4GuanBArfwDYC7ZvP2JEvt4Pd4BSH7Ac1skGV7BAg4A2-X937vMwymzM4aMTDl2HQORjs9cLqtoXQpEzEYZZrmyJjxYBMXULyyCLY4SpJlTOMqIxoLw3vTCJik6eUWaYQyxktUmLwZboCs8PboV2FgFNnSRa7xKmYeL18pqlTPFKCCRPprAWfaqdLUymR-wsxbmTNSNAbsvBGC943pnel_MZzRh-Llmss1Ojan1fjVP7odyWPTpJufHgqWQs26qaVVajeI_eJWIJMVGDxu6YYg8zvnKihvZ14m5iLDLkfx7oX7fj32si9bqd4WPt30y140RscH8mjL_2v6_AyKa_cCKN4A2bHo4ndROAz1m-L_v0ImKT7TQ |
| linkToPdf | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1bSxwxFD6IgtQHW9uKa61OSyl9mWUuuY0-edu1tl1Ere6DEJJMokVZZd2l0l_fk7m5ioXi2zA5A5lzSb4zc84XgE9K2CzKLQ-dMi4kmbahojQPc5YYoZ2iedHl-qPH9n6S_T7tT8FG3QtT8kM0H9x8ZBTrtQ_wm9xNBLk5d23f-ImpzwxhiCQ8Ijq8544inNGa2NtTxlS0Qr6Mp3n0wWY04_V69wBpTuLVYsPpvISzeqplncllezzSbfPnEYvjM9_lFcxXQDTYLD1nAabs4DXMTdATvoF1hNlXW-jGF-vBZnCEC_ZvNbRB1eoQINwNTn7d-q7Mspcz2G2ow9_CcWf3eHsvrM5aCE3KRBxmubYp5qsYjqlLSB5ZhDpcJalyhhGVEe2J4Z1JRGzylDLLFCI5o0VKDN5MF2F6cD2wSxBw6izJYpc4FRPPls80dYpHSjBhIp214Eutc2kqHnJ_HMaVrPMR1IYstNGCj43oTUm-8ZTQ58JwjYQaXvpqNU7laa8reXSYdOP9I8lasFJbVlaBeouZT8QSzEMFDn9ohjHE_H8TNbDXYy8Tc5Fh5sdx7oUZ_z0bud3tFBfL_y-6BrMHOx35_Wvv2zt4kZTnbYRRvALTo-HYvkfUM9KrhXf_Baed-fw |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=EvalBench%3A+A+Software+Library+for+Visualization+Evaluation&rft.jtitle=Computer+graphics+forum&rft.au=Aigner%2C+W.&rft.au=Hoffmann%2C+S.&rft.au=Rind%2C+A.&rft.date=2013-06-01&rft.issn=0167-7055&rft.eissn=1467-8659&rft.volume=32&rft.issue=3pt1&rft.spage=41&rft.epage=50&rft_id=info:doi/10.1111%2Fcgf.12091&rft.externalDBID=n%2Fa&rft.externalDocID=10_1111_cgf_12091 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0167-7055&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0167-7055&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0167-7055&client=summon |