An automatically created novel bug dataset and its validation in bug prediction
Bugs are inescapable during software development due to frequent code changes, tight deadlines, etc.; therefore, it is important to have tools to find these errors. One way of performing bug identification is to analyze the characteristics of buggy source code elements from the past and predict the...
Saved in:
Published in | The Journal of systems and software Vol. 169; p. 110691 |
---|---|
Main Authors | , , , , |
Format | Journal Article |
Language | English |
Published |
Elsevier Inc
01.11.2020
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | Bugs are inescapable during software development due to frequent code changes, tight deadlines, etc.; therefore, it is important to have tools to find these errors. One way of performing bug identification is to analyze the characteristics of buggy source code elements from the past and predict the present ones based on the same characteristics, using e.g. machine learning models. To support model building tasks, code elements and their characteristics are collected in so-called bug datasets which serve as the input for learning.
We present the BugHunter Dataset: a novel kind of automatically constructed and freely available bug dataset containing code elements (files, classes, methods) with a wide set of code metrics and bug information. Other available bug datasets follow the traditional approach of gathering the characteristics of all source code elements (buggy and non-buggy) at only one or more pre-selected release versions of the code. Our approach, on the other hand, captures the buggy and the fixed states of the same source code elements from the narrowest timeframe we can identify for a bug’s presence, regardless of release versions. To show the usefulness of the new dataset, we built and evaluated bug prediction models and achieved F-measure values over 0.74.
•Proposing a novel kind of bug dataset that captures before- and after-fix states.•Predicting faults at method level is more accurate than at class and file levels.•Using method level metrics for class level bug prediction performed the best.•The novel dataset moderates the uncertainty of labeling elements as buggy. |
---|---|
AbstractList | Bugs are inescapable during software development due to frequent code changes, tight deadlines, etc.; therefore, it is important to have tools to find these errors. One way of performing bug identification is to analyze the characteristics of buggy source code elements from the past and predict the present ones based on the same characteristics, using e.g. machine learning models. To support model building tasks, code elements and their characteristics are collected in so-called bug datasets which serve as the input for learning.
We present the BugHunter Dataset: a novel kind of automatically constructed and freely available bug dataset containing code elements (files, classes, methods) with a wide set of code metrics and bug information. Other available bug datasets follow the traditional approach of gathering the characteristics of all source code elements (buggy and non-buggy) at only one or more pre-selected release versions of the code. Our approach, on the other hand, captures the buggy and the fixed states of the same source code elements from the narrowest timeframe we can identify for a bug’s presence, regardless of release versions. To show the usefulness of the new dataset, we built and evaluated bug prediction models and achieved F-measure values over 0.74.
•Proposing a novel kind of bug dataset that captures before- and after-fix states.•Predicting faults at method level is more accurate than at class and file levels.•Using method level metrics for class level bug prediction performed the best.•The novel dataset moderates the uncertainty of labeling elements as buggy. |
ArticleNumber | 110691 |
Author | Ferenc, Rudolf Gyimóthy, Tibor Tóth, Zoltán Gyimesi, Gábor Gyimesi, Péter |
Author_xml | – sequence: 1 givenname: Rudolf surname: Ferenc fullname: Ferenc, Rudolf email: ferenc@inf.u-szeged.hu organization: Department of Software Engineering, University of Szeged, Hungary – sequence: 2 givenname: Péter surname: Gyimesi fullname: Gyimesi, Péter email: pgyimesi@inf.u-szeged.hu organization: Department of Software Engineering, University of Szeged, Hungary – sequence: 3 givenname: Gábor surname: Gyimesi fullname: Gyimesi, Gábor email: ggyimesi@inf.u-szeged.hu organization: Department of Software Engineering, University of Szeged, Hungary – sequence: 4 givenname: Zoltán surname: Tóth fullname: Tóth, Zoltán email: zizo@inf.u-szeged.hu organization: Department of Software Engineering, University of Szeged, Hungary – sequence: 5 givenname: Tibor surname: Gyimóthy fullname: Gyimóthy, Tibor email: gyimothy@inf.u-szeged.hu organization: Department of Software Engineering, University of Szeged, Hungary |
BookMark | eNp9kM1qwzAQhEVJoUnaB-hNL-BUP44t01MI_YNALu1ZbKRVkXHkICmBvH2VpueedneYWYZvRiZhDEjII2cLznjz1C_6lBaCiXJz1nT8hky5amXFhVATMi2euuxc3JFZSj1jrC3mKdmuAoVjHveQvYFhOFMTETJaGsYTDnR3_KYWMiTMFIKlPid6gsEXzY-B-vDrOES03lyUe3LrYEj48Dfn5Ov15XP9Xm22bx_r1aYysma5QrVUTQNYenTgLCydca0wwtRWoEOFdSOsqtEqkIYrJx13O8WXUnbQtYzJOeHXvyaOKUV0-hD9HuJZc6YvRHSvCxF9IaKvRErm-ZrBUuzkMepkPAZTukc0WdvR_5P-AQJka-Y |
CitedBy_id | crossref_primary_10_1007_s10664_021_09954_8 crossref_primary_10_1007_s10664_021_09984_2 crossref_primary_10_1109_TR_2021_3066170 crossref_primary_10_1007_s10664_022_10257_9 crossref_primary_10_1007_s10207_023_00795_8 crossref_primary_10_1109_ACCESS_2024_3406929 crossref_primary_10_1007_s11277_023_10694_9 crossref_primary_10_1016_j_jksuci_2022_12_017 crossref_primary_10_3390_math9111180 crossref_primary_10_1109_ACCESS_2022_3181995 crossref_primary_10_1016_j_jss_2023_111868 crossref_primary_10_2139_ssrn_4176728 crossref_primary_10_1109_ACCESS_2023_3262411 crossref_primary_10_1007_s10664_021_10092_4 crossref_primary_10_1016_j_softx_2023_101499 |
Cites_doi | 10.1109/TSE.2013.11 10.1109/TR.2013.2259203 10.1023/A:1018991717352 10.1007/s10994-005-0466-3 10.1109/TSE.2005.112 10.1214/aoms/1177731944 10.1109/TKDE.2008.239 10.1109/TSE.2005.49 10.1109/TSE.2006.102 10.1109/TSE.2017.2724538 10.1109/52.50773 10.1145/2915970.2916007 10.1016/j.scico.2009.02.007 10.1037/0033-2909.112.1.155 10.2307/3001968 10.1109/TSE.2007.70725 10.1109/32.295895 10.1049/iet-sen.2017.0148 10.1016/j.eswa.2008.10.027 10.1145/2629648 10.1109/32.544352 10.1109/TSE.2017.2780222 |
ContentType | Journal Article |
Copyright | 2020 The Authors |
Copyright_xml | – notice: 2020 The Authors |
DBID | 6I. AAFTH AAYXX CITATION |
DOI | 10.1016/j.jss.2020.110691 |
DatabaseName | ScienceDirect Open Access Titles Elsevier:ScienceDirect:Open Access CrossRef |
DatabaseTitle | CrossRef |
DatabaseTitleList | |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Computer Science |
EISSN | 1873-1228 |
ExternalDocumentID | 10_1016_j_jss_2020_110691 S0164121220301436 |
GroupedDBID | --K --M -~X .DC .~1 0R~ 1B1 1~. 1~5 29L 4.4 457 4G. 5GY 5VS 6I. 7-5 71M 8P~ 9JN 9M8 AABNK AACTN AAEDT AAEDW AAFTH AAIKJ AAKOC AALRI AAOAW AAQFI AAQXK AAXUO AAYFN AAYOK ABBOA ABEFU ABFNM ABFRF ABFSI ABJNI ABMAC ABTAH ABXDB ABYKQ ACDAQ ACGFO ACGFS ACGOD ACNNM ACRLP ACZNC ADBBV ADEZE ADHUB ADJOM ADMUD AEBSH AEFWE AEKER AENEX AFKWA AFTJW AGHFR AGUBO AGYEJ AHHHB AHZHX AI. AIALX AIEXJ AIKHN AITUG AJBFU AJOXV ALMA_UNASSIGNED_HOLDINGS AMFUW AMRAJ AOUOD ASPBG AVWKF AXJTR AZFZN BKOJK BKOMP BLXMC CS3 DU5 E.L EBS EFJIC EFLBG EJD EO8 EO9 EP2 EP3 FDB FEDTE FGOYB FIRID FNPLU FYGXN G-Q G8K GBLVA GBOLZ HLZ HVGLF HZ~ IHE J1W KOM LG9 M41 MO0 MS~ N9A O-L O9- OAUVE OZT P-8 P-9 P2P PC. PQQKQ Q38 R2- RIG RNS ROL RPZ RXW SBC SDF SDG SDP SES SEW SPC SPCBC SSV SSZ T5K TAE TN5 TWZ UHS UNMZH VH1 WUQ XPP ZMT ZY4 ~G- AAXKI AAYXX AFJKZ AKRWK CITATION |
ID | FETCH-LOGICAL-c340t-e85866ae0009afda5fcf72c2c4d2efe8e462d84ed8a3c18f3f1fb815339a97003 |
IEDL.DBID | AIKHN |
ISSN | 0164-1212 |
IngestDate | Thu Sep 26 17:43:36 EDT 2024 Fri Feb 23 02:48:51 EST 2024 |
IsDoiOpenAccess | true |
IsOpenAccess | true |
IsPeerReviewed | true |
IsScholarly | true |
Keywords | Bug prediction Bug dataset Code metrics GitHub Static code analysis Machine learning |
Language | English |
License | This is an open access article under the CC BY-NC-ND license. |
LinkModel | DirectLink |
MergedId | FETCHMERGED-LOGICAL-c340t-e85866ae0009afda5fcf72c2c4d2efe8e462d84ed8a3c18f3f1fb815339a97003 |
OpenAccessLink | https://www.sciencedirect.com/science/article/pii/S0164121220301436 |
ParticipantIDs | crossref_primary_10_1016_j_jss_2020_110691 elsevier_sciencedirect_doi_10_1016_j_jss_2020_110691 |
PublicationCentury | 2000 |
PublicationDate | November 2020 2020-11-00 |
PublicationDateYYYYMMDD | 2020-11-01 |
PublicationDate_xml | – month: 11 year: 2020 text: November 2020 |
PublicationDecade | 2020 |
PublicationTitle | The Journal of systems and software |
PublicationYear | 2020 |
Publisher | Elsevier Inc |
Publisher_xml | – name: Elsevier Inc |
References | Dallmeier, Zimmermann (b18) 2007 Catal, Diri (b12) 2009; 36 Nemenyi (b42) 1963 Li, Jing, Zhu (b38) 2018; 12 Ma, Guo, Cukic (b40) 2006 Bellon, Koschke, Antoniol, Krinke, Merlo (b6) 2007; 33 He, Garcia (b29) 2009; 21 Kalliamvakou, Gousios, Blincoe, Singer, German, Damian (b34) 2014 Ghotra, McIntosh, Hassan (b24) 2015 Rosenthal, Cooper, Hedges (b48) 1994 Porter, Selby (b46) 1990; 7 Saha, Lease, Khurshid, Perry (b50) 2013 Williams, Spacco (b61) 2008 Wang, Yao (b59) 2013; 62 Śliwerski, Zimmermann, Zeller (b54) 2005 Kohavi (b36) 1995 Coles (b15) 2018 Ostrand, Weyuker, Bell (b44) 2007 Bán, Ferenc, Siket, Kiss, Gyimóthy (b3) 2018 Johnson, Song, Murphy-Hill, Bowdidge (b32) 2013 Wu, Zhang, Kim, Cheung (b62) 2011 D’Ambros, Lanza, Robbes (b19) 2010 Wilcoxon (b60) 1945; 1 Gyimesi, Gyimesi, Tóth, Ferenc (b25) 2015 Wang, Lin, Zhang, Hu (b57) 2010 Zhou, Leung (b63) 2006; 32 Petrić, J., Bowes, D., Hall, T., Christianson, B., Baddoo, N., 2016. The jinx on the NASA software defect data sets. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering. pp. 1–5. Bán, Ferenc (b2) 2014 Cohen (b14) 1992; 112 Couto, Silva, Valente, Bigonha, Anquetil (b16) 2012 Jureczko, Madeyski (b33) 2010 Roy, Cordy, Koschke (b49) 2009; 74 Kim, Zimmermann, Pan, Whitehead Jr (b35) 2006 Bakota, Hegedus, Kortvelyesi, Ferenc, Gyimothy (b1) 2011 Zhou, Zhang, Lo (b64) 2012 Hall, Zhang, Bowes, Sun (b27) 2014; 23 Boehm, Abts, Chulani (b8) 2000; 10 Zimmermann, Premraj, Zeller (b65) 2007 Bowes, Hall, Harman, Jia, Sarro, Wu (b10) 2016 Fischer, Pinzger, Gall (b22) 2003 Davies, Roper, Wood (b20) 2012 Boogerd, Moonen (b9) 2008 Harman, Islam, Jia, Minku, Sarro, Srivisut (b28) 2014 Quinlan (b47) 1993 Mockus, Votta (b41) 2000 Tóth, Gyimesi, Ferenc (b55) 2016 Dallmeier, Zimmermann (b17) 2007 Gyimothy, Ferenc, Siket (b26) 2005; 31 Toth, Novak, Ferenc, Siket (b56) 2013 Ostrand, Weyuker, Bell (b43) 2005; 31 Shirabad, Menzies (b53) 2005 Bird, Rigby, Barr, Hamilton, German, Devanbu (b7) 2009 Landwehr, Hall, Frank (b37) 2005; 95 Bruntink, Van Deursen (b11) 2004 Friedman (b23) 1940; 11 Herbold, Trautsch, Grabowski (b30) 2018; 44 Chidamber, Kemerer (b13) 1994; 20 Shippey, Hall, Counsell, Bowes (b52) 2016 Dyer, Nguyen, Rajan, Nguyen (b21) 2013 Shepperd, Song, Sun, Mair (b51) 2013; 39 Basili, Briand, Melo (b5) 1996; 22 Li, Jing, Zhu, Zhang, Xu, Ying (b39) 2019; 45 Wang, Lo (b58) 2014 (b31) 2018 Bangcharoensap, Ihara, Kamei, Matsumoto (b4) 2012 Roy (10.1016/j.jss.2020.110691_b49) 2009; 74 D’Ambros (10.1016/j.jss.2020.110691_b19) 2010 Mockus (10.1016/j.jss.2020.110691_b41) 2000 Basili (10.1016/j.jss.2020.110691_b5) 1996; 22 Bán (10.1016/j.jss.2020.110691_b2) 2014 Herbold (10.1016/j.jss.2020.110691_b30) 2018; 44 Coles (10.1016/j.jss.2020.110691_b15) 2018 Shirabad (10.1016/j.jss.2020.110691_b53) 2005 Tóth (10.1016/j.jss.2020.110691_b55) 2016 Shepperd (10.1016/j.jss.2020.110691_b51) 2013; 39 Friedman (10.1016/j.jss.2020.110691_b23) 1940; 11 Quinlan (10.1016/j.jss.2020.110691_b47) 1993 Rosenthal (10.1016/j.jss.2020.110691_b48) 1994 Wang (10.1016/j.jss.2020.110691_b57) 2010 Bowes (10.1016/j.jss.2020.110691_b10) 2016 Kim (10.1016/j.jss.2020.110691_b35) 2006 Li (10.1016/j.jss.2020.110691_b39) 2019; 45 (10.1016/j.jss.2020.110691_b31) 2018 Hall (10.1016/j.jss.2020.110691_b27) 2014; 23 Boogerd (10.1016/j.jss.2020.110691_b9) 2008 Li (10.1016/j.jss.2020.110691_b38) 2018; 12 Catal (10.1016/j.jss.2020.110691_b12) 2009; 36 Bakota (10.1016/j.jss.2020.110691_b1) 2011 Kalliamvakou (10.1016/j.jss.2020.110691_b34) 2014 Jureczko (10.1016/j.jss.2020.110691_b33) 2010 Kohavi (10.1016/j.jss.2020.110691_b36) 1995 Bellon (10.1016/j.jss.2020.110691_b6) 2007; 33 Ghotra (10.1016/j.jss.2020.110691_b24) 2015 Johnson (10.1016/j.jss.2020.110691_b32) 2013 Fischer (10.1016/j.jss.2020.110691_b22) 2003 Couto (10.1016/j.jss.2020.110691_b16) 2012 Ostrand (10.1016/j.jss.2020.110691_b43) 2005; 31 Wang (10.1016/j.jss.2020.110691_b58) 2014 Dallmeier (10.1016/j.jss.2020.110691_b18) 2007 Dyer (10.1016/j.jss.2020.110691_b21) 2013 Landwehr (10.1016/j.jss.2020.110691_b37) 2005; 95 Davies (10.1016/j.jss.2020.110691_b20) 2012 Bán (10.1016/j.jss.2020.110691_b3) 2018 Williams (10.1016/j.jss.2020.110691_b61) 2008 Cohen (10.1016/j.jss.2020.110691_b14) 1992; 112 Gyimothy (10.1016/j.jss.2020.110691_b26) 2005; 31 Zhou (10.1016/j.jss.2020.110691_b64) 2012 Harman (10.1016/j.jss.2020.110691_b28) 2014 10.1016/j.jss.2020.110691_b45 Chidamber (10.1016/j.jss.2020.110691_b13) 1994; 20 Ma (10.1016/j.jss.2020.110691_b40) 2006 Porter (10.1016/j.jss.2020.110691_b46) 1990; 7 Toth (10.1016/j.jss.2020.110691_b56) 2013 Wang (10.1016/j.jss.2020.110691_b59) 2013; 62 He (10.1016/j.jss.2020.110691_b29) 2009; 21 Zhou (10.1016/j.jss.2020.110691_b63) 2006; 32 Wilcoxon (10.1016/j.jss.2020.110691_b60) 1945; 1 Śliwerski (10.1016/j.jss.2020.110691_b54) 2005 Saha (10.1016/j.jss.2020.110691_b50) 2013 Ostrand (10.1016/j.jss.2020.110691_b44) 2007 Dallmeier (10.1016/j.jss.2020.110691_b17) 2007 Bruntink (10.1016/j.jss.2020.110691_b11) 2004 Gyimesi (10.1016/j.jss.2020.110691_b25) 2015 Nemenyi (10.1016/j.jss.2020.110691_b42) 1963 Shippey (10.1016/j.jss.2020.110691_b52) 2016 Wu (10.1016/j.jss.2020.110691_b62) 2011 Boehm (10.1016/j.jss.2020.110691_b8) 2000; 10 Bird (10.1016/j.jss.2020.110691_b7) 2009 Zimmermann (10.1016/j.jss.2020.110691_b65) 2007 Bangcharoensap (10.1016/j.jss.2020.110691_b4) 2012 |
References_xml | – start-page: 9 year: 2007 ident: b65 article-title: Predicting defects for eclipse publication-title: Predictor Models in Software Engineering, 2007. PROMISE’07: ICSE Workshops 2007. International Workshop on contributor: fullname: Zeller – start-page: 223 year: 2012 end-page: 232 ident: b16 article-title: Uncovering causal relationships between software metrics and bugs publication-title: Software Maintenance and Reengineering (CSMR), 2012 16th European Conference on contributor: fullname: Anquetil – year: 2012 ident: b64 article-title: Where should the bugs be fixed? more accurate information retrieval-based bug localization based on bug reports publication-title: 2012 34th International Conference on Software Engineering (ICSE) contributor: fullname: Lo – start-page: 92 year: 2014 end-page: 101 ident: b34 article-title: The promises and perils of mining github publication-title: MSR 2014 Proceedings of the 11th Working Conference on Mining Software Repositories contributor: fullname: Damian – volume: 45 start-page: 391 year: 2019 end-page: 411 ident: b39 article-title: On the multiple sources and privacy preservation issues for heterogeneous defect prediction publication-title: IEEE Transactions on Software Engineering contributor: fullname: Ying – start-page: 237 year: 2006 end-page: 265 ident: b40 article-title: A statistical framework for the prediction of fault-proneness publication-title: Advances in Machine Learning Application in Software Engineering contributor: fullname: Cukic – year: 2018 ident: b31 article-title: Jhawk – start-page: 243 year: 2011 end-page: 252 ident: b1 article-title: A probabilistic software quality model publication-title: Software Maintenance (ICSM), 2011 27th IEEE International Conference on contributor: fullname: Gyimothy – year: 2010 ident: b57 article-title: Detect related bugs from source code using bug information publication-title: Computer Software and Applications Conference (COMPSAC) contributor: fullname: Hu – volume: 95 start-page: 161 year: 2005 end-page: 205 ident: b37 article-title: Logistic model trees publication-title: Mach. Learn. contributor: fullname: Frank – year: 1993 ident: b47 article-title: C4.5: Programs for Machine Learning contributor: fullname: Quinlan – start-page: 1 year: 2005 end-page: 5 ident: b54 article-title: When do changes induce fixes? publication-title: ACM Sigsoft Software Engineering Notes, Vol. 30 contributor: fullname: Zeller – start-page: 1 year: 2009 end-page: 10 ident: b7 article-title: The promises and perils of mining git publication-title: Mining Software Repositories, 2009. MSR ’09. 6th IEEE International Working Conference on contributor: fullname: Devanbu – volume: 12 start-page: 161 year: 2018 end-page: 175 ident: b38 article-title: Progress on approaches to software defect prediction publication-title: IET Softw. contributor: fullname: Zhu – start-page: 136 year: 2004 end-page: 145 ident: b11 article-title: Predicting class testability using object-oriented metrics publication-title: Source Code Analysis and Manipulation, 2004. Fourth IEEE International Workshop on contributor: fullname: Van Deursen – volume: 31 start-page: 340 year: 2005 end-page: 355 ident: b43 article-title: Predicting the location and number of faults in large software systems publication-title: IEEE Trans. Softw. Eng. contributor: fullname: Bell – volume: 1 start-page: 80 year: 1945 end-page: 83 ident: b60 article-title: Individual comparisons by ranking methods publication-title: Biom. Bull. contributor: fullname: Wilcoxon – volume: 21 start-page: 1263 year: 2009 end-page: 1284 ident: b29 article-title: Learning from imbalanced data publication-title: IEEE Trans. Knowl. Data Eng. contributor: fullname: Garcia – start-page: 345 year: 2013 end-page: 355 ident: b50 article-title: Improving bug localization using structured information retrieval publication-title: Automated Software Engineering (ASE), 2013 IEEE/ACM 28th International Conference on contributor: fullname: Perry – volume: 23 start-page: 33 year: 2014 ident: b27 article-title: Some code smells have a significant but small effect on faults publication-title: ACM Trans. Softw. Eng. Methodol. (TOSEM) contributor: fullname: Sun – volume: 62 start-page: 434 year: 2013 end-page: 443 ident: b59 article-title: Using class imbalance learning for software defect prediction publication-title: IEEE Trans. Reliab. contributor: fullname: Yao – volume: 7 start-page: 46 year: 1990 end-page: 54 ident: b46 article-title: Empirically guided software development using metric-based classification trees publication-title: IEEE Softw. contributor: fullname: Selby – start-page: 672 year: 2013 end-page: 681 ident: b32 article-title: Why don’t software developers use static analysis tools to find bugs? publication-title: 2013 35th International Conference on Software Engineering (ICSE) contributor: fullname: Bowdidge – start-page: 219 year: 2007 end-page: 227 ident: b44 article-title: Automating algorithms for the identification of fault-prone files publication-title: Proceedings of the 2007 International Symposium on Software Testing and Analysis contributor: fullname: Bell – year: 2005 ident: b53 article-title: The PROMISE Repository of Software Engineering Databases, Vol. 24 contributor: fullname: Menzies – volume: 10 start-page: 177 year: 2000 end-page: 205 ident: b8 article-title: Software development cost estimation approaches — A survey publication-title: Ann. Softw. Eng. contributor: fullname: Chulani – year: 2018 ident: b15 article-title: Pitest mutation framework contributor: fullname: Coles – start-page: 32 year: 2008 end-page: 36 ident: b61 article-title: Szz revisited: verifying when changes induce fixes publication-title: Proceedings of the 2008 Workshop on Defects in Large Software Systems contributor: fullname: Spacco – start-page: 10 year: 2012 end-page: 15 ident: b4 article-title: Locating source code to be fixed based on initial bug reports - A case study on the eclipse project publication-title: Empirical Software Engineering in Practice (IWESEP), 2012 Fourth International Workshop on contributor: fullname: Matsumoto – start-page: 81 year: 2006 end-page: 90 ident: b35 article-title: Automatic identification of bug-introducing changes publication-title: Automated Software Engineering, 2006. ASE’06. 21st IEEE/ACM International Conference on contributor: fullname: Whitehead Jr – start-page: 1 year: 2018 end-page: 25 ident: b3 article-title: Prediction models for performance, power, and energy efficiency of software executed on heterogeneous hardware publication-title: J. Supercomput. contributor: fullname: Gyimóthy – start-page: 9 year: 2010 ident: b33 article-title: Towards identifying software project clusters with regard to defect prediction publication-title: Proceedings of the 6th International Conference on Predictive Models in Software Engineering contributor: fullname: Madeyski – start-page: 625 year: 2016 end-page: 638 ident: b55 article-title: A public bug database of github projects and its application in bug prediction publication-title: International Conference on Computational Science and Its Applications contributor: fullname: Ferenc – start-page: 31 year: 2010 end-page: 41 ident: b19 article-title: An extensive comparison of bug prediction approaches publication-title: Proceedings of MSR 2010 (7th IEEE Working Conference on Mining Software Repositories) contributor: fullname: Robbes – volume: 22 start-page: 751 year: 1996 end-page: 761 ident: b5 article-title: A validation of object-oriented design metrics as quality indicators publication-title: IEEE Trans. Softw. Eng. contributor: fullname: Melo – year: 1963 ident: b42 article-title: Distribution-Free Multiple Comparison contributor: fullname: Nemenyi – volume: 39 start-page: 1208 year: 2013 end-page: 1215 ident: b51 article-title: Data quality: Some comments on the nasa software defect datasets publication-title: IEEE Trans. Softw. Eng. contributor: fullname: Mair – volume: 32 start-page: 771 year: 2006 end-page: 789 ident: b63 article-title: Empirical analysis of object-oriented design metrics for predicting high and low severity faults publication-title: IEEE Trans. Softw. Eng. contributor: fullname: Leung – start-page: 125 year: 2012 end-page: 134 ident: b20 article-title: Using bug report similarity to enhance bug localisation publication-title: Reverse Engineering (WCRE), 2012 19th Working Conference on contributor: fullname: Wood – start-page: 12:1 year: 2016 end-page: 12:6 ident: b52 article-title: So you need more method level datasets for your software defect prediction?: Voilà! publication-title: Proceedings of the 10th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement contributor: fullname: Bowes – start-page: 330 year: 2016 end-page: 341 ident: b10 article-title: Mutation-aware fault prediction publication-title: Proceedings of the 25th International Symposium on Software Testing and Analysis contributor: fullname: Wu – start-page: 422 year: 2013 end-page: 431 ident: b21 article-title: Boa: A language and infrastructure for analyzing ultra-large-scale software repositories publication-title: Proceedings of the 2013 International Conference on Software Engineering contributor: fullname: Nguyen – year: 2007 ident: b17 article-title: Automatic Extraction of Bug Localization Benchmarks from History contributor: fullname: Zimmermann – start-page: 231 year: 1994 end-page: 244 ident: b48 article-title: Parametric measures of effect size publication-title: The Handbook of Research Synthesis, Vol. 621 contributor: fullname: Hedges – volume: 36 start-page: 7346 year: 2009 end-page: 7354 ident: b12 article-title: A systematic review of software fault prediction studies publication-title: Expert Syst. Appl. contributor: fullname: Diri – start-page: 15 year: 2011 end-page: 25 ident: b62 article-title: Relink: recovering links between bugs and changes publication-title: Proceedings of the 19th ACM SIGSOFT Symposium and the 13th European Conference on Foundations of Software Engineering contributor: fullname: Cheung – volume: 11 start-page: 86 year: 1940 end-page: 92 ident: b23 article-title: A comparison of alternative tests of significance for the problem of m rankings publication-title: Ann. Math. Stat. contributor: fullname: Friedman – volume: 31 start-page: 897 year: 2005 end-page: 910 ident: b26 article-title: Empirical validation of object-oriented metrics on open source software for fault prediction publication-title: IEEE Trans. Softw. Eng. contributor: fullname: Siket – start-page: 240 year: 2014 end-page: 246 ident: b28 article-title: Less is more: Temporal fault predictive performance over multiple hadoop releases publication-title: International Symposium on Search Based Software Engineering contributor: fullname: Srivisut – volume: 44 start-page: 811 year: 2018 end-page: 833 ident: b30 article-title: A comparative study to benchmark cross-project defect prediction approaches publication-title: IEEE Trans. Softw. Eng. contributor: fullname: Grabowski – start-page: 277 year: 2008 end-page: 286 ident: b9 article-title: Assessing the value of coding standards: An empirical study publication-title: Software Maintenance, 2008. ICSM 2008. IEEE International Conference on contributor: fullname: Moonen – start-page: 23 year: 2003 end-page: 32 ident: b22 article-title: Populating a release history database from version control and bug tracking systems publication-title: Software Maintenance, 2003. ICSM 2003. Proceedings. International Conference on contributor: fullname: Gall – year: 2013 ident: b56 article-title: Using version control history to follow the changes of source code elements publication-title: Software Maintenance and Reengineering (CSMR) contributor: fullname: Siket – start-page: 53 year: 2014 end-page: 63 ident: b58 article-title: Version history, similar report, and structure: Putting them together for improved bug localization publication-title: Proceedings of the 22nd International Conference on Program Comprehension contributor: fullname: Lo – volume: 33 start-page: 577 year: 2007 end-page: 591 ident: b6 article-title: Comparison and evaluation of clone detection tools publication-title: IEEE Trans. Softw. Eng. contributor: fullname: Merlo – start-page: 120 year: 2000 end-page: 130 ident: b41 article-title: Identifying reasons for software changes using historic databases publication-title: Software Maintenance, 2000. Proceedings. International Conference on contributor: fullname: Votta – start-page: 337 year: 2014 end-page: 352 ident: b2 article-title: Recognizing antipatterns and analyzing their effects on software maintainability publication-title: International Conference on Computational Science and Its Applications contributor: fullname: Ferenc – start-page: 433 year: 2007 end-page: 436 ident: b18 article-title: Extraction of bug localization benchmarks from history publication-title: Proceedings of the Twenty-Second IEEE/ACM International Conference on Automated Software Engineering contributor: fullname: Zimmermann – volume: 20 start-page: 476 year: 1994 end-page: 493 ident: b13 article-title: A metrics suite for object oriented design publication-title: IEEE Trans. Softw. Eng. contributor: fullname: Kemerer – start-page: 174 year: 1995 end-page: 189 ident: b36 article-title: The power of decision tables publication-title: 8th European Conference on Machine Learning contributor: fullname: Kohavi – volume: 74 start-page: 470 year: 2009 end-page: 495 ident: b49 article-title: Comparison and evaluation of code clone detection techniques and tools: A qualitative approach publication-title: Sci. Comput. Program. contributor: fullname: Koschke – volume: 112 start-page: 155 year: 1992 ident: b14 article-title: A power primer publication-title: Psychol. Bull. contributor: fullname: Cohen – start-page: 789 year: 2015 end-page: 800 ident: b24 article-title: Revisiting the impact of classification techniques on the performance of defect prediction models publication-title: Proceedings of the 37th International Conference on Software Engineering-Volume 1 contributor: fullname: Hassan – start-page: 47 year: 2015 end-page: 62 ident: b25 article-title: Characterization of source code defects by data mining conducted on github publication-title: International Conference on Computational Science and Its Applications contributor: fullname: Ferenc – volume: 39 start-page: 1208 issue: 9 year: 2013 ident: 10.1016/j.jss.2020.110691_b51 article-title: Data quality: Some comments on the nasa software defect datasets publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/TSE.2013.11 contributor: fullname: Shepperd – start-page: 15 year: 2011 ident: 10.1016/j.jss.2020.110691_b62 article-title: Relink: recovering links between bugs and changes contributor: fullname: Wu – year: 2010 ident: 10.1016/j.jss.2020.110691_b57 article-title: Detect related bugs from source code using bug information contributor: fullname: Wang – volume: 62 start-page: 434 issue: 2 year: 2013 ident: 10.1016/j.jss.2020.110691_b59 article-title: Using class imbalance learning for software defect prediction publication-title: IEEE Trans. Reliab. doi: 10.1109/TR.2013.2259203 contributor: fullname: Wang – volume: 10 start-page: 177 issue: 1 year: 2000 ident: 10.1016/j.jss.2020.110691_b8 article-title: Software development cost estimation approaches — A survey publication-title: Ann. Softw. Eng. doi: 10.1023/A:1018991717352 contributor: fullname: Boehm – start-page: 125 year: 2012 ident: 10.1016/j.jss.2020.110691_b20 article-title: Using bug report similarity to enhance bug localisation contributor: fullname: Davies – volume: 95 start-page: 161 issue: 1–2 year: 2005 ident: 10.1016/j.jss.2020.110691_b37 article-title: Logistic model trees publication-title: Mach. Learn. doi: 10.1007/s10994-005-0466-3 contributor: fullname: Landwehr – volume: 31 start-page: 897 issue: 10 year: 2005 ident: 10.1016/j.jss.2020.110691_b26 article-title: Empirical validation of object-oriented metrics on open source software for fault prediction publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/TSE.2005.112 contributor: fullname: Gyimothy – start-page: 345 year: 2013 ident: 10.1016/j.jss.2020.110691_b50 article-title: Improving bug localization using structured information retrieval contributor: fullname: Saha – start-page: 1 year: 2018 ident: 10.1016/j.jss.2020.110691_b3 article-title: Prediction models for performance, power, and energy efficiency of software executed on heterogeneous hardware publication-title: J. Supercomput. contributor: fullname: Bán – start-page: 1 year: 2005 ident: 10.1016/j.jss.2020.110691_b54 article-title: When do changes induce fixes? contributor: fullname: Śliwerski – year: 2007 ident: 10.1016/j.jss.2020.110691_b17 contributor: fullname: Dallmeier – start-page: 23 year: 2003 ident: 10.1016/j.jss.2020.110691_b22 article-title: Populating a release history database from version control and bug tracking systems contributor: fullname: Fischer – year: 2012 ident: 10.1016/j.jss.2020.110691_b64 article-title: Where should the bugs be fixed? more accurate information retrieval-based bug localization based on bug reports contributor: fullname: Zhou – start-page: 81 year: 2006 ident: 10.1016/j.jss.2020.110691_b35 article-title: Automatic identification of bug-introducing changes contributor: fullname: Kim – volume: 11 start-page: 86 issue: 1 year: 1940 ident: 10.1016/j.jss.2020.110691_b23 article-title: A comparison of alternative tests of significance for the problem of m rankings publication-title: Ann. Math. Stat. doi: 10.1214/aoms/1177731944 contributor: fullname: Friedman – volume: 21 start-page: 1263 issue: 9 year: 2009 ident: 10.1016/j.jss.2020.110691_b29 article-title: Learning from imbalanced data publication-title: IEEE Trans. Knowl. Data Eng. doi: 10.1109/TKDE.2008.239 contributor: fullname: He – start-page: 136 year: 2004 ident: 10.1016/j.jss.2020.110691_b11 article-title: Predicting class testability using object-oriented metrics contributor: fullname: Bruntink – year: 1993 ident: 10.1016/j.jss.2020.110691_b47 contributor: fullname: Quinlan – start-page: 223 year: 2012 ident: 10.1016/j.jss.2020.110691_b16 article-title: Uncovering causal relationships between software metrics and bugs contributor: fullname: Couto – year: 2005 ident: 10.1016/j.jss.2020.110691_b53 contributor: fullname: Shirabad – year: 2013 ident: 10.1016/j.jss.2020.110691_b56 article-title: Using version control history to follow the changes of source code elements contributor: fullname: Toth – volume: 31 start-page: 340 issue: 4 year: 2005 ident: 10.1016/j.jss.2020.110691_b43 article-title: Predicting the location and number of faults in large software systems publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/TSE.2005.49 contributor: fullname: Ostrand – start-page: 9 year: 2007 ident: 10.1016/j.jss.2020.110691_b65 article-title: Predicting defects for eclipse contributor: fullname: Zimmermann – volume: 32 start-page: 771 issue: 10 year: 2006 ident: 10.1016/j.jss.2020.110691_b63 article-title: Empirical analysis of object-oriented design metrics for predicting high and low severity faults publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/TSE.2006.102 contributor: fullname: Zhou – volume: 44 start-page: 811 issue: 9 year: 2018 ident: 10.1016/j.jss.2020.110691_b30 article-title: A comparative study to benchmark cross-project defect prediction approaches publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/TSE.2017.2724538 contributor: fullname: Herbold – start-page: 12:1 year: 2016 ident: 10.1016/j.jss.2020.110691_b52 article-title: So you need more method level datasets for your software defect prediction?: Voilà! contributor: fullname: Shippey – start-page: 243 year: 2011 ident: 10.1016/j.jss.2020.110691_b1 article-title: A probabilistic software quality model contributor: fullname: Bakota – start-page: 672 year: 2013 ident: 10.1016/j.jss.2020.110691_b32 article-title: Why don’t software developers use static analysis tools to find bugs? contributor: fullname: Johnson – start-page: 174 year: 1995 ident: 10.1016/j.jss.2020.110691_b36 article-title: The power of decision tables contributor: fullname: Kohavi – start-page: 92 year: 2014 ident: 10.1016/j.jss.2020.110691_b34 article-title: The promises and perils of mining github contributor: fullname: Kalliamvakou – start-page: 277 year: 2008 ident: 10.1016/j.jss.2020.110691_b9 article-title: Assessing the value of coding standards: An empirical study contributor: fullname: Boogerd – year: 2018 ident: 10.1016/j.jss.2020.110691_b15 contributor: fullname: Coles – start-page: 433 year: 2007 ident: 10.1016/j.jss.2020.110691_b18 article-title: Extraction of bug localization benchmarks from history contributor: fullname: Dallmeier – volume: 7 start-page: 46 issue: 2 year: 1990 ident: 10.1016/j.jss.2020.110691_b46 article-title: Empirically guided software development using metric-based classification trees publication-title: IEEE Softw. doi: 10.1109/52.50773 contributor: fullname: Porter – start-page: 31 year: 2010 ident: 10.1016/j.jss.2020.110691_b19 article-title: An extensive comparison of bug prediction approaches contributor: fullname: D’Ambros – start-page: 337 year: 2014 ident: 10.1016/j.jss.2020.110691_b2 article-title: Recognizing antipatterns and analyzing their effects on software maintainability contributor: fullname: Bán – start-page: 219 year: 2007 ident: 10.1016/j.jss.2020.110691_b44 article-title: Automating algorithms for the identification of fault-prone files contributor: fullname: Ostrand – start-page: 32 year: 2008 ident: 10.1016/j.jss.2020.110691_b61 article-title: Szz revisited: verifying when changes induce fixes contributor: fullname: Williams – start-page: 1 year: 2009 ident: 10.1016/j.jss.2020.110691_b7 article-title: The promises and perils of mining git contributor: fullname: Bird – start-page: 10 year: 2012 ident: 10.1016/j.jss.2020.110691_b4 article-title: Locating source code to be fixed based on initial bug reports - A case study on the eclipse project contributor: fullname: Bangcharoensap – start-page: 53 year: 2014 ident: 10.1016/j.jss.2020.110691_b58 article-title: Version history, similar report, and structure: Putting them together for improved bug localization contributor: fullname: Wang – year: 2018 ident: 10.1016/j.jss.2020.110691_b31 – ident: 10.1016/j.jss.2020.110691_b45 doi: 10.1145/2915970.2916007 – volume: 74 start-page: 470 issue: 7 year: 2009 ident: 10.1016/j.jss.2020.110691_b49 article-title: Comparison and evaluation of code clone detection techniques and tools: A qualitative approach publication-title: Sci. Comput. Program. doi: 10.1016/j.scico.2009.02.007 contributor: fullname: Roy – start-page: 9 year: 2010 ident: 10.1016/j.jss.2020.110691_b33 article-title: Towards identifying software project clusters with regard to defect prediction contributor: fullname: Jureczko – volume: 112 start-page: 155 issue: 1 year: 1992 ident: 10.1016/j.jss.2020.110691_b14 article-title: A power primer publication-title: Psychol. Bull. doi: 10.1037/0033-2909.112.1.155 contributor: fullname: Cohen – start-page: 789 year: 2015 ident: 10.1016/j.jss.2020.110691_b24 article-title: Revisiting the impact of classification techniques on the performance of defect prediction models contributor: fullname: Ghotra – volume: 1 start-page: 80 issue: 6 year: 1945 ident: 10.1016/j.jss.2020.110691_b60 article-title: Individual comparisons by ranking methods publication-title: Biom. Bull. doi: 10.2307/3001968 contributor: fullname: Wilcoxon – start-page: 330 year: 2016 ident: 10.1016/j.jss.2020.110691_b10 article-title: Mutation-aware fault prediction contributor: fullname: Bowes – volume: 33 start-page: 577 issue: 9 year: 2007 ident: 10.1016/j.jss.2020.110691_b6 article-title: Comparison and evaluation of clone detection tools publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/TSE.2007.70725 contributor: fullname: Bellon – volume: 20 start-page: 476 issue: 6 year: 1994 ident: 10.1016/j.jss.2020.110691_b13 article-title: A metrics suite for object oriented design publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/32.295895 contributor: fullname: Chidamber – start-page: 120 year: 2000 ident: 10.1016/j.jss.2020.110691_b41 article-title: Identifying reasons for software changes using historic databases contributor: fullname: Mockus – volume: 12 start-page: 161 issue: 3 year: 2018 ident: 10.1016/j.jss.2020.110691_b38 article-title: Progress on approaches to software defect prediction publication-title: IET Softw. doi: 10.1049/iet-sen.2017.0148 contributor: fullname: Li – start-page: 625 year: 2016 ident: 10.1016/j.jss.2020.110691_b55 article-title: A public bug database of github projects and its application in bug prediction contributor: fullname: Tóth – volume: 36 start-page: 7346 issue: 4 year: 2009 ident: 10.1016/j.jss.2020.110691_b12 article-title: A systematic review of software fault prediction studies publication-title: Expert Syst. Appl. doi: 10.1016/j.eswa.2008.10.027 contributor: fullname: Catal – volume: 23 start-page: 33 issue: 4 year: 2014 ident: 10.1016/j.jss.2020.110691_b27 article-title: Some code smells have a significant but small effect on faults publication-title: ACM Trans. Softw. Eng. Methodol. (TOSEM) doi: 10.1145/2629648 contributor: fullname: Hall – volume: 22 start-page: 751 issue: 10 year: 1996 ident: 10.1016/j.jss.2020.110691_b5 article-title: A validation of object-oriented design metrics as quality indicators publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/32.544352 contributor: fullname: Basili – start-page: 422 year: 2013 ident: 10.1016/j.jss.2020.110691_b21 article-title: Boa: A language and infrastructure for analyzing ultra-large-scale software repositories contributor: fullname: Dyer – start-page: 231 year: 1994 ident: 10.1016/j.jss.2020.110691_b48 article-title: Parametric measures of effect size contributor: fullname: Rosenthal – volume: 45 start-page: 391 issue: 4 year: 2019 ident: 10.1016/j.jss.2020.110691_b39 article-title: On the multiple sources and privacy preservation issues for heterogeneous defect prediction publication-title: IEEE Transactions on Software Engineering doi: 10.1109/TSE.2017.2780222 contributor: fullname: Li – start-page: 240 year: 2014 ident: 10.1016/j.jss.2020.110691_b28 article-title: Less is more: Temporal fault predictive performance over multiple hadoop releases contributor: fullname: Harman – start-page: 47 year: 2015 ident: 10.1016/j.jss.2020.110691_b25 article-title: Characterization of source code defects by data mining conducted on github contributor: fullname: Gyimesi – start-page: 237 year: 2006 ident: 10.1016/j.jss.2020.110691_b40 article-title: A statistical framework for the prediction of fault-proneness contributor: fullname: Ma – year: 1963 ident: 10.1016/j.jss.2020.110691_b42 contributor: fullname: Nemenyi |
SSID | ssj0007202 |
Score | 2.4995437 |
Snippet | Bugs are inescapable during software development due to frequent code changes, tight deadlines, etc.; therefore, it is important to have tools to find these... |
SourceID | crossref elsevier |
SourceType | Aggregation Database Publisher |
StartPage | 110691 |
SubjectTerms | Bug dataset Bug prediction Code metrics GitHub Machine learning Static code analysis |
Title | An automatically created novel bug dataset and its validation in bug prediction |
URI | https://dx.doi.org/10.1016/j.jss.2020.110691 |
Volume | 169 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1LSwMxEB76uHjxLdZHycGTsNZNstn0WIqlKtaDFnpbsnnIStmWdit48bebZHdFQS8eN2QgfJv5MmG-zABcCEVdvoUFMU1JQK27WZ8TaaC4SY0mWmJf8eZhwsZTejeLZg0Y1m9hnKyy4v6S0z1bVyO9Cs3eMst6T644VGiZF_trAWFNaPskUQvag9v78eSLkGPspYdufuAM6uSml3m9rl3Rbuz18Kwf_n48fTtyRruwXcWKaFAuZw8aOt-HnboPA6rc8gAeBzkSm2Lhq6-K-fwd-VBQK5Qv3vQcpZsX5JSga10gkSuUFWtkN1hWtlNCWe5nLFcuZ-NGDmE6unkejoOqUUIgCb0uAs0jzpjQLmASRonISBNjiSVVWBvNNWVYcaoVF0SG3BATmpS7SK8v-rH16yNo5YtcHwMSMsYRJ6GIiL00U8mVDIkKJdPMsDQyHbis8UmWZT2MpBaKvSYWzMSBmZRgdoDWCCY_fmpi-fpvs5P_mZ3ClvsqHwqeQatYbfS5jRiKtAvNq4-wW-2LT9LUv7c |
link.rule.ids | 315,783,787,4511,24130,27938,27939,45599,45693 |
linkProvider | Elsevier |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV3NS8MwFA9zO-jFb3F-5uBJKLNJmqbHMZTOfXhwg91Kmg_pGN3YOsH_3iRtRUEvXtM8CL_m_fLC--U9AO64JDbfQr2QpNgjxt2Mz_HUk0ynWmElkKt4MxrTeEqeZ8GsAXr1Wxgrq6y4v-R0x9bVSKdCs7PKss6rLQ7lG-ZF7lqA6Q5omWggMpu91e0P4vEXIYfISQ_tfM8a1MlNJ_Oab2zRbuT08DTyfz-evh05T4dgv4oVYbdczhFoqPwYHNR9GGDllifgpZtDvi2WrvoqXyw-oAsFlYT58l0tYLp9g1YJulEF5LmEWbGBZoNlZTslmOVuxmptczZ25BRMnx4nvdirGiV4ApOHwlMsYJRyZQMmriUPtNAhEkgQiZRWTBGKJCNKMo6FzzTWvk6ZjfQiHoXGr89AM1_m6hxALkIUMOzzAJtLMxFMCh9LX1BFNU0D3Qb3NT7JqqyHkdRCsXliwEwsmEkJZhuQGsHkx09NDF__bXbxP7NbsBtPRsNk2B8PLsGe_VI-GrwCzWK9VdcmeijSm2p3fAKPWsG0 |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=An+automatically+created+novel+bug+dataset+and+its+validation+in+bug+prediction&rft.jtitle=The+Journal+of+systems+and+software&rft.au=Ferenc%2C+Rudolf&rft.au=Gyimesi%2C+P%C3%A9ter&rft.au=Gyimesi%2C+G%C3%A1bor&rft.au=T%C3%B3th%2C+Zolt%C3%A1n&rft.date=2020-11-01&rft.issn=0164-1212&rft.volume=169&rft.spage=110691&rft_id=info:doi/10.1016%2Fj.jss.2020.110691&rft.externalDBID=n%2Fa&rft.externalDocID=10_1016_j_jss_2020_110691 |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0164-1212&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0164-1212&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0164-1212&client=summon |