Smells in system user interactive tests
Test smells are known as bad development practices that reflect poor design and implementation choices in software tests. Over the last decade, there are few attempts to study test smells in the context of system tests that interact with the System Under Test through a Graphical User Interface. To f...
Saved in:
| Published in | Empirical software engineering : an international journal Vol. 28; no. 1; p. 20 |
|---|---|
| Main Authors | , , , , |
| Format | Journal Article |
| Language | English |
| Published |
New York
Springer US
01.01.2023
Springer Nature B.V |
| Subjects | |
| Online Access | Get full text |
Cover
Loading…
| Abstract | Test smells are known as bad development practices that reflect poor design and implementation choices in software tests. Over the last decade, there are few attempts to study test smells in the context of system tests that interact with the System Under Test through a Graphical User Interface. To fill the gap, we conduct an exploratory analysis of test smells occurring in System User Interactive Tests (SUIT). We thus, compose a catalog of 35 SUIT-specific smells, identified through a multi-vocal literature review, and show how they differ from smells encountered in unit tests. We also conduct an empirical analysis to assess the diffuseness and removal of these smells in 48 industrial repositories and 12 open-source projects. Our results show that the same type of smells tends to appear in both industrial and open-source projects, but they are not addressed in the same way. We also find that smells originating from a combination of multiple code locations appear more often than those that are localized on a single line. This happens because of the difficulty to observe non-local smells without tool support. Furthermore, we find that smell-removing actions are not frequent with less than 50% of the affected tests ever undergoing a smell removal. Interestingly, while smell-removing actions are rare, some smells disappear while discarding tests, i.e., these smells do not appear in follow-up tests that replace the discarded ones. |
|---|---|
| AbstractList | Test smells are known as bad development practices that reflect poor design and implementation choices in software tests. Over the last decade, there are few attempts to study test smells in the context of system tests that interact with the System Under Test through a Graphical User Interface. To fill the gap, we conduct an exploratory analysis of test smells occurring in System User Interactive Tests (SUIT). We thus, compose a catalog of 35 SUIT-specific smells, identified through a multi-vocal literature review, and show how they differ from smells encountered in unit tests. We also conduct an empirical analysis to assess the diffuseness and removal of these smells in 48 industrial repositories and 12 open-source projects. Our results show that the same type of smells tends to appear in both industrial and open-source projects, but they are not addressed in the same way. We also find that smells originating from a combination of multiple code locations appear more often than those that are localized on a single line. This happens because of the difficulty to observe non-local smells without tool support. Furthermore, we find that smell-removing actions are not frequent with less than 50% of the affected tests ever undergoing a smell removal. Interestingly, while smell-removing actions are rare, some smells disappear while discarding tests, i.e., these smells do not appear in follow-up tests that replace the discarded ones. |
| ArticleNumber | 20 |
| Author | Brasseur, Marie-Claude Habchi, Sarra Papadakis, Mike Rwemalika, Renaud Le Traon, Yves |
| Author_xml | – sequence: 1 givenname: Renaud orcidid: 0000-0003-2945-0286 surname: Rwemalika fullname: Rwemalika, Renaud email: renaud.rwemalika@hotmail.com organization: University of Luxembourg – sequence: 2 givenname: Sarra surname: Habchi fullname: Habchi, Sarra organization: University of Luxembourg – sequence: 3 givenname: Mike surname: Papadakis fullname: Papadakis, Mike organization: University of Luxembourg – sequence: 4 givenname: Yves surname: Le Traon fullname: Le Traon, Yves organization: University of Luxembourg – sequence: 5 givenname: Marie-Claude surname: Brasseur fullname: Brasseur, Marie-Claude organization: BGL BNP Paribas |
| BookMark | eNp9kEtLw0AQxxepYFv9Ap4CHjytzuwzOUrxBQUP6nlJtxNpaZO6kwr99m6N4M3TPPg_4DcRo7ZrSYhLhBsE8LeM4JyRoJREUBYlnogxWq-ld-hGedelklpZdyYmzGsAqLyxY3H9uqXNhotVW_CBe9oWe6aUz55SHfvVFxU9cc_n4rSpN0wXv3Mq3h_u32ZPcv7y-Dy7m8uoTNVLu7DkbE2VNpocmqVXRscmP0obYwWlXoArFy5WTe2xQmwwlmqprV8qMhb0VFwNubvUfe5zc1h3-9TmyqC8tQAIiFmlBlVMHXOiJuzSalunQ0AIRyBhABIykPADJBxNejBxFrcflP6i_3F9Aww5Yxk |
| CitedBy_id | crossref_primary_10_1007_s00500_023_08741_5 crossref_primary_10_1007_s10664_023_10436_2 crossref_primary_10_3390_computers13030079 |
| Cites_doi | 10.1109/TSE.2007.70745 10.1145/3368089.3417921 10.1007/s10664-014-9313-0 10.1109/ICSTE.2010.5608882 10.1109/ICSTW.2015.7107403 10.1109/HICSS.2010.344 10.1145/3338906.3338970 10.1145/2950290.2950294 10.1109/ICST.2019.00040 10.1145/2491411.2491450 10.1109/CSMR.2012.12 10.1007/s10664-015-9378-4 10.1145/3422392.3422412 10.1145/3379597.3387453 10.1109/ICSME.2018.00010 10.1145/142750.142789 10.1145/2593812.2593817 10.1109/WSE.2012.6320526 10.1109/ICPC.2015.20 10.1016/j.jss.2017.12.013 10.1109/ISSREW.2014.17 10.1109/ICSE.2009.5070522 10.1145/174800.174808 10.1109/ICDCSW.2011.20 10.1002/stvr.1754 10.5381/jot.2007.6.9.a12 10.1145/2970276.2970340 10.1109/ICSM.2012.6405253 10.1109/ICAL.2008.4636415 10.1109/SANER.2019.8667976 10.1145/3236454.3236489 10.1007/978-3-030-67731-2_35 10.1109/ICSM.2004.1357820 10.1145/200968.200971 10.1007/978-3-540-73101-6_16 10.1109/ICSE.2015.28 10.1016/j.jss.2016.02.047 10.1109/ICSTW.2016.47 10.1109/ICST.2013.45 10.1109/ICSE.2013.6606682 10.1145/2931037.2931054 10.1016/S0065-2458(10)80003-8 10.1109/TSE.2014.2342227 10.1109/ASE.2017.8115711 10.1109/WETSoM.2017.2 10.1109/WETSoM.2017.2 10.1109/MSR.2017.14 10.1002/stvr.1760 10.1145/3106237.3106288 10.1145/1321631.1321695 10.1109/ICST.2016.16 10.1145/312203.312214 10.1145/2610384.2610404 10.1109/QSIC.2009.47 10.1016/j.infsof.2013.03.004 10.1002/stvr.456 10.1109/MSR.2019.00072 10.1016/j.jss.2019.07.016 10.5120/21262-3533 10.1145/151640.151643 10.1109/ASE.2019.00103 10.1145/3377812.3382176 10.1145/2002931.2002932 10.1007/s10515-013-0128-9 10.1109/SNPD.2012.10 10.1109/TR.2018.2869227 10.1109/ICSE.2013.6606553 10.1109/ICSM.2006.18 10.1145/3293882.3339003 10.1007/978-3-540-72563-3_7 10.1109/ACCESS.2019.2895504 10.1109/ICST.2009.11 10.1109/ICSTW50294.2020.00029 |
| ContentType | Journal Article |
| Copyright | The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2022. Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law. |
| Copyright_xml | – notice: The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2022. Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law. |
| DBID | AAYXX CITATION 7SC 8FD 8FE 8FG ABJCF AFKRA ARAPS BENPR BGLVJ CCPQU DWQXO HCIFZ JQ2 L6V L7M L~C L~D M7S P5Z P62 PQEST PQQKQ PQUKI PRINS PTHSS S0W |
| DOI | 10.1007/s10664-022-10251-1 |
| DatabaseName | CrossRef Computer and Information Systems Abstracts Technology Research Database ProQuest SciTech Collection ProQuest Technology Collection Materials Science & Engineering Collection ProQuest Central Advanced Technologies & Aerospace Collection ProQuest Central Technology Collection ProQuest One Community College ProQuest Central Korea SciTech Premium Collection ProQuest Computer Science Collection ProQuest Engineering Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional Engineering Database Advanced Technologies & Aerospace Database ProQuest Advanced Technologies & Aerospace Collection ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Academic ProQuest One Academic UKI Edition ProQuest Central China Engineering Collection DELNET Engineering & Technology Collection |
| DatabaseTitle | CrossRef Technology Collection Technology Research Database Computer and Information Systems Abstracts – Academic ProQuest Advanced Technologies & Aerospace Collection ProQuest Computer Science Collection Computer and Information Systems Abstracts SciTech Premium Collection ProQuest One Community College ProQuest Central China ProQuest Central ProQuest Engineering Collection ProQuest Central Korea Advanced Technologies Database with Aerospace Engineering Collection Advanced Technologies & Aerospace Collection Engineering Database ProQuest One Academic Eastern Edition ProQuest Technology Collection ProQuest SciTech Collection Computer and Information Systems Abstracts Professional Advanced Technologies & Aerospace Database ProQuest One Academic UKI Edition ProQuest DELNET Engineering and Technology Collection Materials Science & Engineering Collection ProQuest One Academic |
| DatabaseTitleList | Technology Collection |
| Database_xml | – sequence: 1 dbid: 8FG name: ProQuest Technology Collection url: https://search.proquest.com/technologycollection1 sourceTypes: Aggregation Database |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Computer Science |
| EISSN | 1573-7616 |
| ExternalDocumentID | 10_1007_s10664_022_10251_1 |
| GrantInformation_xml | – fundername: fonds national de la recherche luxembourg grantid: AFR PHD 11278802 funderid: https://doi.org/10.13039/501100001866 |
| GroupedDBID | -4Z -59 -5G -BR -EM -Y2 -~C .86 .DC .VR 06D 0R~ 0VY 199 1N0 1SB 2.D 203 28- 29G 2J2 2JN 2JY 2KG 2LR 2P1 2VQ 2~H 30V 4.4 406 408 409 40D 40E 5GY 5QI 5VS 67Z 6NX 78A 8FE 8FG 8TC 8UJ 95- 95. 95~ 96X AABHQ AABYN AAFGU AAHNG AAIAL AAJKR AANZL AAOBN AAPBV AARHV AARTL AATNV AATVU AAUYE AAWCG AAWWR AAYFA AAYIU AAYOK AAYQN AAYTO ABBBX ABBXA ABDZT ABECU ABFGW ABFTD ABFTV ABHLI ABHQN ABJCF ABJNI ABJOX ABKAS ABKCH ABKTR ABMNI ABMQK ABNWP ABQBU ABSXP ABTEG ABTHY ABTKH ABTMW ABULA ABWNU ABXPI ACBMV ACBRV ACBXY ACBYP ACGFS ACHSB ACHXU ACIGE ACIPQ ACIWK ACKNC ACMDZ ACMLO ACOKC ACOMO ACSNA ACTTH ACVWB ACWMK ADGRI ADHHG ADHIR ADIMF ADINQ ADKNI ADKPE ADMDM ADOXG ADRFC ADTPH ADURQ ADYFF ADZKW AEBTG AEEQQ AEFIE AEFTE AEGAL AEGNC AEJHL AEJRE AEKMD AENEX AEOHA AEPYU AESKC AESTI AETLH AEVLU AEVTX AEXYK AEYWE AFEXP AFGCZ AFKRA AFLOW AFNRJ AFQWF AFWTZ AFZKB AGAYW AGDGC AGGBP AGGDS AGJBK AGMZJ AGQMX AGWIL AGWZB AGYKE AHAVH AHBYD AHKAY AHSBF AHYZX AIAKS AIIXL AILAN AIMYW AITGF AJBLW AJDOV AJRNO AJZVZ AKQUC ALMA_UNASSIGNED_HOLDINGS ALWAN AMKLP AMXSW AMYLF AMYQR AOCGG ARAPS ARMRJ ASPBG AVWKF AXYYD AYJHY AZFZN B-. BA0 BBWZM BDATZ BENPR BGLVJ BGNMA CAG CCPQU COF CS3 CSCUP DDRTE DL5 DNIVK DPUIP DU5 EBLON EBS EIOEI EJD ESBYG FEDTE FERAY FFXSO FIGPU FINBP FNLPD FRRFC FSGXE FWDCC GGCAI GGRSB GJIRD GNWQR GQ6 GQ7 GQ8 GXS HCIFZ HF~ HG5 HG6 HMJXF HQYDN HRMNR HVGLF HZ~ I09 IHE IJ- IKXTQ ITM IWAJR IXC IZIGR IZQ I~X I~Z J-C J0Z JBSCW JCJTX JZLTJ KDC KOV KOW L6V LAK LLZTM M4Y M7S MA- N2Q NB0 NDZJH NPVJJ NQJWS NU0 O9- O93 O9G O9I O9J OAM P19 P62 P9O PF0 PT4 PT5 PTHSS Q2X QOK QOS R4E R89 R9I RHV RNI RNS ROL RPX RSV RZC RZE RZK S0W S16 S1Z S26 S27 S28 S3B SAP SCJ SCLPG SCO SDH SDM SHX SISQX SJYHP SNE SNPRN SNX SOHCF SOJ SPISZ SRMVM SSLCW STPWE SZN T13 T16 TSG TSK TSV TUC U2A UG4 UNUBA UOJIU UTJUX UZXMN VC2 VFIZW W23 W48 WK8 YLTOR Z45 Z7R Z7S Z7V Z7X Z7Z Z81 Z83 Z86 Z88 Z8M Z8N Z8P Z8R Z8T Z8U Z8W Z92 ZMTXR ~EX AACDK AAEOY AAJBT AASML AAYXX ABAKF ACAOD ACDTI ACZOJ AEFQL AEMSY AFBBN AGQEE AGRTI AIGIU CITATION H13 7SC 8FD DWQXO JQ2 L7M L~C L~D PQEST PQQKQ PQUKI PRINS |
| ID | FETCH-LOGICAL-c249t-5b5e65ae9343e614d7243cfae985cc9083b068b6c9fa71911f1c82d357d2e4503 |
| IEDL.DBID | 8FG |
| ISSN | 1382-3256 |
| IngestDate | Thu Oct 10 15:30:35 EDT 2024 Thu Sep 12 18:57:08 EDT 2024 Sat Dec 16 12:05:55 EST 2023 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 1 |
| Keywords | Test smells Multivocal literature review Refactoring System user interface tests GUI tests |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c249t-5b5e65ae9343e614d7243cfae985cc9083b068b6c9fa71911f1c82d357d2e4503 |
| ORCID | 0000-0003-2945-0286 |
| PQID | 2755001011 |
| PQPubID | 326341 |
| ParticipantIDs | proquest_journals_2755001011 crossref_primary_10_1007_s10664_022_10251_1 springer_journals_10_1007_s10664_022_10251_1 |
| PublicationCentury | 2000 |
| PublicationDate | 2023-01-01 |
| PublicationDateYYYYMMDD | 2023-01-01 |
| PublicationDate_xml | – month: 01 year: 2023 text: 2023-01-01 day: 01 |
| PublicationDecade | 2020 |
| PublicationPlace | New York |
| PublicationPlace_xml | – name: New York – name: Dordrecht |
| PublicationSubtitle | An International Journal |
| PublicationTitle | Empirical software engineering : an international journal |
| PublicationTitleAbbrev | Empir Software Eng |
| PublicationYear | 2023 |
| Publisher | Springer US Springer Nature B.V |
| Publisher_xml | – name: Springer US – name: Springer Nature B.V |
| References | Van RB, Du Bois B, Demeyer S, Rieger M (2007) On the detection of test smells: a metrics-based approach for general fixture and eager test. IEEE Trans Soft Eng 33(12):800–817. https://doi.org/10.1109/TSE.2007.70745 Knight A (2019) Bdd 101: Writing good gherkin. https://techbeacon.com/app-dev-testing/7-ways-tidy-your-test-code Zhang S, Jalali D, Wuttke J, Muşlu K, Lam W, Ernst MD, Notkin D (2014) Empirically revisiting the test independence assumption. In: Proceedings of the international symposium on software testing and analysis, ACM Press, New York,USA, pp 385–396. https://doi.org/10.1145/2610384.2610404 Chen WK, Wang JC (2012) Bad smells and refactoring methods for GUI test scripts. In: Proceedings of the 13th international conference on software engineering, artificial intelligence, networking, and parallel/distributed computing pp 289–294. https://doi.org/10.1109/SNPD.2012.10 Hammoudi M, Rothermel G, Stocco A (2016a) WATERFALL: an incremental approach for repairing record-replay tests of web applications. In: Proceedings of the 24th ACM SIGSOFT international symposium on foundations of software engineering, ACM, New York, NY, USA, vol 13-18-Nove, pp 751–762. https://doi.org/10.1145/2950290.2950294 Gupta P, Surve P (2011). In: Proceedings of the 1st ACM international workshop on end-to-end test script engineering, ACM Press, New York, USA, pp 1–7.https://doi.org/10.1145/2002931.2002932 Hurdugaci V, Zaidman A (2012) Aiding software developers to maintain developer tests. In: Proceedings of 16th european conference on software maintenance and Reengineering, IEEE, pp 11–20 Tufano M, Palomba F, Bavota G, Di Penta M, Oliveto R, De Lucia A, Poshyvanyk D (2016) An empirical investigation into the nature of test smells. In: Proceedings of the 31st international conference on automated software engineering, ACM Press, Singapore, pp 4–15. https://doi.org/10.1145/2970276.2970340 Rwemalika R, Kintis M, Papadakis M, Le Traon Y, Lorrach P (2019a) On the evolution of keyword-driven test suites. In: Proceedings of the 12th international conference on software testing, verification and validation, New York, NY, USA, pp 335-345 Virgi̇nio T, Martins LA, Soares LR, Santana R, Costa H, Machado I (2020) An empirical study of automatically-generated tests from the perspective of test smells. In: Proceedings of the 34th Brazilian symposium on software engineering, ACM, New York, NY, USA, pp 92–96.https://doi.org/10.1145/3422392.3422412 Machiry A, Tahiliani R, Naik M (2013) Dynodroid: an input generation system for Android apps. In: Proceedings of the 9th joint meeting on foundations of software engineering, ACM Press, New York, USA, pp 224. https://doi.org/10.1145/2491411.2491450 ArcelliFFMäntyläMVZanoniMMarinoAComparing and experimenting machine learning techniques for code smell detectionEmpir Softw Eng20162131143119110.1007/s10664-015-9378-4https://doi.org/10.1007/s10664-015-9378-4 https://doi.org/10.1007/s10664-015-9378-4 Hauptmann B, Eder S, Junker M, Juergens E, Woinke V (2015) Generating Refactoring Proposals to remove clones from automated system tests. In: Proceedings of the 23rd international conference on program comprehension, IEEE, vol 2015-August, pp 115–124. https://doi.org/10.1109/ICPC.2015.20 Spadini D, Schvarcbacher M, Oprescu AM, Bruntink M, Bacchelli A (2020) Investigating severity thresholds for test smells. In: Proceedings of the 17th international conference on mining software repositories, ACM, New York, NY, USA, pp 311–321. https://doi.org/10.1145/3379597.3387453 SalihuIAIbrahimRAhmedBSZamliKZUsmanAAMOGA: A static-dynamic model generation strategy for mobile Apps testingIEEE Access20197c171581717310.1109/ACCESS.2019.2895504https://doi.org/10.1109/ACCESS.2019.2895504 Khomh F, Vaucher S, Guéhéneuc YG, Sahraoui H (2009) A bayesian approach for the detection of code and design smells. In: Proceedings of the 9th international conference on quality software. IEEE Comput Soc, USA, pp 305–314. https://doi.org/10.1109/QSIC.2009.47 Hammoudi M, Rothermel G, Tonella P (2016b) Why do Record/Replay Tests of Web Applications Break?. In: Proceedings of the international conference on software testing, verification and validation, IEEE, pp 180–190 Battat M (2020) How do you simplify end-to-end test maintenance?. https://dzone.com/articles/how-do-you-simplify-end-to-end-test-maintenance-auhttps://dzone.com/articles/how-do-you-simplify-end-to-end-test-maintenance-au Saddler JA, Cohen MB (2017) EventFlowSlicer: A tool for generating realistic goal-driven GUI tests. In: Proceedings of the 32nd international conference on automated software engineering, ASE, IEEE, pp 955–960. https://doi.org/10.1109/ASE.2017.8115711 Klarck P (2014) Robot framework dos and don’ts. https://slideshare.net/pekkaklarck/robot-framework-dos-and-donts Marinescu R (2004) Detection strategies: metrics-based rules for detecting design flaws. In: Proceedings of the 20th IEEE international conference on software maintenance, IEEE, pp 350–359. https://doi.org/10.1109/ICSM.2004.1357820 Yu S, Fang C, Feng Y, Zhao W, Chen Z (2019) LIRAT: layout and image recognition driving automated mobile testing of cross-platform. In: Proceedings of the 34th international conference on automated software engineering, IEEE, pp 1066–1069 https://doi.org/10.1109/ASE.2019.00103 LeottaMStoccoARiccaFTonellaPRobula+: an algorithm for generating robust XPath locators for web testingJ softw: Evol Process2016283177204 Katalon (2018) The most striking problems in test automation : A survey. Tech Rep May, Katalon GranoGPalombaFDi NucciDDe LuciaAGallHCScented since the beginning: On the diffuseness of test smells in automatically generated test codeJ Syst Softw201915631232710.1016/j.jss.2019.07.016https://doi.org/10.1016/j.jss.2019.07.016 Issa A, Sillito J, Garousi V (2012) Visual testing of graphical user interfaces: an exploratory study towards systematic definitions and approaches. In: Proceedings of the international symposium on web systems evolution, IEEE, pp 11–15. https://doi.org/10.1109/WSE.2012.6320526 Leotta M, Stocco A, Ricca F, Tonella P (2014) Reducing web test cases aging by means of robust XPath locators. In: Proceedings of the IEEE international symposium on software reliability engineering workshops, IEEE, pp 449–454 Kapelonis K (2018) Software testing anti-patterns. http://blog.codepipes.com/testing/software-testing-antipatterns.htmlhttp://blog.codepipes.com/testing/software-testing-antipatterns.html Shay L (2019) Bdd cucumber features best practices. https://www.linkedin.com/pulse/bdd-cucumber-features-best-practices-liraz-shay Lanubile F, Mallardo T (2007) Inspecting automated test code: a preliminary study. In: Agile processes in software engineering and extreme programming, vol 4536, LNCS, Springer Berlin Heidelberg, pp 115–122. https://doi.org/10.1007/978-3-540-73101-6_16 Morlion P (2019) Software testing anti patterns. https://www.enov8.com/blog/software-testing-anti-patterns BanerjeeINguyenBGarousiVMemonAGraphical user interface (GUI) testing: Systematic mapping and repositoryInf Softw Technol201355101679169410.1016/j.infsof.2013.03.004https://doi.org/10.1016/j.infsof.2013.03.004 Cripsin L (2018) Keep your automated testing simple and avoid anti-patterns. https://www.mabl.com/blog/keep-your-automated-testing-simple PanditPTahilianiSAgile UAT: a framework for user acceptance testing based on user stories and acceptance criteriaInt J Comput Appl2015120101621https://doi.org/10.5120/21262-3533 Sciamanna A (2019) What are the anti patterns of automation with selenium? https://anthonysciamanna.com/2019/10/20/avoiding-automated-testing-pitfalls.html Mabl (2021) Benchmark report : the state of testing in DeVops Tsantalis N, Guana V, Stroulia E, Hindle A (2013) A multidimensional empirical study on Refactoring cctivity. In: Proceedings of the conference of the center for advanced studies on collaborative research, IBM Corp, Ontario, Canada, pp 132–146 Silva D, Valente MT (2017) RefDiff: detecting Refactorings in version histories. In: Proceedings of the 14th international conference on mining software repositories, IEEE, pp 269–279. arXiv:1704.01544. https://doi.org/10.1109/MSR.2017.14 Myers BA, Rosson MB (1992) Survey on user interface programming. In: Proceedings of the conference on Human factors in computing systems, ACM Press, New York, USA, pp 195–202. https://doi.org/10.1145/142750.142789 Peruma A, Almalki K, Newman C D, Mkaouer M W, Ouni A, Palomba F (2020) tsDetect: an open-source test smells detection tool. In: Proceedings of the 28th joint meeting on European software engineering conference and symposium on the foundations of software engineering, ACM, New York, NY, USA, pp 1650-1654. https://doi.org/10.1145/3368089.3417921 Advolodkin N (2018) Top 17 automated testing best practices (supported by data). https://ultimateqa.com/automation-patterns-antipatterns Di MartinoSFasolinoARStaraceLLLTramontanaPComparing the effectiveness of capture and replay against automatic input generation for Android graphical user interface testingSoftw Test Verif Reliab202131327228510.1002/stvr.1754https://doi.org/10.1002/stvr.1754 AthanasiouDNugrohoAVisserJZaidmanATest code quality and its relation to issue handling performanceIEEE Trans Softw Eng201440111100112510.1109/TSE.2014.2342227https://doi.org/10.1109/TSE.2014.2342227 Gao Z, Liang Y, Cohen MB, Memon AM, Wang Z (2015) Making System User Interactive Tests Repeatable: When and What Should We Control?. In: Proceedings of the 37th International Conference on Software Engineering, IEEE, vol 1, pp 55–65, https://doi.org/10.1109/ICSE.2015.28 CoppolaRMorisioMTorchianoMMobile GUI testing fragility: a study on open-source android applicationsIEEE Trans Reliab2019681679010.1109/TR.2018.2869227https://doi.org/10.1109/TR.2018.2869227 Rwemalika R, Kintis M, Papadakis M, Le Traon Y, Lorrach P (2019b) Ukwikora: continuous inspection for keyword-driven testing. In: Proceedings of the 28th international symposium on software testing and analysis, association for computing machinery, 10251_CR35 10251_CR37 10251_CR38 10251_CR39 MW Hall (10251_CR43) 1992; 1 M Utting (10251_CR107) 2012; 22 10251_CR41 10251_CR42 10251_CR44 10251_CR45 10251_CR46 10251_CR47 10251_CR48 D Athanasiou (10251_CR5) 2014; 40 10251_CR109 IA Salihu (10251_CR93) 2019; 7 10251_CR108 B Myers (10251_CR78) 1994; 1 10251_CR106 10251_CR101 10251_CR100 10251_CR50 10251_CR51 10251_CR52 10251_CR105 10251_CR53 10251_CR104 10251_CR54 10251_CR103 10251_CR55 10251_CR102 10251_CR56 10251_CR57 10251_CR58 10251_CR59 G Grano (10251_CR40) 2019; 156 10251_CR112 10251_CR60 10251_CR111 10251_CR61 10251_CR110 10251_CR62 10251_CR63 10251_CR64 10251_CR65 10251_CR66 10251_CR113 10251_CR67 10251_CR68 BN Nguyen (10251_CR81) 2014; 21 10251_CR70 10251_CR71 10251_CR72 10251_CR73 10251_CR74 10251_CR75 10251_CR76 10251_CR77 V Nguyen (10251_CR82) 2021; 31 G Bavota (10251_CR11) 2015; 20 10251_CR80 10251_CR84 10251_CR85 10251_CR87 10251_CR88 10251_CR9 M Leotta (10251_CR69) 2016; 28 10251_CR1 10251_CR2 10251_CR4 10251_CR6 10251_CR90 10251_CR91 S Di Martino (10251_CR29) 2021; 31 10251_CR92 M Fowler (10251_CR34) 1999 10251_CR94 10251_CR95 10251_CR96 10251_CR97 10251_CR10 BA Myers (10251_CR79) 1995; 2 M Ronsse (10251_CR89) 1999; 17 10251_CR98 10251_CR99 10251_CR12 10251_CR13 10251_CR14 10251_CR15 P Pandit (10251_CR83) 2015; 120 10251_CR16 10251_CR17 10251_CR18 10251_CR19 H Femmer (10251_CR33) 2017; 123 V Garousi (10251_CR36) 2018; 138 S Reichhart (10251_CR86) 2007; 6 R Coppola (10251_CR22) 2019; 68 10251_CR20 W Basit (10251_CR8) 2013; 13 10251_CR21 10251_CR23 10251_CR24 J Humble (10251_CR49) 2010 10251_CR25 10251_CR26 10251_CR27 10251_CR28 FF Arcelli (10251_CR3) 2016; 21 I Banerjee (10251_CR7) 2013; 55 10251_CR30 10251_CR31 10251_CR32 |
| References_xml | – ident: 10251_CR21 – ident: 10251_CR109 doi: 10.1109/TSE.2007.70745 – ident: 10251_CR84 doi: 10.1145/3368089.3417921 – ident: 10251_CR96 – volume: 20 start-page: 1052 issue: 4 year: 2015 ident: 10251_CR11 publication-title: Empir Softw Eng doi: 10.1007/s10664-014-9313-0 contributor: fullname: G Bavota – ident: 10251_CR38 – ident: 10251_CR24 doi: 10.1109/ICSTE.2010.5608882 – ident: 10251_CR67 doi: 10.1109/ICSTW.2015.7107403 – ident: 10251_CR46 doi: 10.1109/HICSS.2010.344 – ident: 10251_CR12 doi: 10.1145/3338906.3338970 – ident: 10251_CR44 doi: 10.1145/2950290.2950294 – ident: 10251_CR90 doi: 10.1109/ICST.2019.00040 – ident: 10251_CR71 doi: 10.1145/2491411.2491450 – ident: 10251_CR50 doi: 10.1109/CSMR.2012.12 – volume: 21 start-page: 1143 issue: 3 year: 2016 ident: 10251_CR3 publication-title: Empir Softw Eng doi: 10.1007/s10664-015-9378-4 contributor: fullname: FF Arcelli – ident: 10251_CR110 doi: 10.1145/3422392.3422412 – ident: 10251_CR102 doi: 10.1145/3379597.3387453 – ident: 10251_CR18 – ident: 10251_CR101 doi: 10.1109/ICSME.2018.00010 – ident: 10251_CR80 doi: 10.1145/142750.142789 – ident: 10251_CR32 doi: 10.1145/2593812.2593817 – ident: 10251_CR51 doi: 10.1109/WSE.2012.6320526 – ident: 10251_CR87 – ident: 10251_CR30 – ident: 10251_CR48 doi: 10.1109/ICPC.2015.20 – ident: 10251_CR55 – volume: 138 start-page: 52 year: 2018 ident: 10251_CR36 publication-title: J Syst Softw doi: 10.1016/j.jss.2017.12.013 contributor: fullname: V Garousi – ident: 10251_CR76 – ident: 10251_CR68 doi: 10.1109/ISSREW.2014.17 – ident: 10251_CR75 doi: 10.1109/ICSE.2009.5070522 – ident: 10251_CR62 – volume: 1 start-page: 73 issue: 1 year: 1994 ident: 10251_CR78 publication-title: Interactions doi: 10.1145/174800.174808 contributor: fullname: B Myers – ident: 10251_CR94 doi: 10.1109/ICDCSW.2011.20 – volume: 31 start-page: 272 issue: 3 year: 2021 ident: 10251_CR29 publication-title: Softw Test Verif Reliab doi: 10.1002/stvr.1754 contributor: fullname: S Di Martino – volume: 6 start-page: 231 issue: 9 year: 2007 ident: 10251_CR86 publication-title: J Object Technol doi: 10.5381/jot.2007.6.9.a12 contributor: fullname: S Reichhart – ident: 10251_CR106 doi: 10.1145/2970276.2970340 – ident: 10251_CR10 doi: 10.1109/ICSM.2012.6405253 – ident: 10251_CR53 doi: 10.1109/ICAL.2008.4636415 – ident: 10251_CR4 – ident: 10251_CR58 doi: 10.1109/SANER.2019.8667976 – ident: 10251_CR61 – ident: 10251_CR85 doi: 10.1145/3236454.3236489 – ident: 10251_CR98 – ident: 10251_CR27 – volume: 28 start-page: 177 issue: 3 year: 2016 ident: 10251_CR69 publication-title: J softw: Evol Process contributor: fullname: M Leotta – ident: 10251_CR88 doi: 10.1007/978-3-030-67731-2_35 – ident: 10251_CR70 – ident: 10251_CR73 doi: 10.1109/ICSM.2004.1357820 – ident: 10251_CR1 – ident: 10251_CR95 – volume: 2 start-page: 64 issue: 1 year: 1995 ident: 10251_CR79 publication-title: ACM Trans Comput Hum Interact doi: 10.1145/200968.200971 contributor: fullname: BA Myers – ident: 10251_CR66 doi: 10.1007/978-3-540-73101-6_16 – ident: 10251_CR35 doi: 10.1109/ICSE.2015.28 – ident: 10251_CR16 – volume: 123 start-page: 190 year: 2017 ident: 10251_CR33 publication-title: J Syst Softw doi: 10.1016/j.jss.2016.02.047 contributor: fullname: H Femmer – ident: 10251_CR2 doi: 10.1109/ICSTW.2016.47 – ident: 10251_CR41 doi: 10.1109/ICST.2013.45 – ident: 10251_CR64 – ident: 10251_CR105 – ident: 10251_CR47 doi: 10.1109/ICSE.2013.6606682 – volume-title: Refactoring: Improving The Design of Existing Code year: 1999 ident: 10251_CR34 contributor: fullname: M Fowler – ident: 10251_CR72 doi: 10.1145/2931037.2931054 – ident: 10251_CR103 – ident: 10251_CR31 – ident: 10251_CR74 doi: 10.1016/S0065-2458(10)80003-8 – volume: 40 start-page: 1100 issue: 11 year: 2014 ident: 10251_CR5 publication-title: IEEE Trans Softw Eng doi: 10.1109/TSE.2014.2342227 contributor: fullname: D Athanasiou – ident: 10251_CR92 doi: 10.1109/ASE.2017.8115711 – ident: 10251_CR54 – ident: 10251_CR13 doi: 10.1109/WETSoM.2017.2 10.1109/WETSoM.2017.2 – ident: 10251_CR77 – ident: 10251_CR99 doi: 10.1109/MSR.2017.14 – volume: 31 start-page: 19 issue: 3 year: 2021 ident: 10251_CR82 publication-title: Softw Test Verif Reliab doi: 10.1002/stvr.1760 contributor: fullname: V Nguyen – ident: 10251_CR65 doi: 10.1145/3106237.3106288 – ident: 10251_CR63 – ident: 10251_CR9 – ident: 10251_CR112 doi: 10.1145/1321631.1321695 – ident: 10251_CR97 – ident: 10251_CR100 – ident: 10251_CR45 doi: 10.1109/ICST.2016.16 – ident: 10251_CR14 – volume: 17 start-page: 133 issue: 2 year: 1999 ident: 10251_CR89 publication-title: ACM Trans Comput Syst doi: 10.1145/312203.312214 contributor: fullname: M Ronsse – ident: 10251_CR113 doi: 10.1145/2610384.2610404 – ident: 10251_CR56 doi: 10.1109/QSIC.2009.47 – volume: 55 start-page: 1679 issue: 10 year: 2013 ident: 10251_CR7 publication-title: Inf Softw Technol doi: 10.1016/j.infsof.2013.03.004 contributor: fullname: I Banerjee – ident: 10251_CR59 – ident: 10251_CR28 – volume: 22 start-page: 297 issue: 5 year: 2012 ident: 10251_CR107 publication-title: Software Testing Verification and Reliability doi: 10.1002/stvr.456 contributor: fullname: M Utting – ident: 10251_CR25 doi: 10.1109/MSR.2019.00072 – volume: 156 start-page: 312 year: 2019 ident: 10251_CR40 publication-title: J Syst Softw doi: 10.1016/j.jss.2019.07.016 contributor: fullname: G Grano – volume: 13 start-page: 37 year: 2013 ident: 10251_CR8 publication-title: Pak J Eng Appl Sci contributor: fullname: W Basit – volume: 120 start-page: 16 issue: 10 year: 2015 ident: 10251_CR83 publication-title: Int J Comput Appl doi: 10.5120/21262-3533 contributor: fullname: P Pandit – volume: 1 start-page: 227 issue: 3 year: 1992 ident: 10251_CR43 publication-title: ACM Trans Program Lang Syst doi: 10.1145/151640.151643 contributor: fullname: MW Hall – ident: 10251_CR52 – ident: 10251_CR17 – ident: 10251_CR111 doi: 10.1109/ASE.2019.00103 – volume-title: Continuous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation year: 2010 ident: 10251_CR49 contributor: fullname: J Humble – ident: 10251_CR57 doi: 10.1145/3377812.3382176 – ident: 10251_CR104 – ident: 10251_CR42 doi: 10.1145/2002931.2002932 – ident: 10251_CR23 – volume: 21 start-page: 65 issue: 1 year: 2014 ident: 10251_CR81 publication-title: Autom Softw Eng doi: 10.1007/s10515-013-0128-9 contributor: fullname: BN Nguyen – ident: 10251_CR20 doi: 10.1109/SNPD.2012.10 – volume: 68 start-page: 67 issue: 1 year: 2019 ident: 10251_CR22 publication-title: IEEE Trans Reliab doi: 10.1109/TR.2018.2869227 contributor: fullname: R Coppola – ident: 10251_CR39 doi: 10.1109/ICSE.2013.6606553 – ident: 10251_CR37 – ident: 10251_CR108 doi: 10.1109/ICSM.2006.18 – ident: 10251_CR91 doi: 10.1145/3293882.3339003 – ident: 10251_CR6 doi: 10.1007/978-3-540-72563-3_7 – volume: 7 start-page: 17158 issue: c year: 2019 ident: 10251_CR93 publication-title: IEEE Access doi: 10.1109/ACCESS.2019.2895504 contributor: fullname: IA Salihu – ident: 10251_CR60 – ident: 10251_CR15 doi: 10.1109/ICST.2009.11 – ident: 10251_CR19 doi: 10.1109/ICSTW50294.2020.00029 – ident: 10251_CR26 |
| SSID | ssj0009745 |
| Score | 2.385443 |
| Snippet | Test smells are known as bad development practices that reflect poor design and implementation choices in software tests. Over the last decade, there are few... |
| SourceID | proquest crossref springer |
| SourceType | Aggregation Database Publisher |
| StartPage | 20 |
| SubjectTerms | Compilers Computer Science Empirical analysis Graphical user interface Interactive systems Interpreters Literature reviews Programming Languages Smell Software Engineering/Programming and Operating Systems Software testing |
| SummonAdditionalLinks | – databaseName: SpringerLINK - Czech Republic Consortium dbid: AGYKE link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV07T8MwED6hdmGhPEWhIA9IDOAqLzvxWKGWCiQWWqlMVuw4EqIERFIGfj3nPBSeQ9c4spQvdu47577vAM5E7GrhKYVvAHOTIBYuVY5hlAtlhZ9CJ3FZIHvHp_PgZsEWrY67LHZv_kiWH-ovWjfOA2qLz13LiymmPF1mDb860B1dP9yOW6_dsOxNbN31qI8hvdbK_D3L93jUkswf_0XLcDPpwawR7VRVJk_DVaGG-uO3h-M6T7INWzX9JKNqvezAhsl2ode0diD1Tt-D8_tns1zm5DEjldczsacZxJpLlLKqd0OQoxb5Pswn49nVlNY9FajGRKugTDHDWWyEH_gGQ3MSeoGvU7wQMa0FEjLl8EhxLdI4xFzOTV0deYnPwsQzAXP8A-hkL5k5BJJEQntOHDKlMRSmTCEX1EKkjAsTxibtw0WDrHytrDNka5JsMZCIgSwxkG4fBg34st5GufRCTKCsCx4OXzZgtsP_z3a03u3HsGnbyFdHKwPoFG8rc4Jko1Cn9eL6BC_PxxM priority: 102 providerName: Springer Nature |
| Title | Smells in system user interactive tests |
| URI | https://link.springer.com/article/10.1007/s10664-022-10251-1 https://www.proquest.com/docview/2755001011 |
| Volume | 28 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1NS8QwEB109-LFb3F1lRwEDxps2qZtTrLKfqCwiLqwnkqTpiCs3dVWf7-TNqUo6KmQQg4zbebNZOY9gDORMCVcKdEDmJv4iWBUOprTQEgz-ClUmlQNstNgMvPv5nxuC26FbatszsTqoE6XytTIr9wQsbQhRGPXq3dqVKPM7aqV0FiHLjNMeGZSfDRuSXfDSqTY0OxRD2O7HZqxo3NB4FPTy84MzKbsZ2Bq0eavC9Iq7oy2YdMCRjKoPbwDazrfha1GjIHYf3MPzp_e9GJRkNec1OzMxNQfiKGDqAahvjRBVFkW-zAbDZ9vJ9SqIFCFqVFJueQ64IkWnu9pDKZp6PqeynAh4koJhFDSCSIZKJElIWZfLGMqclOPh6mrfe54B9DJl7k-BJJGQrlOEnKpMHhlXCJ6U0JkPBA6THTWg4vGBPGqJruIW1pjY7AYDRZXBotZD_qNlWL74Rdx66YeXDaWa1__vdvR_7sdw4YReq-LH33olB-f-gThQClPK5-fQncwfrkf4vNmOH14xNWZO_gGDMuyMg |
| link.rule.ids | 315,786,790,12792,21416,27955,27956,33406,33777,41114,41556,42183,42625,43633,43838,52144,52267,74390,74657 |
| linkProvider | ProQuest |
| linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV3PS8MwFH7odtCLv8Xp1BwEDxpc2iZtTqLimDqH6Aa7hSZNQZjdtNW_36RNKQp6bSCH76V533t573sAJzwmintSGguY2CSIOcGypylmXNrGT66SuCyQHbHBJLif0qlLuOWurLK-E8uLOpkrmyO_8ELDpa0gGrlcvGM7Ncq-rroRGsvQtpKbUQva17ejp-dGdjcsxxRboT3sG-_u2mZc8xxjAbbV7MQSbUx-uqaGb_56Ii09T38D1hxlRFeVjTdhSWdbsF6PY0Du79yG05c3PZvl6DVDlT4zshkIZAUhylaoL40MryzyHZj0b8c3A-zmIGBlgqMCU0k1o7HmfuBr406T0At8lZoPEVWKGxIleyySTPE0Dk38RVKiIi_xaZh4OqA9fxda2TzTe4CSiCuvF4dUKuO-UioNf1Ocp5RxHcY67cBZDYFYVHIXohE2toAJA5goAROkA90aJeGOfi4aQ3XgvEauWf57t_3_dzuGlcH4cSiGd6OHA1i1Y9-rVEgXWsXHpz405KCQR-4EfANWKLJy |
| linkToPdf | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1NS8QwEB10BfHit7i6ag6CBw02bZM2JxG1rh8sgi7sLTRpCsLaXW3195u0KUVBry3k8IZk3iQz7wEc85Qo7ktpImBqkzDlBEtPU8y4tIOfXGVp3SA7YsNxeD-hE9f_VLq2yvZMrA_qbKbsHfm5HxkubQXRyHnu2iKerpOL-Tu2DlL2pdXZaSzCkiXZ1sYhTm47Ad6oNiy2kns4MHneDdC4MTrGQmz72oml3Jj8TFId8_z1WFrnoGQdVh15RJdNtDdgQRebsNYaMyC3T7fg5PlNT6clei1Qo9SM7F0EstIQ9VDUl0aGYVblNoyTm5erIXaOCFiZMqnCVFLNaKp5EAbaJNYs8sNA5eZDTJXihk5Jj8WSKZ6nkanESE5U7GcBjTJfh9QLdqBXzAq9CyiLufK9NKJSmUSWU2mYnOI8p4zrKNV5H05bCMS8Eb4QncSxBUwYwEQNmCB9GLQoCbcJStGFrA9nLXLd779X2_t_tSNYNqEXj3ejh31Ysf7vzZ3IAHrVx6c-MCyhkod1-L8Bk5-1OA |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Smells+in+system+user+interactive+tests&rft.jtitle=Empirical+software+engineering+%3A+an+international+journal&rft.au=Rwemalika%2C+Renaud&rft.au=Habchi%2C+Sarra&rft.au=Papadakis%2C+Mike&rft.au=Le+Traon%2C+Yves&rft.date=2023-01-01&rft.pub=Springer+Nature+B.V&rft.issn=1382-3256&rft.eissn=1573-7616&rft.volume=28&rft.issue=1&rft.spage=20&rft_id=info:doi/10.1007%2Fs10664-022-10251-1&rft.externalDBID=HAS_PDF_LINK |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1382-3256&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1382-3256&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1382-3256&client=summon |