Semi-Automatic Mapping Technique Using Snowballing to Support Massive Literature Searches in Software Engineering
Systematic literature reviews represent an important methodology in Evidence-Based Software Engineering. To define the methodological route in these type of studies, in which a review of quantitative and qualitative aspects of primary studies is carried out to summarize the existing information rega...
Saved in:
| Published in | Revista FI-UPTC Vol. 31; no. 60; p. e14189 |
|---|---|
| Main Authors | , , |
| Format | Journal Article |
| Language | English |
| Published |
Universidad Pedagógica y Tecnológica de Colombia
01.06.2022
|
| Subjects | |
| Online Access | Get full text |
| ISSN | 0121-1129 2357-5328 |
| DOI | 10.19053/01211129.v31.n60.2022.14189 |
Cover
| Abstract | Systematic literature reviews represent an important methodology in Evidence-Based Software Engineering. To define the methodological route in these type of studies, in which a review of quantitative and qualitative aspects of primary studies is carried out to summarize the existing information regarding a particular topic, researchers use protocols that guide the construction of knowledge from research questions. This article presents a process that uses forward Snowballing, which identifies the articles cited in the paper under study and the number of citations as inclusion criteria to complement systematic literature reviews. A process that relies on software tools was designed to apply the Snowballing strategy and to identify the most cited works and those who cite them. To validate the process, a review identified in the literature was used. After comparing the results, new works that were not taken into account but made contributions to the subject of study emerged. The citation index represents the number of times a publication has been referenced in other documents and is used as a mechanism to analyze, measure, or quantitatively assess the impact of said publication on the scientific community. The present study showed how applying Snowballing along with other strategies enables the emergence of works that may be relevant for an investigation given the citations rate. That is, implementing this proposal will allow updating or expanding systematic literature studies through the new works evidenced. |
|---|---|
| AbstractList | Systematic literature reviews represent an important methodology in EvidenceBased Software Engineering. To define the methodological route in these type of
studies, in which a review of quantitative and qualitative aspects of primary studies is carried out to summarize the existing information regarding a particular topic, researchers use protocols that guide the construction of knowledge from research questions. This article presents a process that uses forward Snowballing, which identifies the articles cited in the paper under study and the number of citations as inclusion criteria to complement systematic literature reviews. A process that relies on software tools was designed to apply the Snowballing strategy and to identify the most cited works and those who cite them. To validate the process, a review identified in the literature was used. After comparing the results, new works that were not taken into account but made contributions to the subject of study emerged. The citation index represents the number of times a publication has been referenced in other documents and is used as a mechanism to analyze, measure, or quantitatively assess the impact of said publication on the scientific community. The present study showed how applying Snowballing along with other strategies enables the emergence of works that may be relevant for an investigation given the citations rate. That is, implementing this proposal will allow updating or expanding systematic literature studies through the new works evidenced.
Los estudios sistemáticos de literatura representan una metodología importante en Ingeniería de Software Basada en Evidencias, para definir la ruta metodológica en este tipo de estudios, en los cuales se realiza una revisión de aspectos cuantitativos y cualitativos de estudios primarios, con el fin de resumir la información existente sobre un tema en particular los investigadores utilizan protocolos que guían la construcción del conocimiento a partir de las preguntas de investigación. Este artículo presenta un proceso que utiliza la propuesta conocida como Snowballing hacia adelante, que identifica los artículos citados por el artículo en estudio y el número de citas como criterios de inclusión para complementar los estudios sistemáticos de literatura. Se diseñó un proceso que se apoya en herramientas de software para aplicar la estrategia Snowballing e identificar los trabajos más citados y quienes los citan. Se validó el proceso por comparación y surgieron nuevos trabajos que hicieron aportes al tema de estudio, que no habían sido considerados inicialmente. El índice de citas representa el número de veces que una publicación ha sido referenciada en otros documentos y se utiliza como mecanismo para analizar, medir o evaluar cuantitativamente el impacto de dicha publicación en la comunidad científica. La presente propuesta mostró cómo la aplicación del Snowballing con otras estrategias permite evidenciar nuevos de trabajos que pueden ser relevantes para una investigación dada la tasa de citas. Es decir, el uso de la presente propuesta permitirá actualizar o ampliar los estudios bibliográficos sistemáticos por los nuevos trabajos evidenciados. Systematic literature reviews represent an important methodology in Evidence-Based Software Engineering. To define the methodological route in these type of studies, in which a review of quantitative and qualitative aspects of primary studies is carried out to summarize the existing information regarding a particular topic, researchers use protocols that guide the construction of knowledge from research questions. This article presents a process that uses forward Snowballing, which identifies the articles cited in the paper under study and the number of citations as inclusion criteria to complement systematic literature reviews. A process that relies on software tools was designed to apply the Snowballing strategy and to identify the most cited works and those who cite them. To validate the process, a review identified in the literature was used. After comparing the results, new works that were not taken into account but made contributions to the subject of study emerged. The citation index represents the number of times a publication has been referenced in other documents and is used as a mechanism to analyze, measure, or quantitatively assess the impact of said publication on the scientific community. The present study showed how applying Snowballing along with other strategies enables the emergence of works that may be relevant for an investigation given the citations rate. That is, implementing this proposal will allow updating or expanding systematic literature studies through the new works evidenced. |
| Author | Pardo-Calvache, César-Jesús Suescún-Monsalve, Elizabeth Sampaio-do-Prado-Leite, Julio-Cesar |
| Author_xml | – sequence: 1 givenname: Elizabeth orcidid: 0000-0001-7872-7638 surname: Suescún-Monsalve fullname: Suescún-Monsalve, Elizabeth – sequence: 2 givenname: Julio-Cesar orcidid: 0000-0002-0355-0265 surname: Sampaio-do-Prado-Leite fullname: Sampaio-do-Prado-Leite, Julio-Cesar – sequence: 3 givenname: César-Jesús orcidid: 0000-0002-6907-2905 surname: Pardo-Calvache fullname: Pardo-Calvache, César-Jesús |
| BookMark | eNqNkV9v0zAUxS00JMrYd8gDrwn-l9SReCnTgEmdkEj3bN3Yt52r1M7sZBPfHrcrIHjCL7aPzzmS7-8tufDBIyHvGa1YS2vxgTLOGONt9SRY5Rtaccp5xSRT7Suy4KJelrXg6oIsjs7yaH1DrlLa07waVQsmFuSxw4MrV_MUDjA5U9zBODq_KzZoHrx7nLG4T8d758NzD8NwPE-h6OZxDHHK9pTcExZrN2GEaY5YdAjRPGAqnC-6sJ2eIYs3fuc8Yszxd-T1FoaEV-f9ktx_vtlcfy3X377cXq_WpRFctmXLLAOhGKjGGkFBWqWMFWJLadsYaIAx0Tayb2qBraJWLg3mJ7BWWorMikty-9JrA-z1GN0B4g8dwOmTEOJOQ8xfHlDbhjNZK1gKoWSeTV9bQ3nT9yh7gXWfuz6euxwMHqe_687a7F10YQ8ak1593-Qhs1rKhqs_cRNDShG3v_OM6hNM_QumzjB1hqmPMPUJZo5_-idu3JRpBT9FcMP_lfwEqwGq2w |
| CitedBy_id | crossref_primary_10_1016_j_spc_2025_02_013 |
| Cites_doi | 10.1002/smr.2345 10.1109/ICSE.2004.1317449 10.1109/ESEM.2017.30 10.1016/j.infsof.2018.06.003 10.1016/0048-7333(83)90005-7 10.1016/j.infsof.2019.01.004 10.1145/3084226.3084275 10.1145/3021460.3021462 10.1145/3194747.3194748 10.1016/j.jss.2020.110607 10.1016/j.infsof.2019.01.005 10.1007/s10664-021-09953-9 10.1007/s10664-017-9587-0 10.1007/s10664-019-09747-0 10.1109/ICSE-NIER52604.2021.00012 10.1016/j.infsof.2021.106555 10.1007/s10664-020-09844-5 10.1145/2601248.2601268 10.1109/ESEM.2013.28 10.1109/MS.2005.6 10.1145/3382494.3422170 10.14236/ewic/EASE2008.8 10.1016/j.infsof.2018.02.001 10.1016/j.infsof.2021.106697 10.1109/ESEM.2007.59 10.1109/MS.2020.3022931 10.1145/3021460.3021489 10.1007/s10664-016-9437-5 10.1109/SCCC.2018.8705250 10.1145/3239235.3267432 10.1145/3210459.3210464 10.1201/9781315154855-2 10.1145/3379177.3390305 10.1016/j.infsof.2015.03.007 10.1186/2046-4053-3-74 10.3233/JIFS-169146 10.1109/METRICS.2005.46 10.1109/SEAA.2019.00061 10.1016/j.infsof.2019.04.005 10.1007/s10664-017-9556-7 10.1016/j.infsof.2018.02.002 10.1016/j.infsof.2013.02.002 10.1109/ESEM.2013.32 10.1016/j.compedu.2012.03.004 10.1007/s10664-019-09711-y 10.1016/j.infsof.2020.106294 10.1016/j.infsof.2020.106397 10.1016/j.infsof.2020.106449 10.1016/j.infsof.2018.09.006 10.1016/j.jss.2020.110657 |
| ContentType | Journal Article |
| Copyright | LICENCIA DE USO: Los documentos a texto completo incluidos en Dialnet son de acceso libre y propiedad de sus autores y/o editores. Por tanto, cualquier acto de reproducción, distribución, comunicación pública y/o transformación total o parcial requiere el consentimiento expreso y escrito de aquéllos. Cualquier enlace al texto completo de estos documentos deberá hacerse a través de la URL oficial de éstos en Dialnet. Más información: https://dialnet.unirioja.es/info/derechosOAI | INTELLECTUAL PROPERTY RIGHTS STATEMENT: Full text documents hosted by Dialnet are protected by copyright and/or related rights. This digital object is accessible without charge, but its use is subject to the licensing conditions set by its authors or editors. Unless expressly stated otherwise in the licensing conditions, you are free to linking, browsing, printing and making a copy for your own personal purposes. All other acts of reproduction and communication to the public are subject to the licensing conditions expressed by editors and authors and require consent from them. Any link to this document should be made using its official URL in Dialnet. More info: https://dialnet.unirioja.es/info/derechosOAI |
| Copyright_xml | – notice: LICENCIA DE USO: Los documentos a texto completo incluidos en Dialnet son de acceso libre y propiedad de sus autores y/o editores. Por tanto, cualquier acto de reproducción, distribución, comunicación pública y/o transformación total o parcial requiere el consentimiento expreso y escrito de aquéllos. Cualquier enlace al texto completo de estos documentos deberá hacerse a través de la URL oficial de éstos en Dialnet. Más información: https://dialnet.unirioja.es/info/derechosOAI | INTELLECTUAL PROPERTY RIGHTS STATEMENT: Full text documents hosted by Dialnet are protected by copyright and/or related rights. This digital object is accessible without charge, but its use is subject to the licensing conditions set by its authors or editors. Unless expressly stated otherwise in the licensing conditions, you are free to linking, browsing, printing and making a copy for your own personal purposes. All other acts of reproduction and communication to the public are subject to the licensing conditions expressed by editors and authors and require consent from them. Any link to this document should be made using its official URL in Dialnet. More info: https://dialnet.unirioja.es/info/derechosOAI |
| DBID | AAYXX CITATION AGMXS FKZ DOA |
| DOI | 10.19053/01211129.v31.n60.2022.14189 |
| DatabaseName | CrossRef Dialnet (Open Access Full Text) Dialnet DOAJ Directory of Open Access Journals |
| DatabaseTitle | CrossRef |
| DatabaseTitleList | CrossRef |
| Database_xml | – sequence: 1 dbid: DOA name: DOAJ Directory of Open Access Journals url: https://www.doaj.org/ sourceTypes: Open Website |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Engineering |
| EISSN | 2357-5328 |
| ExternalDocumentID | oai_doaj_org_article_d621458a73384006b5dc026bbe4b3e5b oai_dialnet_unirioja_es_ART0001544628 10_19053_01211129_v31_n60_2022_14189 |
| GroupedDBID | 8FE 8FG AAYXX ABJCF ACIWK ADBBV AFKRA ALMA_UNASSIGNED_HOLDINGS APOWU AZFZN B14 BCNDV BENPR BGLVJ CCPQU CITATION FAEIB GROUPED_DOAJ HCIFZ INF ITC KQ8 L6V M7S OK1 PHGZM PHGZT PIMPY PROAC PTHSS RNS AGMXS FKZ IPNFZ RIG PQGLB PUEGO |
| ID | FETCH-LOGICAL-c3249-91d1a381a86dc30a4d88cd33f0096ca6a113964b653e980d47ce009add4d0e1d3 |
| IEDL.DBID | DOA |
| ISSN | 0121-1129 |
| IngestDate | Wed Aug 27 01:32:02 EDT 2025 Sun May 12 18:41:32 EDT 2024 Tue Jul 01 03:18:57 EDT 2025 Thu Apr 24 22:52:31 EDT 2025 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | false |
| IsScholarly | true |
| Issue | 60 |
| Language | English |
| License | http://creativecommons.org/licenses/by/4.0 |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c3249-91d1a381a86dc30a4d88cd33f0096ca6a113964b653e980d47ce009add4d0e1d3 |
| ORCID | 0000-0002-6907-2905 0000-0001-7872-7638 0000-0002-0355-0265 |
| OpenAccessLink | https://doaj.org/article/d621458a73384006b5dc026bbe4b3e5b |
| ParticipantIDs | doaj_primary_oai_doaj_org_article_d621458a73384006b5dc026bbe4b3e5b dialnet_primary_oai_dialnet_unirioja_es_ART0001544628 crossref_primary_10_19053_01211129_v31_n60_2022_14189 crossref_citationtrail_10_19053_01211129_v31_n60_2022_14189 |
| ProviderPackageCode | CITATION AAYXX |
| PublicationCentury | 2000 |
| PublicationDate | 20220601 |
| PublicationDateYYYYMMDD | 2022-06-01 |
| PublicationDate_xml | – month: 06 year: 2022 text: 20220601 day: 01 |
| PublicationDecade | 2020 |
| PublicationTitle | Revista FI-UPTC |
| PublicationYear | 2022 |
| Publisher | Universidad Pedagógica y Tecnológica de Colombia |
| Publisher_xml | – name: Universidad Pedagógica y Tecnológica de Colombia |
| References | 199990 199989 199988 199949 199983 199982 199981 199980 199987 199986 199985 199984 199958 199957 199956 199955 199999 200000 199959 199950 199994 199993 199992 199991 199954 199998 199953 199997 199952 199996 199951 199995 199969 199968 199967 199966 199961 199960 199965 199964 199963 199962 199979 199978 199977 199972 199971 199970 199976 199975 199974 199973 |
| References_xml | – ident: 199957 doi: 10.1002/smr.2345 – ident: 199951 doi: 10.1109/ICSE.2004.1317449 – ident: 199978 doi: 10.1109/ESEM.2017.30 – ident: 199961 doi: 10.1016/j.infsof.2018.06.003 – ident: 199955 doi: 10.1016/0048-7333(83)90005-7 – ident: 199960 doi: 10.1016/j.infsof.2019.01.004 – ident: 199979 doi: 10.1145/3084226.3084275 – ident: 199985 doi: 10.1145/3021460.3021462 – ident: 199970 doi: 10.1145/3194747.3194748 – ident: 199976 doi: 10.1016/j.jss.2020.110607 – ident: 199977 doi: 10.1016/j.infsof.2019.01.005 – ident: 199990 doi: 10.1007/s10664-021-09953-9 – ident: 199983 doi: 10.1007/s10664-017-9587-0 – ident: 199981 doi: 10.1007/s10664-019-09747-0 – ident: 199982 doi: 10.1109/ICSE-NIER52604.2021.00012 – ident: 199989 doi: 10.1016/j.infsof.2021.106555 – ident: 199956 doi: 10.1007/s10664-020-09844-5 – ident: 199974 doi: 10.1145/2601248.2601268 – ident: 199986 doi: 10.1109/ESEM.2013.28 – ident: 199949 doi: 10.1109/MS.2005.6 – ident: 199988 doi: 10.1145/3382494.3422170 – ident: 199997 – ident: 199954 doi: 10.14236/ewic/EASE2008.8 – ident: 199972 doi: 10.1016/j.infsof.2018.02.001 – ident: 199994 doi: 10.1016/j.infsof.2021.106697 – ident: 199952 doi: 10.1109/ESEM.2007.59 – ident: 199965 doi: 10.1109/MS.2020.3022931 – ident: 199953 doi: 10.1145/3021460.3021489 – ident: 199993 doi: 10.1007/s10664-016-9437-5 – ident: 199971 doi: 10.1109/SCCC.2018.8705250 – ident: 199980 doi: 10.1145/3239235.3267432 – ident: 199968 doi: 10.1145/3210459.3210464 – ident: 199963 doi: 10.1201/9781315154855-2 – ident: 199966 doi: 10.1145/3379177.3390305 – ident: 199964 doi: 10.1016/j.infsof.2015.03.007 – ident: 199996 doi: 10.1186/2046-4053-3-74 – ident: 199987 doi: 10.3233/JIFS-169146 – ident: 199950 doi: 10.1109/METRICS.2005.46 – ident: 199975 doi: 10.1109/SEAA.2019.00061 – ident: 199991 doi: 10.1016/j.infsof.2019.04.005 – ident: 199962 doi: 10.1007/s10664-017-9556-7 – ident: 199984 doi: 10.1016/j.infsof.2018.02.002 – ident: 199973 doi: 10.1016/j.infsof.2013.02.002 – ident: 199998 doi: 10.1109/ESEM.2013.32 – ident: 200000 doi: 10.1016/j.compedu.2012.03.004 – ident: 199959 doi: 10.1007/s10664-019-09711-y – ident: 199969 doi: 10.1016/j.infsof.2020.106294 – ident: 199995 – ident: 199999 doi: 10.1016/j.infsof.2020.106397 – ident: 199958 doi: 10.1016/j.infsof.2020.106449 – ident: 199967 doi: 10.1016/j.infsof.2018.09.006 – ident: 199992 doi: 10.1016/j.jss.2020.110657 |
| SSID | ssj0000685313 ssib040262413 ssib026971858 |
| Score | 2.1837628 |
| Snippet | Systematic literature reviews represent an important methodology in Evidence-Based Software Engineering. To define the methodological route in these type of... Systematic literature reviews represent an important methodology in EvidenceBased Software Engineering. To define the methodological route in these type of... |
| SourceID | doaj dialnet crossref |
| SourceType | Open Website Enrichment Source Index Database |
| StartPage | e14189 |
| SubjectTerms | citation impact evidence-based software engineering massive literature searches snowballing software engineering systematic mapping |
| Title | Semi-Automatic Mapping Technique Using Snowballing to Support Massive Literature Searches in Software Engineering |
| URI | https://dialnet.unirioja.es/servlet/oaiart?codigo=8557961 https://doaj.org/article/d621458a73384006b5dc026bbe4b3e5b |
| Volume | 31 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1LT8MwDI4QCAQHxFOMl3LgWkibNk3FiSEmhAAhBhK3KGkCGoIWtg7-PnbajXKCA1e3TtXY9aOxPxNy4DS3NsGpAUZnAeJMBhKi3CBl0iWGaxv5Du-ra3F-H188JA-tUV9YE1bDA9cbd2QFYmlLnUIuBfomTGJzyBuMcbHhsBxaX5axVjIFmhSJDGzu93kfJEkCD5Cmf1-YADdVz04OozDAoGOBHPjmPdDKIw98BrTDDx4eFoJBHhlFYFRCnAbf8l_z2NxRuOoH4L_3TL0VstyElPSkfpVVMuOKNbLUAhpcJ-999zoITsZV6RFa6ZVGWIYnejdBcKW-dID2i_LTaA_TTauS4shPCM_h9hFWudPLKQYzrcuU3YgOCtoHU_6pgdh65ga5753dnZ4HzbCFIIeYKgOjZ0MN7ltLYXPOdGylzC3nj5jk5FroEGJFERuRcJdJZuM0d3AJzGNsmQst3ySzRVm4LUIj5qRJncCe3VizxJj0MTJGMwPhXZonHXI82UKVN0jkOBDjRWFGggJQEwEoEIACASgUgPIC6JBkyv1WI3L8la-R1pQNobUntHExGA7KZ63cSEEqwerxbCKSHdJF2f5kQgJoqWq0VP2mpdv_scgOWcTXqQvVdslsNRy7PQiJKrNP5rpn1ze3-_4r-ALFSgCO |
| linkProvider | Directory of Open Access Journals |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Semi-Automatic+Mapping+Technique+Using+Snowballing+to+Support+Massive+Literature+Searches+in+Software+Engineering&rft.jtitle=Revista+FI-UPTC&rft.au=Elizabeth+Suesc%C3%BAn-Monsalve&rft.au=Julio-Cesar+Sampaio-do-Prado-Leite&rft.au=C%C3%A9sar-Jes%C3%BAs+Pardo-Calvache&rft.date=2022-06-01&rft.pub=Universidad+Pedag%C3%B3gica+y+Tecnol%C3%B3gica+de+Colombia&rft.issn=0121-1129&rft.eissn=2357-5328&rft.volume=31&rft.issue=60&rft_id=info:doi/10.19053%2F01211129.v31.n60.2022.14189&rft.externalDBID=DOA&rft.externalDocID=oai_doaj_org_article_d621458a73384006b5dc026bbe4b3e5b |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0121-1129&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0121-1129&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0121-1129&client=summon |