Effectiveness and efficiency of a domain-specific language for high-performance marine ecosystem simulation: a controlled experiment
It is a long-standing hypothesis that the concise and customized notation of a DSL improves the performance of developers when compared with a GPL. For non-technical domains—e.g., science—, this hypothesis lacks empirical evidence. Given this lack of empirical evidence, we evaluate a DSL for ecologi...
Saved in:
| Published in | Empirical software engineering : an international journal Vol. 22; no. 4; pp. 2206 - 2236 |
|---|---|
| Main Authors | , |
| Format | Journal Article |
| Language | English |
| Published |
New York
Springer US
01.08.2017
Springer Nature B.V |
| Subjects | |
| Online Access | Get full text |
Cover
Loading…
| Abstract | It is a long-standing hypothesis that the concise and customized notation of a DSL improves the performance of developers when compared with a GPL. For non-technical domains—e.g., science—, this hypothesis lacks empirical evidence. Given this lack of empirical evidence, we evaluate a DSL for ecological modeling designed and implemented by us with regard to performance improvements of developers as compared to a GPL. We conduct an online survey with embedded controlled experiments among ecologists to assess the correctness and time spent of the participants when using a DSL for ecosystem simulation specifications compared with a GPL-based solution. We observe that (1) solving tasks with the DSL, the participants’ correctness point score was —depending on the task— on average 61 % up to 63 % higher than with the GPL-based solution and their average time spent per task was reduced by 31 % up to 56 %; (2) the participants subjectively find it easier to work with the DSL, and (3) more than 90 % of the subjects are able to carry out basic maintenance tasks concerning the infrastructure of the DSL used in our treatment, which is based on another internal DSL embedded into Java. The tasks of our experiments are simplified and our web-based editor components do not offer full IDE-support. Our findings indicate that the development of further DSL for the specific needs of the ecological modeling community should be a worthwhile investment to increase its members’ productivity and to enhance the reliability of their scientific results. |
|---|---|
| AbstractList | It is a long-standing hypothesis that the concise and customized notation of a DSL improves the performance of developers when compared with a GPL. For non-technical domains—e.g., science—, this hypothesis lacks empirical evidence. Given this lack of empirical evidence, we evaluate a DSL for ecological modeling designed and implemented by us with regard to performance improvements of developers as compared to a GPL. We conduct an online survey with embedded controlled experiments among ecologists to assess the correctness and time spent of the participants when using a DSL for ecosystem simulation specifications compared with a GPL-based solution. We observe that (1) solving tasks with the DSL, the participants’ correctness point score was —depending on the task— on average 61 % up to 63 % higher than with the GPL-based solution and their average time spent per task was reduced by 31 % up to 56 %; (2) the participants subjectively find it easier to work with the DSL, and (3) more than 90 % of the subjects are able to carry out basic maintenance tasks concerning the infrastructure of the DSL used in our treatment, which is based on another internal DSL embedded into Java. The tasks of our experiments are simplified and our web-based editor components do not offer full IDE-support. Our findings indicate that the development of further DSL for the specific needs of the ecological modeling community should be a worthwhile investment to increase its members’ productivity and to enhance the reliability of their scientific results. |
| Author | Johanson, Arne N. Hasselbring, Wilhelm |
| Author_xml | – sequence: 1 givenname: Arne N. surname: Johanson fullname: Johanson, Arne N. email: arj@informatik.uni-kiel.de organization: Software Engineering Group, Kiel University – sequence: 2 givenname: Wilhelm surname: Hasselbring fullname: Hasselbring, Wilhelm organization: Software Engineering Group, Kiel University |
| BookMark | eNp9kE9rHDEMxU1JoPn3AXoz9OzUHs_ant5KSNJCIJfkbDwaeeMwY29tb8nm3A8ep1sIFNKTBNJP7-kdk4OYIhLySfBzwbn-UgRXqmdcKDb0RrLnD-RIrLRkWgl10HppOia7lfpIjkt55JwPul8dkd-X3iPU8AsjlkJdnCh6HyBghB1Nnjo6pcWFyMoGIbQJnV1cb90aqU-ZPoT1A9tgbv3iIiBdXA4RKUIqu1JxoSUs29nVkOLXdgxSrDnNMzadp8aFBWM9JYfezQXP_tYTcn91eXfxnd3cXv-4-HbDQKq-ss5MoPtBu2EcYBIwatBCqM7AJEfupNcKpO-11JPA0XBvANAJvVJjN45mlCfk8_7uJqefWyzVPqZtjk3SdlxJxY3uTNsS-y3IqZSM3m6aTZd3VnD7Grbdh21b2PY1bPvcGP0PA6H-ebpmF-b_kt2eLE0lrjG_eXofegFjpJoW |
| CitedBy_id | crossref_primary_10_1515_itit_2019_0040 crossref_primary_10_1016_j_cola_2024_101269 crossref_primary_10_1007_s10664_017_9593_2 crossref_primary_10_1007_s10664_022_10210_w crossref_primary_10_1155_2018_8467413 crossref_primary_10_3390_math10183386 crossref_primary_10_1145_3241743 crossref_primary_10_1186_s40168_019_0684_8 crossref_primary_10_3390_app11177823 crossref_primary_10_1016_j_cola_2019_02_001 crossref_primary_10_1007_s10270_024_01243_4 crossref_primary_10_1142_S1793962322300023 crossref_primary_10_3390_app12136679 crossref_primary_10_1007_s11219_021_09552_3 crossref_primary_10_1016_j_envsoft_2022_105323 crossref_primary_10_3390_math11173744 crossref_primary_10_1145_3622851 crossref_primary_10_1155_2020_8887588 crossref_primary_10_1016_j_infsof_2018_12_005 crossref_primary_10_3390_app12199893 crossref_primary_10_1016_j_cl_2018_04_003 crossref_primary_10_3390_info10120360 crossref_primary_10_1109_MCSE_2018_021651343 crossref_primary_10_1080_10429247_2021_1958631 crossref_primary_10_1016_j_cl_2018_07_006 |
| Cites_doi | 10.1007/978-3-540-33306-7 10.1016/j.infsof.2007.04.002 10.1007/978-3-642-12770-0 10.1201/b17537 10.1080/01621459.1968.10480932 10.1007/BFb0056614 10.1109/ICSE.1996.493448 10.1145/1118890.1118892 10.1145/1852786.1852809 10.1109/MS.2008.103 10.1109/MCSE.2009.205 10.1007/978-3-642-29044-2 10.1109/ICSE.2015.24 10.1145/2642803.2642820 10.1145/2063348.2063374 10.1007/978-1-84800-044-5_8 10.2307/3001968 10.1007/s10664-011-9172-x 10.1109/VLHCC.2013.6645249 10.1016/j.infsof.2015.11.001 10.5281/zenodo.61373 10.1145/581339.581406 10.1007/978-3-642-25264-8_19 10.1016/j.infsof.2008.04.001 |
| ContentType | Journal Article |
| Copyright | Springer Science+Business Media New York 2016 Copyright Springer Science & Business Media 2017 |
| Copyright_xml | – notice: Springer Science+Business Media New York 2016 – notice: Copyright Springer Science & Business Media 2017 |
| DBID | AAYXX CITATION 7SC 8FD JQ2 L7M L~C L~D |
| DOI | 10.1007/s10664-016-9483-z |
| DatabaseName | CrossRef Computer and Information Systems Abstracts Technology Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional |
| DatabaseTitle | CrossRef Computer and Information Systems Abstracts Technology Research Database Computer and Information Systems Abstracts – Academic Advanced Technologies Database with Aerospace ProQuest Computer Science Collection Computer and Information Systems Abstracts Professional |
| DatabaseTitleList | Computer and Information Systems Abstracts |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Computer Science |
| EISSN | 1573-7616 |
| EndPage | 2236 |
| ExternalDocumentID | 10_1007_s10664_016_9483_z |
| GroupedDBID | -4Z -59 -5G -BR -EM -Y2 -~C .86 .DC .VR 06D 0R~ 0VY 199 1N0 1SB 2.D 203 28- 29G 2J2 2JN 2JY 2KG 2LR 2P1 2VQ 2~H 30V 4.4 406 408 409 40D 40E 5GY 5QI 5VS 67Z 6NX 78A 8FE 8FG 8TC 8UJ 95- 95. 95~ 96X AABHQ AACDK AAHNG AAIAL AAJBT AAJKR AANZL AAOBN AARHV AARTL AASML AATNV AATVU AAUYE AAWCG AAYIU AAYOK AAYQN AAYTO AAYZH ABAKF ABBBX ABBXA ABDZT ABECU ABFTD ABFTV ABHLI ABHQN ABJCF ABJNI ABJOX ABKCH ABKTR ABMNI ABMQK ABNWP ABQBU ABQSL ABSXP ABTEG ABTHY ABTKH ABTMW ABULA ABWNU ABXPI ACAOD ACBXY ACDTI ACGFS ACHSB ACHXU ACIWK ACKNC ACMDZ ACMLO ACOKC ACOMO ACPIV ACSNA ACZOJ ADHHG ADHIR ADIMF ADINQ ADKNI ADKPE ADRFC ADTPH ADURQ ADYFF ADZKW AEBTG AEFIE AEFQL AEGAL AEGNC AEJHL AEJRE AEKMD AEMSY AENEX AEOHA AEPYU AESKC AETLH AEVLU AEXYK AFBBN AFEXP AFGCZ AFKRA AFLOW AFQWF AFWTZ AFZKB AGAYW AGDGC AGGDS AGJBK AGMZJ AGQEE AGQMX AGRTI AGWIL AGWZB AGYKE AHAVH AHBYD AHKAY AHSBF AHYZX AIAKS AIGIU AIIXL AILAN AITGF AJBLW AJRNO AJZVZ ALMA_UNASSIGNED_HOLDINGS ALWAN AMKLP AMXSW AMYLF AMYQR AOCGG ARAPS ARMRJ ASPBG AVWKF AXYYD AYJHY AZFZN B-. BA0 BBWZM BDATZ BENPR BGLVJ BGNMA BSONS CAG CCPQU COF CS3 CSCUP DDRTE DL5 DNIVK DPUIP DU5 EBLON EBS EIOEI EJD ESBYG FEDTE FERAY FFXSO FIGPU FINBP FNLPD FRRFC FSGXE FWDCC GGCAI GGRSB GJIRD GNWQR GQ6 GQ7 GQ8 GXS H13 HCIFZ HF~ HG5 HG6 HMJXF HQYDN HRMNR HVGLF HZ~ I09 IHE IJ- IKXTQ ITM IWAJR IXC IZIGR IZQ I~X I~Z J-C J0Z JBSCW JCJTX JZLTJ KDC KOV KOW L6V LAK LLZTM M4Y M7S MA- N2Q NB0 NDZJH NPVJJ NQJWS NU0 O9- O93 O9G O9I O9J OAM P19 P62 P9O PF0 PT4 PT5 PTHSS Q2X QOK QOS R4E R89 R9I RHV RNI RNS ROL RPX RSV RZC RZE RZK S0W S16 S1Z S26 S27 S28 S3B SAP SCJ SCLPG SCO SDH SDM SHX SISQX SJYHP SNE SNPRN SNX SOHCF SOJ SPISZ SRMVM SSLCW STPWE SZN T13 T16 TSG TSK TSV TUC U2A UG4 UOJIU UTJUX UZXMN VC2 VFIZW W23 W48 WK8 YLTOR Z45 Z7R Z7S Z7V Z7X Z7Z Z81 Z83 Z86 Z88 Z8M Z8N Z8P Z8R Z8T Z8U Z8W Z92 ZMTXR ~EX AAPKM AAYXX ABBRH ABDBE ABFSG ACSTC ADHKG AEZWR AFDZB AFHIU AFOHR AGQPQ AHPBZ AHWEU AIXLP ATHPR AYFIA CITATION PHGZM PHGZT 7SC 8FD ABRTQ JQ2 L7M L~C L~D |
| ID | FETCH-LOGICAL-c364t-28dc7497a9b9cd1cb7c711628cd3b0a3f76c3f4737d1eb80f8ccea1756b2bb8b3 |
| IEDL.DBID | U2A |
| ISSN | 1382-3256 |
| IngestDate | Fri Jul 25 11:10:27 EDT 2025 Thu Apr 24 23:04:31 EDT 2025 Tue Jul 01 03:32:17 EDT 2025 Fri Feb 21 02:35:47 EST 2025 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 4 |
| Keywords | Domain-specific languages (DSLs) Program comprehension Scientific software development Computational science |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c364t-28dc7497a9b9cd1cb7c711628cd3b0a3f76c3f4737d1eb80f8ccea1756b2bb8b3 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 |
| PQID | 2063608728 |
| PQPubID | 326341 |
| PageCount | 31 |
| ParticipantIDs | proquest_journals_2063608728 crossref_primary_10_1007_s10664_016_9483_z crossref_citationtrail_10_1007_s10664_016_9483_z springer_journals_10_1007_s10664_016_9483_z |
| ProviderPackageCode | CITATION AAYXX |
| PublicationCentury | 2000 |
| PublicationDate | 2017-08-01 |
| PublicationDateYYYYMMDD | 2017-08-01 |
| PublicationDate_xml | – month: 08 year: 2017 text: 2017-08-01 day: 01 |
| PublicationDecade | 2010 |
| PublicationPlace | New York |
| PublicationPlace_xml | – name: New York – name: Dordrecht |
| PublicationSubtitle | An International Journal |
| PublicationTitle | Empirical software engineering : an international journal |
| PublicationTitleAbbrev | Empir Software Eng |
| PublicationYear | 2017 |
| Publisher | Springer US Springer Nature B.V |
| Publisher_xml | – name: Springer US – name: Springer Nature B.V |
| References | GalesicMDropouts on the web: Effects of interest and burden experienced during an online surveyJ Off Stat2006222313328 Bortz J, Schuster C (2010) Statistik für Human- und Sozialwissenschaftler, 7th edn. Springer FaulkSLohEVanterMLVDSquiresSVottaLGScientific computing’s productivity gridlock: How software engineering can helpComput Sci Eng200911303910.1109/MCSE.2009.205 Basili VR, Caldiera G, Rombach HD (1994) Goal question metric paradigm. In: Encyclopedia of Software Engineering. Wiley, pp 528–532 Korman AK (1971) Industrial and Organizational Psychology. Prentice-Hall KosarTMernikMCarverJCProgram comprehension of domain-specific and general-purpose languages: Comparison using a family of experimentsEmpir Softw Eng201217327630410.1007/s10664-011-9172-x Palyart M, Lugato D, Ober I, Bruel J (2012) MDE4HPC: An approach for using model-driven engineering in high-performance computing. In: Proceedings SDL’11: Integrating System and Software Modeling, LNCS, vol 7083, pp 247–261 Stahl T, Völter M (2006) Model-Driven Software development: Technology, Engineering, Management. Wiley Johanson AN, Hasselbring W, Oschlies A, Worm B (2016) Evaluating hierarchical domain-specific languages for computational science: Applying the Sprat approach to a marine ecosystem model. In: Carver j, Hong NPC, Thiruvathukal GK (eds) Software Engineering for Science. Chapman and Hall Johanson AN, Hasselbring W (2014a) Hierarchical combination of internal and external domain-specific languages for scientific computing. In: Proceedings of the 2014 European Conference on Software Architecture Workshops, ACM, ECSAW’14, pp 17:1–17:8 Meliá S, Cachero C, Hermida JM, Aparicio E (2015) Comparison of a textual versus a graphical notation for the maintainability of mde domain models: an empirical pilot study. Softw Qual J:1–27 Hoisl B, Sobernig S, Strembeck M (2014) Comparing three notations for defining scenario-based model tests: a controlled experiment. In: 9th International Conference on the Quality of Information and Communications Technology (QUATIC), pp 95–104 da SilvaARModel-driven engineering: a survey supported by the unified conceptual modelComput Lang Syst Struct201543139155 Kieburtz RB, McKinney L, Bell JM, Hook J, Kotov A, Lewis J, Oliva DP, Sheard T, Smith I, Walton L (1996) A software engineering experiment in software component generation. In: Proceedings of the 18th international conference on software engineering (ICSE’96), pp 542–552 Webb CollinsRHevnerARWaltonGHLingerRCThe impacts of function extraction technology on program comprehension: a controlled experimentInf Softw Technol200850111165117910.1016/j.infsof.2008.04.001 Siegmund J, Siegmund N, Apel S (2015) Views on internal and external validity in empirical software engineering. In: IEEE/ACM 37Th IEEE international conference on software engineering (ICSE 2015), pp 9–19 Consel C, Marlet R (1998) Architecture software using a methodology for language development. In: Principles of Declarative Programming, LNCS, vol 1490. Springer, pp 170–194 KosarTBohraSMernikMDomain-specific languages: a systematic mapping studyInf Softw Technol201671779110.1016/j.infsof.2015.11.001 MernikMHeeringJSloaneAMWhen and how to develop domain-specific languagesACM Comput Surv (CSUR)200537431634410.1145/1118890.1118892 Bortz J, Döring N (2006) Forschungsmethoden und Evaluation für Human- und Sozialwissenschaftler, 4th edn. Springer Jones B, Kenward M (2014) Design and Analysis of Cross-Over Trials. Taylor & Francis ShapiroSSWilkMBChenHJA comparative study of various tests for normalityJ Am Stat Assoc1968633241343137223706910.1080/01621459.1968.10480932 April A, Abran A (2012) Software Maintenance Management: Evaluation and Continuous Improvement. Wiley Jedlitschka A, Ciolkowski M, Pfahl D (2008) Reporting experiments in software engineering. In: Shull f, Singer J, DI Sjøberg (eds) Guide to advanced empirical software engineering. Springer, pp 201–228 Kieburtz R, Hook J (1995) Software design for reliability and reuse (sdrr) project phase I final scientific and technical report. Tech. rep. Pacific Software Research Center Prabhu P, Jablin TB, Raman A, Zhang Y, Huang J, Kim H, Johnson NP, Liu F, Ghosh S, Beardl S, Oh T, Zoufaly M, Walker D, August DI (2011) A survey of the practice of computational science. In: State of the Practice Reports, ACM, SC’11, pp 19:1–19:12 BasiliVRCruzesDCarverJCHochsteinLMHollingsworthJKZelkowitzMVShullFUnderstanding the high-performance-computing community: a software engineer’s perspectiveIEEE Softw2008254293610.1109/MS.2008.103 van Solingen R (1999) Berghout, E. McGraw-Hill, The Goal/Question/Metric Method: A Practical Guide for Quality Improvement of Software Development Fowler M (2010) Domain-Specific Languages. Addison-Wesley Hevner AR, Linger RC, Webb Collins R, Pleszkoch MG, Walton GH (2005) The impact of function extraction technology on next-generation software engineering. Tech. rep. Carnegie Mellon University Knight J (2002) Safety critical systems: challenges and directions. In: Proceedings ICSE’02. IEEE, pp 547–550 KosarTMartıPEBarrientosPAMernikMA preliminary study on various implementation approaches of domain-specific languageInf Softw Technol200850539040510.1016/j.infsof.2007.04.002 Ricca F, Scanniello G, Torchiano M, Reggio G, Astesiano E (2010) On the effectiveness of screen mockups in requirements engineering: results from an internal replication WilcoxonFIndividual comparisons by ranking methodsBiom Bull194516808310.2307/3001968 Kolovos DS, Paige RF, Kelly T, Polack FA (2006) Requirements for domain-specific languages. In: Proceedings of ECOOP Workshop on Domain-Specific Program Development (DSPD) Johanson AN (2016) Data and scripts for the Sprat Ecosystem DSL survey. doi:http://dx.doi.org/10.5281/zenodo.61373 LikertRA technique for the measurement of attitudesArch Psychol193222140555 Wohlin C, Runeson P, Höst M, Ohlsson MC, Regnell B, Wesslén A (2012) Experimentation in software engineering. Springer Almorsy M, Grundy J, Sadus R, van Straten W, Barnes DG, Kaluza O (2013) A suite of domain-specific visual languages for scientific software application modelling. In: Symposium on Visual Languages and Human-Centric Computing (VL/HCC), 2013. IEEE, pp 91–94 Johanson AN, Hasselbring W (2014b) Sprat: Hierarchies of domain-specific languages for marine ecosystem simulation engineering. In: Proceedings TMS SpringSim’14, SCS, pp 187–192 9483_CR22 F Wilcoxon (9483_CR39) 1945; 1 9483_CR23 R Likert (9483_CR27) 1932; 22 AR da Silva (9483_CR35) 2015; 43 9483_CR28 9483_CR1 M Mernik (9483_CR29) 2005; 37 9483_CR3 9483_CR2 9483_CR5 9483_CR40 9483_CR7 9483_CR20 9483_CR6 9483_CR21 VR Basili (9483_CR4) 2008; 25 R Webb Collins (9483_CR38) 2008; 50 9483_CR19 9483_CR11 9483_CR12 9483_CR34 9483_CR13 T Kosar (9483_CR24) 2008; 50 T Kosar (9483_CR26) 2016; 71 9483_CR14 9483_CR36 9483_CR15 9483_CR37 9483_CR16 9483_CR17 9483_CR18 S Faulk (9483_CR8) 2009; 11 9483_CR30 9483_CR31 9483_CR32 9483_CR9 M Galesic (9483_CR10) 2006; 22 T Kosar (9483_CR25) 2012; 17 SS Shapiro (9483_CR33) 1968; 63 |
| References_xml | – reference: Johanson AN, Hasselbring W (2014b) Sprat: Hierarchies of domain-specific languages for marine ecosystem simulation engineering. In: Proceedings TMS SpringSim’14, SCS, pp 187–192 – reference: Kieburtz RB, McKinney L, Bell JM, Hook J, Kotov A, Lewis J, Oliva DP, Sheard T, Smith I, Walton L (1996) A software engineering experiment in software component generation. In: Proceedings of the 18th international conference on software engineering (ICSE’96), pp 542–552 – reference: Knight J (2002) Safety critical systems: challenges and directions. In: Proceedings ICSE’02. IEEE, pp 547–550 – reference: Almorsy M, Grundy J, Sadus R, van Straten W, Barnes DG, Kaluza O (2013) A suite of domain-specific visual languages for scientific software application modelling. In: Symposium on Visual Languages and Human-Centric Computing (VL/HCC), 2013. IEEE, pp 91–94 – reference: Korman AK (1971) Industrial and Organizational Psychology. Prentice-Hall – reference: Kolovos DS, Paige RF, Kelly T, Polack FA (2006) Requirements for domain-specific languages. In: Proceedings of ECOOP Workshop on Domain-Specific Program Development (DSPD) – reference: Ricca F, Scanniello G, Torchiano M, Reggio G, Astesiano E (2010) On the effectiveness of screen mockups in requirements engineering: results from an internal replication – reference: Webb CollinsRHevnerARWaltonGHLingerRCThe impacts of function extraction technology on program comprehension: a controlled experimentInf Softw Technol200850111165117910.1016/j.infsof.2008.04.001 – reference: KosarTMartıPEBarrientosPAMernikMA preliminary study on various implementation approaches of domain-specific languageInf Softw Technol200850539040510.1016/j.infsof.2007.04.002 – reference: GalesicMDropouts on the web: Effects of interest and burden experienced during an online surveyJ Off Stat2006222313328 – reference: van Solingen R (1999) Berghout, E. McGraw-Hill, The Goal/Question/Metric Method: A Practical Guide for Quality Improvement of Software Development – reference: FaulkSLohEVanterMLVDSquiresSVottaLGScientific computing’s productivity gridlock: How software engineering can helpComput Sci Eng200911303910.1109/MCSE.2009.205 – reference: Stahl T, Völter M (2006) Model-Driven Software development: Technology, Engineering, Management. Wiley – reference: Fowler M (2010) Domain-Specific Languages. Addison-Wesley – reference: Wohlin C, Runeson P, Höst M, Ohlsson MC, Regnell B, Wesslén A (2012) Experimentation in software engineering. Springer – reference: MernikMHeeringJSloaneAMWhen and how to develop domain-specific languagesACM Comput Surv (CSUR)200537431634410.1145/1118890.1118892 – reference: Hoisl B, Sobernig S, Strembeck M (2014) Comparing three notations for defining scenario-based model tests: a controlled experiment. In: 9th International Conference on the Quality of Information and Communications Technology (QUATIC), pp 95–104 – reference: Johanson AN, Hasselbring W (2014a) Hierarchical combination of internal and external domain-specific languages for scientific computing. In: Proceedings of the 2014 European Conference on Software Architecture Workshops, ACM, ECSAW’14, pp 17:1–17:8 – reference: Kieburtz R, Hook J (1995) Software design for reliability and reuse (sdrr) project phase I final scientific and technical report. Tech. rep. Pacific Software Research Center – reference: Siegmund J, Siegmund N, Apel S (2015) Views on internal and external validity in empirical software engineering. In: IEEE/ACM 37Th IEEE international conference on software engineering (ICSE 2015), pp 9–19 – reference: KosarTBohraSMernikMDomain-specific languages: a systematic mapping studyInf Softw Technol201671779110.1016/j.infsof.2015.11.001 – reference: LikertRA technique for the measurement of attitudesArch Psychol193222140555 – reference: ShapiroSSWilkMBChenHJA comparative study of various tests for normalityJ Am Stat Assoc1968633241343137223706910.1080/01621459.1968.10480932 – reference: Johanson AN (2016) Data and scripts for the Sprat Ecosystem DSL survey. doi:http://dx.doi.org/10.5281/zenodo.61373 – reference: Consel C, Marlet R (1998) Architecture software using a methodology for language development. In: Principles of Declarative Programming, LNCS, vol 1490. Springer, pp 170–194 – reference: Jedlitschka A, Ciolkowski M, Pfahl D (2008) Reporting experiments in software engineering. In: Shull f, Singer J, DI Sjøberg (eds) Guide to advanced empirical software engineering. Springer, pp 201–228 – reference: Prabhu P, Jablin TB, Raman A, Zhang Y, Huang J, Kim H, Johnson NP, Liu F, Ghosh S, Beardl S, Oh T, Zoufaly M, Walker D, August DI (2011) A survey of the practice of computational science. In: State of the Practice Reports, ACM, SC’11, pp 19:1–19:12 – reference: Basili VR, Caldiera G, Rombach HD (1994) Goal question metric paradigm. In: Encyclopedia of Software Engineering. Wiley, pp 528–532 – reference: da SilvaARModel-driven engineering: a survey supported by the unified conceptual modelComput Lang Syst Struct201543139155 – reference: WilcoxonFIndividual comparisons by ranking methodsBiom Bull194516808310.2307/3001968 – reference: Jones B, Kenward M (2014) Design and Analysis of Cross-Over Trials. Taylor & Francis – reference: BasiliVRCruzesDCarverJCHochsteinLMHollingsworthJKZelkowitzMVShullFUnderstanding the high-performance-computing community: a software engineer’s perspectiveIEEE Softw2008254293610.1109/MS.2008.103 – reference: KosarTMernikMCarverJCProgram comprehension of domain-specific and general-purpose languages: Comparison using a family of experimentsEmpir Softw Eng201217327630410.1007/s10664-011-9172-x – reference: Palyart M, Lugato D, Ober I, Bruel J (2012) MDE4HPC: An approach for using model-driven engineering in high-performance computing. In: Proceedings SDL’11: Integrating System and Software Modeling, LNCS, vol 7083, pp 247–261 – reference: Bortz J, Schuster C (2010) Statistik für Human- und Sozialwissenschaftler, 7th edn. Springer – reference: Meliá S, Cachero C, Hermida JM, Aparicio E (2015) Comparison of a textual versus a graphical notation for the maintainability of mde domain models: an empirical pilot study. Softw Qual J:1–27 – reference: Johanson AN, Hasselbring W, Oschlies A, Worm B (2016) Evaluating hierarchical domain-specific languages for computational science: Applying the Sprat approach to a marine ecosystem model. In: Carver j, Hong NPC, Thiruvathukal GK (eds) Software Engineering for Science. Chapman and Hall – reference: April A, Abran A (2012) Software Maintenance Management: Evaluation and Continuous Improvement. Wiley – reference: Hevner AR, Linger RC, Webb Collins R, Pleszkoch MG, Walton GH (2005) The impact of function extraction technology on next-generation software engineering. Tech. rep. Carnegie Mellon University – reference: Bortz J, Döring N (2006) Forschungsmethoden und Evaluation für Human- und Sozialwissenschaftler, 4th edn. Springer – ident: 9483_CR5 doi: 10.1007/978-3-540-33306-7 – volume: 22 start-page: 5 issue: 140 year: 1932 ident: 9483_CR27 publication-title: Arch Psychol – volume: 50 start-page: 390 issue: 5 year: 2008 ident: 9483_CR24 publication-title: Inf Softw Technol doi: 10.1016/j.infsof.2007.04.002 – ident: 9483_CR3 – ident: 9483_CR6 doi: 10.1007/978-3-642-12770-0 – ident: 9483_CR23 – volume: 22 start-page: 313 issue: 2 year: 2006 ident: 9483_CR10 publication-title: J Off Stat – ident: 9483_CR18 doi: 10.1201/b17537 – volume: 63 start-page: 1343 issue: 324 year: 1968 ident: 9483_CR33 publication-title: J Am Stat Assoc doi: 10.1080/01621459.1968.10480932 – ident: 9483_CR19 – ident: 9483_CR7 doi: 10.1007/BFb0056614 – ident: 9483_CR17 – ident: 9483_CR9 – ident: 9483_CR20 doi: 10.1109/ICSE.1996.493448 – volume: 37 start-page: 316 issue: 4 year: 2005 ident: 9483_CR29 publication-title: ACM Comput Surv (CSUR) doi: 10.1145/1118890.1118892 – ident: 9483_CR32 doi: 10.1145/1852786.1852809 – volume: 25 start-page: 29 issue: 4 year: 2008 ident: 9483_CR4 publication-title: IEEE Softw doi: 10.1109/MS.2008.103 – ident: 9483_CR36 – volume: 11 start-page: 30 year: 2009 ident: 9483_CR8 publication-title: Comput Sci Eng doi: 10.1109/MCSE.2009.205 – ident: 9483_CR11 – ident: 9483_CR40 doi: 10.1007/978-3-642-29044-2 – ident: 9483_CR28 – ident: 9483_CR34 doi: 10.1109/ICSE.2015.24 – volume: 43 start-page: 139 year: 2015 ident: 9483_CR35 publication-title: Comput Lang Syst Struct – ident: 9483_CR15 doi: 10.1145/2642803.2642820 – ident: 9483_CR2 – ident: 9483_CR31 doi: 10.1145/2063348.2063374 – ident: 9483_CR22 – ident: 9483_CR13 doi: 10.1007/978-1-84800-044-5_8 – volume: 1 start-page: 80 issue: 6 year: 1945 ident: 9483_CR39 publication-title: Biom Bull doi: 10.2307/3001968 – volume: 17 start-page: 276 issue: 3 year: 2012 ident: 9483_CR25 publication-title: Empir Softw Eng doi: 10.1007/s10664-011-9172-x – ident: 9483_CR1 doi: 10.1109/VLHCC.2013.6645249 – volume: 71 start-page: 77 year: 2016 ident: 9483_CR26 publication-title: Inf Softw Technol doi: 10.1016/j.infsof.2015.11.001 – ident: 9483_CR37 – ident: 9483_CR14 doi: 10.5281/zenodo.61373 – ident: 9483_CR16 – ident: 9483_CR21 doi: 10.1145/581339.581406 – ident: 9483_CR30 doi: 10.1007/978-3-642-25264-8_19 – ident: 9483_CR12 – volume: 50 start-page: 1165 issue: 11 year: 2008 ident: 9483_CR38 publication-title: Inf Softw Technol doi: 10.1016/j.infsof.2008.04.001 |
| SSID | ssj0009745 |
| Score | 2.2944398 |
| Snippet | It is a long-standing hypothesis that the concise and customized notation of a DSL improves the performance of developers when compared with a GPL. For... |
| SourceID | proquest crossref springer |
| SourceType | Aggregation Database Enrichment Source Index Database Publisher |
| StartPage | 2206 |
| SubjectTerms | Compilers Computer Science Computer simulation Domain specific languages Ecological monitoring Ecosystems Hypotheses Interpreters Modelling Performance enhancement Programming Languages Software Engineering/Programming and Operating Systems |
| Title | Effectiveness and efficiency of a domain-specific language for high-performance marine ecosystem simulation: a controlled experiment |
| URI | https://link.springer.com/article/10.1007/s10664-016-9483-z https://www.proquest.com/docview/2063608728 |
| Volume | 22 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1NS8MwGA66Xbz4LU7nyMGTEmiTLEm9Ddkcip4czFPJJwjuAzcvO_vDTdp0VVHBc9ME-iR53zTP87wAnIewh01XIA-ARH5SMKSE04gbSznnNmGFiv_-gQ1H9HbcHUcd96Jiu1dXksVO_UnsxlhgTDCUUUHQahM0u_7oHnhcI9yrnXZ5UZk4eOsh4seurjJ_6uJrMKozzG-XokWsGeyC7Zgkwl6J6h7YsNN9sFMVYIBxPR6A99J7OG5YUE4NtIUlRNBTwpmDEprZxJ_9URBUBlIQrP5PQp-swuBVjOa1dABOZBADQn8kLR2e4eJ5Eut7XfnOIq_9xfpx1pUBDsFo0H-8HqJYVgFpwugSYWE0pxmXmcq0SbXimqcpw0IbohJJHGeaOMoJN6lVInFCayt9msEUVkoocgQa09nUHgPoKKEyzailSlLDEikdS5xHObWJkIK1QFJ931xHz_FQ-uIlr92SAyR54JkFSPJVC1ysX5mXhht_NW5XoOVx7S1ynAQPNMGxaIHLCsj68a-dnfyr9SnYwiHCF1zANmgsX9_smc9PlqoDmr2bp7t-p5iXHxpd4aQ |
| linkProvider | Springer Nature |
| linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV09T8MwELWgDLDwjSgU8MAEspTEru2wVYiqQNuplbpF_pSQ2rSiZenMD8dOnQYQIDHHOUt5Z985vvcOgGsf9hLd5MgBIJBzCooktwoxbQhjzES0YPH3-rQzJE-j5ijwuOdltXt5JVns1J_IbpT6igmKUsIxWm6CLZcLcO_Kw6RVKe2yojOx19ZD2M1dXmX-ZOJrMKoyzG-XokWsae-D3ZAkwtYK1QOwYfJDsFc2YIBhPR6B95X2cNiwoMg1NIUkhOdTwqmFAurpxJ39kSdU-qIgWP6fhC5ZhV6rGM0q6gCcCE8GhO5IulJ4hvOXSejvdeeMhbr2sXHzrDsDHINh-2Fw30GhrQJSmJIFSrhWjKRMpDJVOlaSKRbHNOFKYxkJbBlV2BKGmY6N5JHlShnh0gwqEym5xCeglk9zcwqgJZiIOCWGSEE0jYSwNLIO5dhEXHBaB1H5fTMVNMd964txVqkle0gyX2fmIcmWdXCzfmW2Etz4a3CjBC0La2-eJZHXQOMs4XVwWwJZPf7V2Nm_Rl-B7c6g1826j_3nc7CT-Ghf1AU2QG3x-mYuXK6ykJeFb34AzKbjAw |
| linkToPdf | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3LSsQwFA06grjxLY6OmoUrJdgmMUndDeowPnHhgLuSJwhOZ3DGjWs_3KRNrYoKrpumpSfpve295xwA9kPYw-ZYIA-ARH5RMKSE04gbSznnNmEli__mlvUH9PLh-CH6nE7qbve6JFlxGoJKUzE9Ght39In4xljonmAoo4Kg11kwRwMZ2C_oAe42qru8dCkOOnuI-Puoy5o_TfE1MDXZ5rcCaRl3estgMSaMsFshvAJmbLEKlmozBhj35hp4q3SI48sLysJAW8pDBG4lHDkooRkN5WOBArkyNAjB-l8l9IkrDLrFaNzQCOBQBmIg9J-nldoznDwOo9fXiZ8s9rg_WX-dD5eAdTDond-f9lG0WECaMDpFWBjNacZlpjJtUq245mnKsNCGqEQSx5kmjnLCTWqVSJzQ2kqfcjCFlRKKbIBWMSrsJoCOEirTjFqqJDUskdKxxHnEU5sIKVgbJPXzzXXUHw82GE95o5wcIMlDz1mAJH9tg4OPU8aV-MZfgzs1aHnch5McJ0EPTXAs2uCwBrI5_OtkW_8avQfm7856-fXF7dU2WMAh8Jctgh3Qmj6_2B2ftkzVbrk03wGdxOc2 |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Effectiveness+and+efficiency+of+a+domain-specific+language+for+high-performance+marine+ecosystem+simulation%3A+a+controlled+experiment&rft.jtitle=Empirical+software+engineering+%3A+an+international+journal&rft.au=Johanson%2C+Arne+N.&rft.au=Hasselbring%2C+Wilhelm&rft.date=2017-08-01&rft.pub=Springer+US&rft.issn=1382-3256&rft.eissn=1573-7616&rft.volume=22&rft.issue=4&rft.spage=2206&rft.epage=2236&rft_id=info:doi/10.1007%2Fs10664-016-9483-z&rft.externalDocID=10_1007_s10664_016_9483_z |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1382-3256&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1382-3256&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1382-3256&client=summon |