The Crowd in Requirements Engineering: The Landscape and Challenges

Crowd-based requirements engineering (CrowdRE) could significantly change RE. Performing RE activities such as elicitation with the crowd of stakeholders turns RE into a participatory effort, leads to more accurate requirements, and ultimately boosts software quality. Although any stakeholder in the...

Full description

Saved in:
Bibliographic Details
Published inIEEE software Vol. 34; no. 2; pp. 44 - 52
Main Authors Groen, Eduard C., Seyff, Norbert, Ali, Raian, Dalpiaz, Fabiano, Doerr, Joerg, Guzman, Emitza, Hosseini, Mahmood, Marco, Jordi, Oriol, Marc, Perini, Anna, Stade, Melanie
Format Journal Article Publication
LanguageEnglish
Published Los Alamitos IEEE 01.03.2017
IEEE Computer Society
Subjects
Online AccessGet full text

Cover

Loading…
Abstract Crowd-based requirements engineering (CrowdRE) could significantly change RE. Performing RE activities such as elicitation with the crowd of stakeholders turns RE into a participatory effort, leads to more accurate requirements, and ultimately boosts software quality. Although any stakeholder in the crowd can contribute, CrowdRE emphasizes one stakeholder group whose role is often trivialized: users. CrowdRE empowers the management of requirements, such as their prioritization and segmentation, in a dynamic, evolved style through collecting and harnessing a continuous flow of user feedback and monitoring data on the usage context. To analyze the large amount of data obtained from the crowd, automated approaches are key. This article presents current research topics in CrowdRE; discusses the benefits, challenges, and lessons learned from projects and experiments; and assesses how to apply the methods and tools in industrial contexts. This article is part of a special issue on Crowdsourcing for Software Engineering.
AbstractList Crowd-based requirements engineering (CrowdRE) could significantly change RE. Performing RE activities such as elicitation with the crowd of stakeholders turns RE into a participatory effort, leads to more accurate requirements, and ultimately boosts software quality. Although any stakeholder in the crowd can contribute, CrowdRE emphasizes one stakeholder group whose role is often trivialized: users. CrowdRE empowers the management of requirements, such as their prioritization and segmentation, in a dynamic, evolved style through collecting and harnessing a continuous flow of user feedback and monitoring data on the usage context. To analyze the large amount of data obtained from the crowd, automated approaches are key. This article presents current research topics in CrowdRE; discusses the benefits, challenges, and lessons learned from projects and experiments; and assesses how to apply the methods and tools in industrial contexts. This article is part of a special issue on Crowdsourcing for Software Engineering.
(c) 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works. Crowd-based requirements engineering (CrowdRE) could significantly change RE. Performing RE activities such as elicitation with the crowd of stakeholders turns RE into a participatory effort, leads to more accurate requirements, and ultimately boosts software quality. Although any stakeholder in the crowd can contribute, CrowdRE emphasizes one stakeholder group whose role is often trivialized: users. CrowdRE empowers the management of requirements, such as their prioritization and segmentation, in a dynamic, evolved style through collecting and harnessing a continuous flow of user feedback and monitoring data on the usage context. To analyze the large amount of data obtained from the crowd, automated approaches are key. This article presents current research topics in CrowdRE; discusses the benefits, challenges, and lessons learned from projects and experiments; and assesses how to apply the methods and tools in industrial contexts. This article is part of a special issue on Crowdsourcing for Software Engineering. Peer Reviewed
Author Perini, Anna
Stade, Melanie
Doerr, Joerg
Hosseini, Mahmood
Oriol, Marc
Dalpiaz, Fabiano
Guzman, Emitza
Seyff, Norbert
Ali, Raian
Marco, Jordi
Groen, Eduard C.
Author_xml – sequence: 1
  givenname: Eduard C.
  surname: Groen
  fullname: Groen, Eduard C.
  email: eduard.groen@iese.fraunhofer.de
  organization: Fraunhofer Inst. for Exp. Software Eng., Kaiserslautern, Germany
– sequence: 2
  givenname: Norbert
  surname: Seyff
  fullname: Seyff, Norbert
  email: norbert.seyff@fhnw.ch
  organization: Univ. of Appl. Sci. & Arts Northwestern Switzerland, Windisch, Switzerland
– sequence: 3
  givenname: Raian
  surname: Ali
  fullname: Ali, Raian
  email: rali@bournemouth.ac.uk
  organization: Bournemouth Univ., Bournemouth, UK
– sequence: 4
  givenname: Fabiano
  surname: Dalpiaz
  fullname: Dalpiaz, Fabiano
  email: f.dalpiaz@uu.nl
  organization: Utrecht Univ., Utrecht, Netherlands
– sequence: 5
  givenname: Joerg
  surname: Doerr
  fullname: Doerr, Joerg
  email: joerg.doerr@iese.fraunhofer.de
  organization: Fraunhofer Inst. for Exp. Software Eng., Kaiserslautern, Germany
– sequence: 6
  givenname: Emitza
  surname: Guzman
  fullname: Guzman, Emitza
  email: guzman@ifi.uzh.ch
  organization: Univ. of Zurich, Zurich, Swaziland
– sequence: 7
  givenname: Mahmood
  surname: Hosseini
  fullname: Hosseini, Mahmood
  email: mhosseini@bournemouth.ac.uk
  organization: Bournemouth Univ., Bournemouth, UK
– sequence: 8
  givenname: Jordi
  surname: Marco
  fullname: Marco, Jordi
  email: jmarco@cs.upc.edu
  organization: Polytech. Univ. of Catalonia, Barcelona, Spain
– sequence: 9
  givenname: Marc
  surname: Oriol
  fullname: Oriol, Marc
  email: moriol@essi.upc.edu
  organization: Polytech. Univ. of Catalonia, Barcelona, Spain
– sequence: 10
  givenname: Anna
  surname: Perini
  fullname: Perini, Anna
  email: perini@fbk.eu
  organization: FBK Center for Inf. & Commun. Technol., Povo, Italy
– sequence: 11
  givenname: Melanie
  surname: Stade
  fullname: Stade, Melanie
  email: melanie.stade@fhnw.ch
  organization: Univ. of Appl. Sci. & Arts Northwestern Switzerland, Windisch, Switzerland
BookMark eNptkM1Lw0AQxRepYFu9ePUS8Cak7mQ3za43CfUDWgRbz8t2M223pJt2N0H8701oURAPw8wwv_cY3oD0XOWQkGugIwAq72fzUUIhGzF2RvogWRZzkLxH-jTjNM54Ki_IIIQtpTQFRvskX2wwyn31WUTWRe94aKzHHbo6RBO3tg7RW7d-iDpsql0RjN5j1A5RvtFliW6N4ZKcr3QZ8OrUh-TjabLIX-Lp2_Nr_jiNDUuzOpZQ8ELKlHNqpNFIueSGyWViUia0BDNGnqwSNuYIoLnRAJgYkWq95EJKzoYEjr4mNEZ5NOiNrlWl7e_SVUKzRCWCZwxaze1Rs_fVocFQq23VeNe-qUAIxtKUMdlS9OTsqxA8rpSxta5t5WqvbamAqi5eNZurLl7FWCu5-yPZe7vT_ut_-OYIW0T8ATMhBG-v36-dgzg
CODEN IESOEG
CitedBy_id crossref_primary_10_1007_s00766_020_00344_y
crossref_primary_10_1007_s00766_020_00345_x
crossref_primary_10_1016_j_csi_2019_103389
crossref_primary_10_1109_ACCESS_2024_3409847
crossref_primary_10_1016_j_infsof_2021_106635
crossref_primary_10_4018_IJITSA_289999
crossref_primary_10_1109_MMUL_2021_3122539
crossref_primary_10_1109_ACCESS_2018_2879385
crossref_primary_10_1145_3635712
crossref_primary_10_1007_s00766_019_00314_z
crossref_primary_10_1007_s10664_024_10463_7
crossref_primary_10_1109_MS_2020_2986047
crossref_primary_10_1016_j_is_2023_102181
crossref_primary_10_1016_j_jss_2023_111792
crossref_primary_10_1109_MITP_2021_3105253
crossref_primary_10_3390_su16229794
crossref_primary_10_1002_smr_2199
crossref_primary_10_1002_smr_2332
crossref_primary_10_1007_s00766_023_00407_w
crossref_primary_10_1016_j_procs_2017_06_087
crossref_primary_10_1007_s00766_021_00353_5
crossref_primary_10_1007_s00766_021_00357_1
crossref_primary_10_1007_s10664_024_10546_5
crossref_primary_10_1145_3643677
crossref_primary_10_1016_j_infsof_2024_107516
crossref_primary_10_1016_j_eswa_2024_125524
crossref_primary_10_1016_j_is_2018_08_003
crossref_primary_10_3390_software2020008
crossref_primary_10_1002_smr_2721
crossref_primary_10_1109_TSE_2018_2823327
crossref_primary_10_54452_jrb_1033300
crossref_primary_10_1007_s11390_020_0293_9
crossref_primary_10_1007_s10515_023_00397_7
crossref_primary_10_1016_j_procs_2019_12_042
crossref_primary_10_1109_TSE_2021_3066330
crossref_primary_10_1016_j_jss_2019_110516
crossref_primary_10_1109_ACCESS_2021_3073379
crossref_primary_10_1002_smr_1990
crossref_primary_10_1007_s00766_022_00384_6
crossref_primary_10_1007_s00766_022_00387_3
crossref_primary_10_1109_TSE_2022_3219458
crossref_primary_10_1016_j_dib_2020_105656
crossref_primary_10_1109_MS_2018_2883876
crossref_primary_10_1145_3447332_3447335
crossref_primary_10_1007_s42979_020_00416_4
crossref_primary_10_1093_comjnl_bxz167
crossref_primary_10_2139_ssrn_4098744
crossref_primary_10_1145_3479982
Cites_doi 10.3233/AO-150150
10.1145/2593902.2593927
10.1186/s13174-015-0021-9
10.1109/TSE.2011.36
10.1109/RE.2016.67
10.1109/RCIS.2014.6861072
10.1109/ICC.2012.6363979
10.1109/RE.2015.7320414
10.1007/s007660200002
10.1109/RE.2016.40
10.1007/3-540-28244-0_13
10.1109/CrowdRE.2015.7367583
10.1109/JSEN.2012.2233469
10.1145/2568225.2568249
10.1109/RCIS.2015.7128868
10.1145/1639950.1640068
10.1109/CrowdRE.2015.7367581
ContentType Journal Article
Publication
Contributor Universitat Politècnica de Catalunya. Departament d'Enginyeria de Serveis i Sistemes d'Informació
Universitat Politècnica de Catalunya. inSSIDE - integrated Software, Service, Information and Data Engineering
Universitat Politècnica de Catalunya. Departament de Ciències de la Computació
Contributor_xml – sequence: 1
  fullname: Universitat Politècnica de Catalunya. Departament de Ciències de la Computació
– sequence: 2
  fullname: Universitat Politècnica de Catalunya. Departament d'Enginyeria de Serveis i Sistemes d'Informació
– sequence: 3
  fullname: Universitat Politècnica de Catalunya. inSSIDE - integrated Software, Service, Information and Data Engineering
Copyright Copyright IEEE Computer Society 2017
info:eu-repo/semantics/openAccess
Copyright_xml – notice: Copyright IEEE Computer Society 2017
– notice: info:eu-repo/semantics/openAccess
DBID 97E
RIA
RIE
AAYXX
CITATION
JQ2
XX2
DOI 10.1109/MS.2017.33
DatabaseName IEEE Xplore (IEEE)
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE Electronic Library (IEL)
CrossRef
ProQuest Computer Science Collection
Recercat
DatabaseTitle CrossRef
ProQuest Computer Science Collection
DatabaseTitleList

ProQuest Computer Science Collection
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Computer Science
EISSN 1937-4194
EndPage 52
ExternalDocumentID oai_recercat_cat_2072_284731
10_1109_MS_2017_33
7888433
Genre orig-research
GroupedDBID -DZ
-~X
.4S
.DC
0R~
29I
3EH
4.4
5GY
5VS
6IK
7WY
85S
88I
8FE
8FG
8FL
8G5
8R4
8R5
97E
9M8
AAJGR
AARMG
AASAJ
AAVXG
AAWTH
ABAZT
ABJCF
ABQJQ
ABUWG
ABVLG
ACGFO
ACGOD
ACIWK
AENEX
AETIX
AFKRA
AFOGA
AGCDD
AGQYO
AGSQL
AHBIQ
AI.
AIBXA
AKJIK
AKQYR
ALLEH
ALMA_UNASSIGNED_HOLDINGS
ARAPS
ARCSS
ASUFR
ATWAV
AZLTO
AZQEC
BEFXN
BENPR
BEZIV
BFFAM
BGLVJ
BGNUA
BKEBE
BKOMP
BPEOZ
BPHCQ
CCPQU
CS3
DU5
DWQXO
EBS
EDO
EJD
FRNLG
GNUQQ
GUQSH
HCIFZ
HZ~
H~9
I-F
IBMZZ
ICLAB
IEDLZ
IFIPE
IFJZH
IPLJI
ITG
ITH
JAVBF
K60
K6V
K6~
K7-
L6V
LAI
M0C
M1Q
M2O
M2P
M43
M7S
MS~
O9-
OCL
OHT
P2P
P62
PHGZM
PHGZT
PQBIZ
PQBZA
PQGLB
PQQKQ
PROAC
PTHSS
PUEGO
Q2X
RIA
RIE
RNI
RNS
RXW
RZB
TAE
TN5
UHB
UKR
UQL
VH1
WH7
YZZ
ZCG
AAYOK
AAYXX
ABGFU
CITATION
RIG
JQ2
XX2
ID FETCH-LOGICAL-c357t-91d4d995440c9cae0494c39b2c538a91c6e42f2364e11a4ca11e2c85aab489943
IEDL.DBID RIE
ISSN 0740-7459
IngestDate Fri Aug 29 12:29:23 EDT 2025
Wed Aug 13 08:41:46 EDT 2025
Tue Jul 01 01:48:35 EDT 2025
Thu Apr 24 22:52:33 EDT 2025
Wed Aug 27 02:41:41 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 2
Language English
License https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c357t-91d4d995440c9cae0494c39b2c538a91c6e42f2364e11a4ca11e2c85aab489943
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
OpenAccessLink https://recercat.cat/handle/2072/284731
PQID 1883355339
PQPubID 37787
PageCount 9
ParticipantIDs crossref_citationtrail_10_1109_MS_2017_33
ieee_primary_7888433
proquest_journals_1883355339
csuc_recercat_oai_recercat_cat_2072_284731
crossref_primary_10_1109_MS_2017_33
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2017-03-01
PublicationDateYYYYMMDD 2017-03-01
PublicationDate_xml – month: 03
  year: 2017
  text: 2017-03-01
  day: 01
PublicationDecade 2010
PublicationPlace Los Alamitos
PublicationPlace_xml – name: Los Alamitos
PublicationTitle IEEE software
PublicationTitleAbbrev S-M
PublicationYear 2017
Publisher IEEE
IEEE Computer Society
Publisher_xml – name: IEEE
– name: IEEE Computer Society
References ref13
ref12
ref15
ref14
pagano (ref21) 2013
ref11
ref10
groen (ref9) 0
ref2
ref16
panichella (ref18) 0
ali (refS2) 0
ref23
galvis carreño (ref19) 0
refS1
ref20
dheepa (ref1) 2013; 2
ali (ref22) 0
ref8
ref7
morales-ramirez (ref17) 2014
ref4
ref3
ref6
ref5
References_xml – start-page: 215
  year: 2014
  ident: ref17
  article-title: Towards Supporting the Analysis of Online Discussions in OSS Communities: A Speech-Act Based Approach
  publication-title: Information Systems Engineering in Complex Environments
– ident: ref11
  doi: 10.3233/AO-150150
– ident: ref16
  doi: 10.1145/2593902.2593927
– year: 2013
  ident: ref21
  publication-title: PORTNEUF - A Framework for Continuous User Involvement
– ident: ref14
  doi: 10.1186/s13174-015-0021-9
– ident: refS1
  doi: 10.1109/TSE.2011.36
– ident: ref8
  doi: 10.1109/RE.2016.67
– ident: ref12
  doi: 10.1109/RCIS.2014.6861072
– ident: ref6
  doi: 10.1109/ICC.2012.6363979
– ident: ref15
  doi: 10.1109/RE.2015.7320414
– start-page: 247
  year: 0
  ident: ref9
  article-title: Towards Crowd-Based Requirements Engineering: A Research Preview
  publication-title: Requirements Engineering Foundation for Software Quality
– ident: ref4
  doi: 10.1007/s007660200002
– ident: ref20
  doi: 10.1109/RE.2016.40
– start-page: 281
  year: 0
  ident: ref18
  article-title: How Can I Improve My App? Classifying User Reviews for Software Maintenance and Evolution
  publication-title: Proc 31st Int'l Conf Software Maintenance and Evolution (ICSME 15)
– start-page: 75
  year: 0
  ident: refS2
  article-title: Social Adaptation: When Software Gives Users a Voice
  publication-title: Proc 7th Int'l Conf Evaluation of Novel Approaches to Software Eng (ENASE 12)
– ident: ref3
  doi: 10.1007/3-540-28244-0_13
– ident: ref7
  doi: 10.1109/CrowdRE.2015.7367583
– ident: ref23
  doi: 10.1109/JSEN.2012.2233469
– ident: ref10
  doi: 10.1145/2568225.2568249
– ident: ref5
  doi: 10.1109/RCIS.2015.7128868
– ident: ref2
  doi: 10.1145/1639950.1640068
– start-page: 582
  year: 0
  ident: ref19
  article-title: Analysis of User Comments: An Approach for Software Requirements Evolution
  publication-title: Proc 35th Int'l Conf Software Eng (ICSE 13)
– volume: 2
  start-page: 375
  year: 2013
  ident: ref1
  article-title: A Novel Method for Large Scale Requirement Elicitation
  publication-title: International Journal of Engineering and Innovative Technology
– ident: ref13
  doi: 10.1109/CrowdRE.2015.7367581
– start-page: 75
  year: 0
  ident: ref22
  article-title: Social Adaptation: When Software Gives Users a Voice
  publication-title: Proc 7th Int'l Conf Evaluation of Novel Approaches to Software Eng (ENASE 12)
SSID ssj0005130
Score 2.5669434
Snippet Crowd-based requirements engineering (CrowdRE) could significantly change RE. Performing RE activities such as elicitation with the crowd of stakeholders turns...
(c) 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/republishing this...
SourceID csuc
proquest
crossref
ieee
SourceType Open Access Repository
Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 44
SubjectTerms Context awareness
Context modeling
Continuous flow
crowd-based requirements engineering
CrowdRE
Crowdsourcing
Enginyeria de programari
Enginyeria del software
Informàtica
Monitoring
Object-oriented programming (Computer science)
Programació orientada a l'objecte (Informàtica)
Requirements analysis
requirements engineering
Software
Software development
Software engineering
software requirements
Stakeholders
user feedback
Àrees temàtiques de la UPC
Title The Crowd in Requirements Engineering: The Landscape and Challenges
URI https://ieeexplore.ieee.org/document/7888433
https://www.proquest.com/docview/1883355339
https://recercat.cat/handle/2072/284731
Volume 34
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1Li9swEB6yOfXStJuWpk2LYHtpaR6y5Dje2xJ2WZZND00DuQl5PIbSJVsS-7K_fmdkO33lsAeDDLIYPNI8pE_fAHzM4iL1Wmj2taeRNViwHQyJa14QO2TMKKAtvs6u1_ZmE2868OVwF4aIAviMxtIMZ_n5PVayVTaRdM0acwIn3Krvav2Gc-hQV4Q94nSU2DhtqEhZjMlyJRCuZGzMX86ni_sKm6Iq_1ni4F6uerBsBatRJT_HVZmN8eEfzsanSv4CnjdxprqoJ8ZL6ND2FHptDQfVLOk-LHieqAXn4rn6sVXfSIDBYcdwr_6gKjxX0u1WrgULYEpxQy3aMiz7V7C-uvy-uB41hRVGaOKkZAOX21yI4OwUU_QkHDFo0ixCNn8-1TgjGxVCLU-sQotea4pwHnufWc7PrHkN3e39lt6AynzKQczM-Blam_m514WdU5HwUIWxMQ3gU_vHHTas41L84s6F7GOauuXKiXacMQM4O_T9VXNtHO31WRTn2CHQDn3phCD78CJPNE0iJ27X6AH0RRmH4Ro9DGDYqts1a3bvtNRdjjn8Td8e_-odPBMZagTaELrlrqL3HJKU2YcwFx8B3vLdMA
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LT9tAEB5BOMAFSmnVAIWV2guIhKx3Hce9VVFRgIQDD4nbaj0eS1WrgIhz4dczs7ZTXoceLK2l9Wrk2Z3H7rffAHzP4iL1Wmj2taeONViwHQyJa14QO2TMKKAtLvqjG3t2G98uwdHiLgwRBfAZdaUZzvLzO5zLVtmxpGvWmGVYYb8fR9VtrX-ADh0qi7BP7HUSG6c1GSkLcjy5EhBX0jXmhftp4WyOdVmVN7Y4OJiTDZg0olW4kj_deZl18fEVa-P_yv4B1utIU_2spsYmLNH0I2w0VRxUvai3YMgzRQ05G8_V76m6JIEGhz3DmXpGVvhDSbexXAwWyJTihho2hVhmn-Dm5Nf1cNSpSyt00MRJySYut7lQwdkepuhJWGLQpFmEbAB9qrFPNiqEXJ5YiRa91hThIPY-s5yhWfMZWtO7KX0BlfmUw5i-8X20NvMDrws7oCLhoQpjY2rDQfPHHda841L-4q8L-UcvdZMrJ9pxxrTh26LvfcW28W6vQ1GcY5dAD-hLJxTZixd5ol4SOXG8RrdhS5SxGK7WQxt2G3W7etXOnJbKyzEHwOn2-1_tw-roejJ249OL8x1YE3kqPNoutMqHOX3lAKXM9sK8fAKULeB6
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+Crowd+in+Requirements+Engineering%3A+The+Landscape+and+Challenges&rft.jtitle=IEEE+software&rft.au=Groen%2C+Eduard+C.&rft.au=Seyff%2C+Norbert&rft.au=Ali%2C+Raian&rft.au=Dalpiaz%2C+Fabiano&rft.date=2017-03-01&rft.pub=IEEE&rft.issn=0740-7459&rft.volume=34&rft.issue=2&rft.spage=44&rft.epage=52&rft_id=info:doi/10.1109%2FMS.2017.33&rft.externalDocID=7888433
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0740-7459&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0740-7459&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0740-7459&client=summon