Crowdsourcing Quality of Experience Experiments
Crowdsourcing enables new possibilities for QoE evaluation by moving the evaluation task from the traditional laboratory environment into the Internet, allowing researchers to easily access a global pool of workers for the evaluation task. This makes it not only possible to include a more diverse po...
Saved in:
| Published in | Evaluation in the Crowd. Crowdsourcing and Human-Centered Experiments Vol. 10264; pp. 154 - 190 |
|---|---|
| Main Authors | , , , , , , , |
| Format | Book Chapter |
| Language | English |
| Published |
Switzerland
Springer International Publishing AG
2017
Springer International Publishing |
| Series | Lecture Notes in Computer Science |
| Online Access | Get full text |
Cover
Loading…
| Abstract | Crowdsourcing enables new possibilities for QoE evaluation by moving the evaluation task from the traditional laboratory environment into the Internet, allowing researchers to easily access a global pool of workers for the evaluation task. This makes it not only possible to include a more diverse population and real-life environments into the evaluation, but also reduces the turn-around time and increases the number of subjects participating in an evaluation campaign significantly, thereby circumventing bottle-necks in traditional laboratory setups. In order to utilise these advantages, the differences between laboratory-based and crowd-based QoE evaluation are discussed in this chapter. |
|---|---|
| AbstractList | Crowdsourcing enables new possibilities for QoE evaluation by moving the evaluation task from the traditional laboratory environment into the Internet, allowing researchers to easily access a global pool of workers for the evaluation task. This makes it not only possible to include a more diverse population and real-life environments into the evaluation, but also reduces the turn-around time and increases the number of subjects participating in an evaluation campaign significantly, thereby circumventing bottle-necks in traditional laboratory setups. In order to utilise these advantages, the differences between laboratory-based and crowd-based QoE evaluation are discussed in this chapter. |
| Author | Naderi, Babak Möller, Sebastian Saupe, Dietmar Redi, Judith Hirth, Matthias Egger-Lampl, Sebastian Hoßfeld, Tobias Keimel, Christian |
| Author_xml | – sequence: 1 givenname: Sebastian surname: Egger-Lampl fullname: Egger-Lampl, Sebastian email: sebastian.egger-lampl@ait.ac.at organization: Austrian Institute of Technology, Vienna, Austria – sequence: 2 givenname: Judith surname: Redi fullname: Redi, Judith organization: Delft University of Technology, Delft, Netherlands – sequence: 3 givenname: Tobias surname: Hoßfeld fullname: Hoßfeld, Tobias organization: University of Duisburg-Essen, Duisburg, Germany – sequence: 4 givenname: Matthias surname: Hirth fullname: Hirth, Matthias organization: University of Würzburg, Würzburg, Germany – sequence: 5 givenname: Sebastian surname: Möller fullname: Möller, Sebastian organization: TU Berlin, Berlin, Germany – sequence: 6 givenname: Babak surname: Naderi fullname: Naderi, Babak organization: TU Berlin, Berlin, Germany – sequence: 7 givenname: Christian surname: Keimel fullname: Keimel, Christian organization: Technische Universität München, Munich, Germany – sequence: 8 givenname: Dietmar surname: Saupe fullname: Saupe, Dietmar organization: University of Konstanz, Konstanz, Germany |
| BookMark | eNo1kMtOAzEMRQMURFv6BWz6A6Fx3lmiqjykSggJ1lEmk5RCmRmSqYC_J32wsn2ta12fERo0bRMQugZyA4SomVEaM8zAYCk5E5hbdYImRWVF20v8FA1BAmDGuDlDo_8F5wM0JIxQbBRnF2gERErQCoBeoknO74SQMkpCzRDN5qn9rnO7TX7drKbPW7dZ97_TNk4XP11I69D4cGw_Q9PnK3Qe3SaHybGO0evd4mX-gJdP94_z2yVeUUEUBl1rMMJwMDXzDnisjWOcupryGIiolNOq1k77SsQYKs19jFxqzzQNHhQbIzjczV0qwUKyVdt-ZAvE7vDYAsIyWz62exa24CkefvB0qf3ahtzbsDP5kju5jX9zXR9StkIYYni5Q7UFSdkf5HRk5A |
| ContentType | Book Chapter |
| Copyright | Springer International Publishing AG 2017 |
| Copyright_xml | – notice: Springer International Publishing AG 2017 |
| DBID | FFUUA |
| DEWEY | 5.4370000000000003 |
| DOI | 10.1007/978-3-319-66435-4_7 |
| DatabaseName | ProQuest Ebook Central - Book Chapters - Demo use only |
| DatabaseTitleList | |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Computer Science |
| EISBN | 9783319664354 3319664352 |
| EISSN | 1611-3349 |
| Editor | Purchase, Helen Archambault, Daniel Hoßfeld, Tobias |
| Editor_xml | – sequence: 1 fullname: Archambault, Daniel – sequence: 1 givenname: Daniel surname: Archambault fullname: Archambault, Daniel email: d.w.archambault@swansea.ac.uk – sequence: 2 fullname: Purchase, Helen – sequence: 2 givenname: Helen surname: Purchase fullname: Purchase, Helen email: hcp@dcs.gla.ac.uk – sequence: 3 fullname: Hoßfeld, Tobias – sequence: 3 givenname: Tobias surname: Hoßfeld fullname: Hoßfeld, Tobias email: tobias.hossfeld@uni-due.de |
| EndPage | 190 |
| ExternalDocumentID | EBC5590940_128_162 |
| GroupedDBID | 0D6 0DA 38. AABBV AALVI ABBVZ ABHTH ABQUB ACDJR ADCXD AEDXK AEJLV AEKFX AEZAY AGIGN AGYGE AIODD ALBAV ALMA_UNASSIGNED_HOLDINGS AZZ BATQV BBABE CVWCR CZZ FFUUA I4C IEZ LDH NUC SAO SBO SWYDZ TPJZQ TSXQS Z5O Z7R Z7S Z7U Z7V Z7W Z7X Z7Z Z81 Z82 Z83 Z84 Z87 Z88 -DT -~X 29L 2HA 2HV ACGFS EJD F5P LAS P2P RSU ~02 |
| ID | FETCH-LOGICAL-g2507-18d81959419d3ca14fd9a342ad24fe05b7a87d8a8cb5ffeb84cff468c382ec173 |
| ISBN | 3319664344 9783319664347 |
| ISSN | 0302-9743 |
| IngestDate | Tue Oct 01 18:38:58 EDT 2024 Thu Jul 25 23:08:02 EDT 2024 |
| IsDoiOpenAccess | false |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| LCCallNum | QA76.9.U83 |
| Language | English |
| LinkModel | OpenURL |
| MergedId | FETCHMERGED-LOGICAL-g2507-18d81959419d3ca14fd9a342ad24fe05b7a87d8a8cb5ffeb84cff468c382ec173 |
| OCLC | 1066187112 |
| OpenAccessLink | https://ir.cwi.nl/pub/27199/10.1007_978-3-319-66435-4-7.pdf |
| PQID | EBC5590940_128_162 |
| PageCount | 37 |
| ParticipantIDs | springer_books_10_1007_978_3_319_66435_4_7 proquest_ebookcentralchapters_5590940_128_162 |
| PublicationCentury | 2000 |
| PublicationDate | 2017-00-00 |
| PublicationDateYYYYMMDD | 2017-01-01 |
| PublicationDate_xml | – year: 2017 text: 2017-00-00 |
| PublicationDecade | 2010 |
| PublicationPlace | Switzerland |
| PublicationPlace_xml | – name: Switzerland – name: Cham |
| PublicationSeriesSubtitle | Information Systems and Applications, incl. Internet/Web, and HCI |
| PublicationSeriesTitle | Lecture Notes in Computer Science |
| PublicationSeriesTitleAlternate | Lect.Notes Computer |
| PublicationSubtitle | Dagstuhl Seminar 15481, Dagstuhl Castle, Germany, November 22 - 27, 2015, Revised Contributions |
| PublicationTitle | Evaluation in the Crowd. Crowdsourcing and Human-Centered Experiments |
| PublicationYear | 2017 |
| Publisher | Springer International Publishing AG Springer International Publishing |
| Publisher_xml | – name: Springer International Publishing AG – name: Springer International Publishing |
| RelatedPersons | Kleinberg, Jon M. Mattern, Friedemann Naor, Moni Mitchell, John C. Terzopoulos, Demetri Steffen, Bernhard Pandu Rangan, C. Kanade, Takeo Kittler, Josef Weikum, Gerhard Hutchison, David Tygar, Doug |
| RelatedPersons_xml | – sequence: 1 givenname: David surname: Hutchison fullname: Hutchison, David organization: Lancaster University, Lancaster, United Kingdom – sequence: 2 givenname: Takeo surname: Kanade fullname: Kanade, Takeo organization: Carnegie Mellon University, Pittsburgh, USA – sequence: 3 givenname: Josef surname: Kittler fullname: Kittler, Josef organization: University of Surrey, Guildford, United Kingdom – sequence: 4 givenname: Jon M. surname: Kleinberg fullname: Kleinberg, Jon M. organization: Cornell University, Ithaca, USA – sequence: 5 givenname: Friedemann surname: Mattern fullname: Mattern, Friedemann organization: CNB H 104.2, ETH Zurich, Zürich, Switzerland – sequence: 6 givenname: John C. surname: Mitchell fullname: Mitchell, John C. organization: Stanford, USA – sequence: 7 givenname: Moni surname: Naor fullname: Naor, Moni organization: Weizmann Institute of Science, Rehovot, Israel – sequence: 8 givenname: C. surname: Pandu Rangan fullname: Pandu Rangan, C. organization: Madras, Indian Institute of Technology, Chennai, India – sequence: 9 givenname: Bernhard surname: Steffen fullname: Steffen, Bernhard organization: Fakultät Informatik, TU Dortmund, Dortmund, Germany – sequence: 10 givenname: Demetri surname: Terzopoulos fullname: Terzopoulos, Demetri organization: University of California, Los Angeles, USA – sequence: 11 givenname: Doug surname: Tygar fullname: Tygar, Doug organization: University of California, Berkeley, USA – sequence: 12 givenname: Gerhard surname: Weikum fullname: Weikum, Gerhard organization: Max Planck Institute for Informatics, Saarbrücken, Germany |
| SSID | ssj0001876029 ssj0002792 |
| Score | 2.2020824 |
| Snippet | Crowdsourcing enables new possibilities for QoE evaluation by moving the evaluation task from the traditional laboratory environment into the Internet,... |
| SourceID | springer proquest |
| SourceType | Publisher |
| StartPage | 154 |
| Title | Crowdsourcing Quality of Experience Experiments |
| URI | http://ebookcentral.proquest.com/lib/SITE_ID/reader.action?docID=5590940&ppg=162 http://link.springer.com/10.1007/978-3-319-66435-4_7 |
| Volume | 10264 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1LT9wwELYWeql6aOlDpS_lwKmVKYntOD70UCHQCgGHdqm4WXnYiAMbqRsu_U38SGb8yIte4LK7ykaJPWONZ76Z-UzIHkQ6WVEp8Ny4yCi3B5JWsMtQcMWlKpQQWYl4x9l5vrzgJ5ficrG4G1Ut3XbVfv3vv30lT9EqXAO9YpfsIzTbPxQuwG_QL3yChuFz5vxOYVaPo_c83bFW8RBC6mbffzlQPjYgOqSeIpCLJ3MGeuObyOLkHOorBPeQfdFBwr8N7G7daOX8gj1uaOLo10KLeXZ1bMMx16u2ui77Zy6vQ_WhO1O8_yOwIkwG6Zk8XLJ_4F5-ME6Uqdn8OA1pj_O2c9Vk3-LJFNFQjZGMVM6QjIhkzrDQAY6bhL4MbQe4U56vM7aAgXmHAMlbTOMteo48jczzogYrnXre6rDhp_680gd7ybh8BFu98G2Cci23yJZUYEGf_Tw6Of0zIHqwsbgcZ_ADkJrR57D8oLCzKA7aU1KOJtETYnnO49kbJ-HPLGPvHKHVK_ICm2MS7FoB6e2QhVm_Ji-jApKggDfk-0S_SdBv0tpk0G8y0u9bcnF8tDpc0nA2B70Cp1nStGgwA6t4qhpWlym3jSoZz8om49YciEqWhWyKsqgrYa2pCl5by_OiZkVm6lSyd2R73a7Ne5KURqAjCpOVDIyFKQXLc2UzY5ngaSN2CY2T166CIJQt136qGw1BMbJAanC1dJpnu-RrlJDG2zc6UnODZDXTIFntJKtBsh8ec_NH8nxYt5_Idvf31nwGn7SrvoTFcA_7EoQS |
| link.rule.ids | 785,786,790,799,27958 |
| linkProvider | Library Specific Holdings |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.title=Evaluation+in+the+Crowd.+Crowdsourcing+and+Human-Centered+Experiments&rft.au=Egger-Lampl%2C+Sebastian&rft.au=Redi%2C+Judith&rft.au=Ho%C3%9Ffeld%2C+Tobias&rft.au=Hirth%2C+Matthias&rft.atitle=Crowdsourcing+Quality+of+Experience+Experiments&rft.series=Lecture+Notes+in+Computer+Science&rft.date=2017-01-01&rft.pub=Springer+International+Publishing&rft.isbn=9783319664347&rft.issn=0302-9743&rft.eissn=1611-3349&rft.spage=154&rft.epage=190&rft_id=info:doi/10.1007%2F978-3-319-66435-4_7 |
| thumbnail_s | http://utb.summon.serialssolutions.com/2.0.0/image/custom?url=https%3A%2F%2Febookcentral.proquest.com%2Fcovers%2F5590940-l.jpg |