Effect of Auditory Feedback on Tactile Intensity Perception in a Touchscreen Application
This article presents the effect of auditory feedback on tactile intensity perception, which may be of interest to haptic or audiotactile interaction engineers. An experimental setup consisted of a touchscreen, an electrodynamic shaker, and a closed-back headphone for a subject to interact with the...
Saved in:
| Published in | IEEE transactions on haptics Vol. 13; no. 2; pp. 343 - 353 |
|---|---|
| Main Authors | , |
| Format | Journal Article |
| Language | English |
| Published |
New York
IEEE
01.04.2020
The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| Subjects | |
| Online Access | Get full text |
| ISSN | 1939-1412 2329-4051 2329-4051 |
| DOI | 10.1109/TOH.2019.2947553 |
Cover
Loading…
| Abstract | This article presents the effect of auditory feedback on tactile intensity perception, which may be of interest to haptic or audiotactile interaction engineers. An experimental setup consisted of a touchscreen, an electrodynamic shaker, and a closed-back headphone for a subject to interact with the touchscreen and to feel audiotactile feedback. In the experiment, participants were asked to judge perceived tactile intensity, using the magnitude estimation method, in the absence and presence of simultaneous auditory feedback. All data collected from the subjects were analyzed statistically, and then the effect of auditory feedback was investigated focusing on the following aspects: whether the presence of auditory feedback changes perceived tactile intensity, whether the frequency component of auditory feedback affects tactile intensity perception, and whether the coincidence of tactile and auditory frequencies influences on tactile intensity perception. Besides, changes in Stevens's exponent were analyzed to discuss how tactile intensity perception varies due to the auditory feedback. Finally, an equal intensity contour, in the domain of sensation level and frequency of tactile stimulation, was drawn. It can be applied to adjust the level of tactile stimuli for haptic feedback designers to provide a constant perceived tactile intensity considering the presence of auditory feedback. |
|---|---|
| AbstractList | This article presents the effect of auditory feedback on tactile intensity perception, which may be of interest to haptic or audiotactile interaction engineers. An experimental setup consisted of a touchscreen, an electrodynamic shaker, and a closed-back headphone for a subject to interact with the touchscreen and to feel audiotactile feedback. In the experiment, participants were asked to judge perceived tactile intensity, using the magnitude estimation method, in the absence and presence of simultaneous auditory feedback. All data collected from the subjects were analyzed statistically, and then the effect of auditory feedback was investigated focusing on the following aspects: whether the presence of auditory feedback changes perceived tactile intensity, whether the frequency component of auditory feedback affects tactile intensity perception, and whether the coincidence of tactile and auditory frequencies influences on tactile intensity perception. Besides, changes in Stevens's exponent were analyzed to discuss how tactile intensity perception varies due to the auditory feedback. Finally, an equal intensity contour, in the domain of sensation level and frequency of tactile stimulation, was drawn. It can be applied to adjust the level of tactile stimuli for haptic feedback designers to provide a constant perceived tactile intensity considering the presence of auditory feedback. This article presents the effect of auditory feedback on tactile intensity perception, which may be of interest to haptic or audiotactile interaction engineers. An experimental setup consisted of a touchscreen, an electrodynamic shaker, and a closed-back headphone for a subject to interact with the touchscreen and to feel audiotactile feedback. In the experiment, participants were asked to judge perceived tactile intensity, using the magnitude estimation method, in the absence and presence of simultaneous auditory feedback. All data collected from the subjects were analyzed statistically, and then the effect of auditory feedback was investigated focusing on the following aspects: whether the presence of auditory feedback changes perceived tactile intensity, whether the frequency component of auditory feedback affects tactile intensity perception, and whether the coincidence of tactile and auditory frequencies influences on tactile intensity perception. Besides, changes in Stevens's exponent were analyzed to discuss how tactile intensity perception varies due to the auditory feedback. Finally, an equal intensity contour, in the domain of sensation level and frequency of tactile stimulation, was drawn. It can be applied to adjust the level of tactile stimuli for haptic feedback designers to provide a constant perceived tactile intensity considering the presence of auditory feedback.This article presents the effect of auditory feedback on tactile intensity perception, which may be of interest to haptic or audiotactile interaction engineers. An experimental setup consisted of a touchscreen, an electrodynamic shaker, and a closed-back headphone for a subject to interact with the touchscreen and to feel audiotactile feedback. In the experiment, participants were asked to judge perceived tactile intensity, using the magnitude estimation method, in the absence and presence of simultaneous auditory feedback. All data collected from the subjects were analyzed statistically, and then the effect of auditory feedback was investigated focusing on the following aspects: whether the presence of auditory feedback changes perceived tactile intensity, whether the frequency component of auditory feedback affects tactile intensity perception, and whether the coincidence of tactile and auditory frequencies influences on tactile intensity perception. Besides, changes in Stevens's exponent were analyzed to discuss how tactile intensity perception varies due to the auditory feedback. Finally, an equal intensity contour, in the domain of sensation level and frequency of tactile stimulation, was drawn. It can be applied to adjust the level of tactile stimuli for haptic feedback designers to provide a constant perceived tactile intensity considering the presence of auditory feedback. |
| Author | Won, Hong-In Altinsoy, M. Ercan |
| Author_xml | – sequence: 1 givenname: Hong-In orcidid: 0000-0003-1609-8447 surname: Won fullname: Won, Hong-In email: luvhayym@kitech.re.kr organization: Institute of Acoustics and Speech Communication, Technische Universität Dresden, Dresden, Germany – sequence: 2 givenname: M. Ercan orcidid: 0000-0002-0803-8818 surname: Altinsoy fullname: Altinsoy, M. Ercan email: ercan.altinsoy@tu-dresden.de organization: Institute of Acoustics and Speech Communication, Technische Universität Dresden, Dresden, Germany |
| BookMark | eNp9kD1rHDEQhoVxsM8ffSCNIE2avUgjrXZVHsaODQanuEA6odOOiJy1tJG0xf177-VMChepppj3eZl5LshpTBEJ-cjZmnOmv26f7tfAuF6Dll3bihOyAgG6kazlp2TFtdANlxzOyUUpz4wp6LQ8I-eCKyG5lCvy89Z7dJUmTzfzEGrKe3qHOOys-01TpFvrahiRPsSKsYS6p98xO5xqWJYhUku3aXa_isuIkW6maQzOHpZX5IO3Y8Hrt3lJftzdbm_um8enbw83m8fGCZC16dse_TCA7-zgmIadax3aHmQHA2O9BK0AsFUMRMfB626HaMUg2p3qrJdMXJIvx94ppz8zlmpeQnE4jjZimosBwbpOAod-iX5-F31Oc47LdQYWG60QSh0K1THlciolozcu1L8v1WzDaDgzB_dmcW8O7s2b-wVk78Aphxeb9_9DPh2RgIj_4n2vdA9MvAKbSo45 |
| CODEN | ITHEBX |
| CitedBy_id | crossref_primary_10_1109_ACCESS_2024_3491113 crossref_primary_10_1145_3648353 crossref_primary_10_1007_s11431_024_2813_0 crossref_primary_10_1177_10711813241278833 |
| Cites_doi | 10.1016/j.cub.2009.02.013 10.1121/1.3365318 10.1109/TOH.2017.2704603 10.1007/978-3-540-87883-4_13 10.1002/j.2637-496X.2010.tb00231.x 10.3758/BF03212732 10.1016/j.chb.2016.03.006 10.3109/08990229609052583 10.1109/TOH.2010.1 10.1007/978-3-642-31404-9_18 10.1109/TOH.2009.37 10.4324/9781315127675 10.1109/JPROC.2012.2221071 10.1109/TOH.2008.14 10.2307/40285553 10.1109/TOH.2018.2793867 10.1109/3516.951362 10.1109/TOH.2013.2 10.1109/TOH.2016.2571694 10.1109/TOH.2015.2437871 10.3758/APP.71.7.1439 10.1518/001872008X250638 10.1145/3003715.3005406 10.1007/978-3-642-31401-8_56 10.1121/1.1639909 10.1109/TII.2018.2850849 10.3758/BF03204312 10.1044/1092-4388(2002/033) 10.1109/HAPTIC.2003.1191261 10.1016/j.brainres.2008.06.104 10.1109/WHC.2005.103 10.1109/WHC.2015.7177738 10.1109/TOH.2011.56 10.1007/s00221-009-1759-8 10.1121/1.3204305 10.1007/978-3-319-17193-7 10.1365/s40111-008-0116-4 10.1007/978-3-642-04076-4_15 |
| ContentType | Journal Article |
| Copyright | Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2020 |
| Copyright_xml | – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2020 |
| DBID | 97E RIA RIE AAYXX CITATION 7SC 7SP 8FD JQ2 L7M L~C L~D 7X8 |
| DOI | 10.1109/TOH.2019.2947553 |
| DatabaseName | IEEE Xplore (IEEE) IEEE All-Society Periodicals Package (ASPP) 1998–Present IEEE Electronic Library (IEL) CrossRef Computer and Information Systems Abstracts Electronics & Communications Abstracts Technology Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional MEDLINE - Academic |
| DatabaseTitle | CrossRef Technology Research Database Computer and Information Systems Abstracts – Academic Electronics & Communications Abstracts ProQuest Computer Science Collection Computer and Information Systems Abstracts Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Professional MEDLINE - Academic |
| DatabaseTitleList | Technology Research Database MEDLINE - Academic |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/ sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Computer Science |
| EISSN | 2329-4051 |
| EndPage | 353 |
| ExternalDocumentID | 10_1109_TOH_2019_2947553 8869820 |
| Genre | orig-research |
| GrantInformation_xml | – fundername: Deutsche Forschungsgemeinschaft grantid: AL 1473/5-1 and 6-1 funderid: 10.13039/501100001659 |
| GroupedDBID | 0R~ 29I 4.4 5GY 5VS 6IK 97E AAJGR AARMG AASAJ AAWTH ABAZT ABQJQ ABVLG ACIWK AENEX AETIX AGQYO AGSQL AHBIQ AKJIK AKQYR ALMA_UNASSIGNED_HOLDINGS ATWAV BEFXN BFFAM BGNUA BKEBE BPEOZ CS3 EBS EJD F5P HZ~ IEDLZ IFIPE IPLJI JAVBF M43 O9- OCL PQQKQ RIA RIE RNI RNS RZB AAYXX CITATION 7SC 7SP 8FD JQ2 L7M L~C L~D 7X8 |
| ID | FETCH-LOGICAL-c324t-858efdd2f7adc092bc5cea82472d008429622e56023712f97beea3d35b67af403 |
| IEDL.DBID | RIE |
| ISSN | 1939-1412 2329-4051 |
| IngestDate | Fri Jul 11 11:56:26 EDT 2025 Mon Jun 30 02:26:23 EDT 2025 Thu Apr 24 23:00:08 EDT 2025 Tue Jul 01 01:39:05 EDT 2025 Wed Aug 27 01:42:30 EDT 2025 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 2 |
| Language | English |
| License | https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html https://doi.org/10.15223/policy-029 https://doi.org/10.15223/policy-037 |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c324t-858efdd2f7adc092bc5cea82472d008429622e56023712f97beea3d35b67af403 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 content type line 23 |
| ORCID | 0000-0003-1609-8447 0000-0002-0803-8818 |
| PMID | 31634144 |
| PQID | 2414533660 |
| PQPubID | 85508 |
| PageCount | 11 |
| ParticipantIDs | ieee_primary_8869820 proquest_journals_2414533660 crossref_primary_10_1109_TOH_2019_2947553 proquest_miscellaneous_2307742128 crossref_citationtrail_10_1109_TOH_2019_2947553 |
| ProviderPackageCode | CITATION AAYXX |
| PublicationCentury | 2000 |
| PublicationDate | 2020-04-01 |
| PublicationDateYYYYMMDD | 2020-04-01 |
| PublicationDate_xml | – month: 04 year: 2020 text: 2020-04-01 day: 01 |
| PublicationDecade | 2020 |
| PublicationPlace | New York |
| PublicationPlace_xml | – name: New York |
| PublicationTitle | IEEE transactions on haptics |
| PublicationTitleAbbrev | TOH |
| PublicationYear | 2020 |
| Publisher | IEEE The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| Publisher_xml | – name: IEEE – name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| References | ref13 ref12 ref15 ref14 ref11 ref10 ref17 ref16 ref19 ref18 mcgee (ref35) 2001; 2001 altinsoy (ref25) 2006 tüzün (ref2) 2016; 61 scharine (ref42) 2009 ref45 ref48 ref44 ref8 ref7 ref9 ref4 ref3 ref6 ref5 merchel (ref41) 2012; 60 (ref46) 1999 ref40 sprouse (ref49) 2008 (ref43) 2003 ref37 todorovi? (ref47) 2010; 17 ref36 difranco (ref38) 1997; 61 ref30 ref33 ref32 ref1 ref39 ref24 ref23 ref26 ref20 ref22 klatzky (ref31) 2004 ref21 ref28 ref27 merchel (ref34) 2011 ref29 |
| References_xml | – volume: 60 start-page: 47 year: 2012 ident: ref41 article-title: Touch the sound: Audio-driven tactile feedback for audio mixing applications publication-title: J Audio Eng Soc – ident: ref30 doi: 10.1016/j.cub.2009.02.013 – volume: 2001 start-page: 29 year: 2001 ident: ref35 article-title: Feeling rough: Multimodal perception of virtual roughness publication-title: Proc Eurohaptics – ident: ref29 doi: 10.1121/1.3365318 – ident: ref23 doi: 10.1109/TOH.2017.2704603 – volume: 61 start-page: 17 year: 1997 ident: ref38 article-title: Effect of auditory cues on the haptic perception of stiffness in virtual environments publication-title: Amer Soc Mechan Eng Dynamic Syst Contr Division – ident: ref36 doi: 10.1007/978-3-540-87883-4_13 – ident: ref3 doi: 10.1002/j.2637-496X.2010.tb00231.x – ident: ref16 doi: 10.3758/BF03212732 – volume: 61 start-page: 73 year: 2016 ident: ref2 article-title: Usability testing of a 3D touch screen kiosk system for way-finding publication-title: Comput Human Behav doi: 10.1016/j.chb.2016.03.006 – ident: ref18 doi: 10.3109/08990229609052583 – ident: ref7 doi: 10.1109/TOH.2010.1 – ident: ref33 doi: 10.1007/978-3-642-31404-9_18 – ident: ref19 doi: 10.1109/TOH.2009.37 – ident: ref44 doi: 10.4324/9781315127675 – ident: ref15 doi: 10.1109/JPROC.2012.2221071 – ident: ref6 doi: 10.1109/TOH.2008.14 – year: 2003 ident: ref43 article-title: International Organization for Standardization, Acoustics: Normal Equal-Loudness-Level Contours – ident: ref17 doi: 10.2307/40285553 – volume: 17 start-page: 17 year: 2010 ident: ref47 article-title: Context effects in visual perception and their explanations publication-title: Psychological Review – start-page: 397 year: 2008 ident: ref49 article-title: Magnitude estimation and the non-linearity of acceptability judgments publication-title: Proc 27th West Coast Conf Formal Linguistics – ident: ref13 doi: 10.1109/TOH.2018.2793867 – ident: ref39 doi: 10.1109/3516.951362 – ident: ref20 doi: 10.1109/TOH.2013.2 – year: 2006 ident: ref25 publication-title: Auditory Tactile Interaction in Virtual Environments – ident: ref22 doi: 10.1109/TOH.2016.2571694 – ident: ref8 doi: 10.1109/TOH.2015.2437871 – ident: ref10 doi: 10.3758/APP.71.7.1439 – ident: ref14 doi: 10.1518/001872008X250638 – ident: ref5 doi: 10.1145/3003715.3005406 – start-page: 107 year: 2004 ident: ref31 article-title: Multisensory texture perception publication-title: The Handbook of Multisensory Processes – ident: ref4 doi: 10.1007/978-3-642-31401-8_56 – ident: ref32 doi: 10.1121/1.1639909 – ident: ref9 doi: 10.1109/TII.2018.2850849 – ident: ref45 doi: 10.3758/BF03204312 – ident: ref48 doi: 10.1044/1092-4388(2002/033) – year: 2011 ident: ref34 article-title: Feeling the sound: Audio-tactile intensity perception publication-title: Proc 2nd Polish-German Structured Conf Acoust 58th Open Seminar Acoust – ident: ref24 doi: 10.1109/HAPTIC.2003.1191261 – ident: ref37 doi: 10.1016/j.brainres.2008.06.104 – ident: ref40 doi: 10.1109/WHC.2005.103 – ident: ref21 doi: 10.1109/WHC.2015.7177738 – ident: ref11 doi: 10.1109/TOH.2011.56 – year: 1999 ident: ref46 article-title: International Organization for Standardization, Sensory Analysis-Methodology-Magnitude Estimation Method – start-page: 391 year: 2009 ident: ref42 article-title: Auditory perception and cognitive performance publication-title: Helmet-Mounted Displays Sensation Perception and Cognition Issues – ident: ref27 doi: 10.1007/s00221-009-1759-8 – ident: ref28 doi: 10.1121/1.3204305 – ident: ref12 doi: 10.1007/978-3-319-17193-7 – ident: ref1 doi: 10.1365/s40111-008-0116-4 – ident: ref26 doi: 10.1007/978-3-642-04076-4_15 |
| SSID | ssj0062794 |
| Score | 2.210786 |
| Snippet | This article presents the effect of auditory feedback on tactile intensity perception, which may be of interest to haptic or audiotactile interaction... |
| SourceID | proquest crossref ieee |
| SourceType | Aggregation Database Enrichment Source Index Database Publisher |
| StartPage | 343 |
| SubjectTerms | Automobiles Automotive application Electrodynamics ergonomics Estimation Feedback Haptic interfaces Headphones human computer interaction Interactive computer systems interactive systems Perception Perceptions Social integration Tactile sensors Touch screens Vibrations |
| Title | Effect of Auditory Feedback on Tactile Intensity Perception in a Touchscreen Application |
| URI | https://ieeexplore.ieee.org/document/8869820 https://www.proquest.com/docview/2414533660 https://www.proquest.com/docview/2307742128 |
| Volume | 13 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1La9wwEBZJTr3k2ZBtkqJAL4V615b1sI5L6bIE0vawgb0ZvQwhwS6pfUh_fWZs2aEPSm4GScbWSJpvNN_MEPJBaqkF6LEE40gSXjieWBPyBKCHE74QRXB4oX_zVa5v-fVWbHfIpykWJoTQk8_CHB97X75vXIdXZYuikBo01i7ZBcNtiNUaT13JlI4eZJ1kPGOjSzLVi823NXK49JxproTA0jk5wBAOtsRv2qgvr_LXmdwrmtUBuRk_ceCX3M-71s7drz-yN772Hw7JfkScdDkskSOyE-pjcjBWc6Bxc5-Q7ZDImDYVXWKoRvP4RFeg26xx97Sp6QZDIB4CjaT39ol-n0gx9K6mhm6aDsNckMlDly-O8bfkdvVl83mdxLoLiQN41SYoocp7VinjXaqZdcIFUzCumMf8-0xLxgJAJZarjFVa2RBM7nNhpTIVT_NTslc3dTgjlKUhV0F6yzPHq8qZzEuTiqrw3ApYDTOyGOe_dDEpOdbGeCh74yTVJQivROGVUXgz8nEa8WNIyPGfvicogKlfnPsZuRhFXMYd-7MEJMMB-koJzVdTM-w1dKCYOjQd9IEDUaELvXj37zefkzcM7fGe2XNB9trHLlwCaGnt-361PgN7reZr |
| linkProvider | IEEE |
| linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1Lb9QwEB6VcoALBQpioYCRuCCR3cTxIz6uEKsFuoVDKu0t8itS1SpBJTmUX884cYJ4CHGLZDtKPGPPZ883MwCvhRKKox1LQhxJwgrLEqN9niD0sNwVvPA2XOjvzsT2nH3c8_0BvJ1jYbz3A_nML8Pj4Mt3re3DVdmqKIRCi3ULbqPd59kYrTXtu4JKFX3IKslYRienZKpW5edtYHGpJVVMch6K5-QIRBieJn6xR0OBlT925cHUbI5gN33kyDC5XPadWdrvv-Vv_N-_uA_3IuYk61FJHsCBbx7C0VTPgcTlfQz7MZUxaWuyDsEa7fUN2aB1M9pekrYhZQiCuPIk0t67G_JlpsWQi4ZoUrZ9CHQJXB6y_ukafwTnm_flu20SKy8kFgFWlwQZ1c7RWmpnU0WN5dbrgjJJXcjAT5Wg1CNYornMaK2k8V7nLudGSF2zNH8Mh03b-CdAaOpz6YUzLLOsrq3OnNAprwvHDEd9WMBqmv_KxrTkoTrGVTUcT1JVofCqILwqCm8Bb-YRX8eUHP_oexwEMPeLc7-Ak0nEVVyz3yrEMgzBrxDY_GpuxtUWXCi68W2PfXBLlMGJXjz9-5tfwp1tuTutTj-cfXoGd2k4nQ88nxM47K57_xwhTGdeDJr7A6kT6bQ |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Effect+of+Auditory+Feedback+on+Tactile+Intensity+Perception+in+a+Touchscreen+Application&rft.jtitle=IEEE+transactions+on+haptics&rft.au=Won%2C+Hong-In&rft.au=Altinsoy%2C+M+Ercan&rft.date=2020-04-01&rft.issn=2329-4051&rft.eissn=2329-4051&rft.volume=13&rft.issue=2&rft.spage=343&rft_id=info:doi/10.1109%2FTOH.2019.2947553&rft.externalDBID=NO_FULL_TEXT |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1939-1412&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1939-1412&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1939-1412&client=summon |