Identification with Your Mind: A Hybrid BCI Based Authentication Approach for Anti-shoulder Surfing Attacks Using EEG and Eye Movement Data

Biometric authentication has been applied in many domains due to the promoting awareness of privacy and security risks. Most of the previous work has shown the performance of single biometric, but few researches explored the feasibility of hybrid biometrics. On this basis, we proposed a hybrid brain...

Full description

Saved in:
Bibliographic Details
Published inIEEE transactions on instrumentation and measurement Vol. 72; p. 1
Main Authors Shiwei, Cheng, Jialing, Wang, Danyi, Sheng, Yijian, Chen
Format Journal Article
LanguageEnglish
Published New York IEEE 01.01.2023
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects
Online AccessGet full text

Cover

Loading…
Abstract Biometric authentication has been applied in many domains due to the promoting awareness of privacy and security risks. Most of the previous work has shown the performance of single biometric, but few researches explored the feasibility of hybrid biometrics. On this basis, we proposed a hybrid brain-computer interface (BCI) authentication approach that combined user's electroencephalogram (EEG) and eye movement data features simultaneously. In anti-shoulder surfing experiments, the proposed approach reached the average accuracy of 84.36% (the highest was 88.35%) to identify shoulder surfers, and outperformed the only EEG and only eye movement data based authentication approach. In additional experiments, the approach was proved to be useful in reducing the possibility of user misidentification. Our approach hold great potential in providing references for implementing hybrid BCI authentication for anti-shoulder surfing applications.
AbstractList Biometric authentication has been applied in many domains due to the promoting awareness of privacy and security risks. Most of the previous work has shown the performance of single biometric, but a few studies explored the feasibility of hybrid biometrics. On this basis, we proposed a hybrid brain–computer interface (BCI) authentication approach that combined user’s electroencephalogram (EEG) and eye movement data features simultaneously. In anti-shoulder-surfing experiments, the proposed approach reached the average accuracy of 84.36% (the highest was 88.35%) to identify shoulder surfers and outperformed the only EEG and only eye movement data-based authentication approach. In additional experiments, the approach was proven to be useful in reducing the possibility of user misidentification. Our approach holds a great potential in providing references for implementing hybrid BCI authentication for anti-shoulder-surfing applications.
Biometric authentication has been applied in many domains due to the promoting awareness of privacy and security risks. Most of the previous work has shown the performance of single biometric, but few researches explored the feasibility of hybrid biometrics. On this basis, we proposed a hybrid brain-computer interface (BCI) authentication approach that combined user's electroencephalogram (EEG) and eye movement data features simultaneously. In anti-shoulder surfing experiments, the proposed approach reached the average accuracy of 84.36% (the highest was 88.35%) to identify shoulder surfers, and outperformed the only EEG and only eye movement data based authentication approach. In additional experiments, the approach was proved to be useful in reducing the possibility of user misidentification. Our approach hold great potential in providing references for implementing hybrid BCI authentication for anti-shoulder surfing applications.
Author Jialing, Wang
Danyi, Sheng
Shiwei, Cheng
Yijian, Chen
Author_xml – sequence: 1
  givenname: Cheng
  orcidid: 0000-0003-4716-4179
  surname: Shiwei
  fullname: Shiwei, Cheng
– sequence: 2
  givenname: Wang
  orcidid: 0000-0002-2440-497X
  surname: Jialing
  fullname: Jialing, Wang
– sequence: 3
  givenname: Sheng
  orcidid: 0000-0002-9564-4786
  surname: Danyi
  fullname: Danyi, Sheng
– sequence: 4
  givenname: Chen
  orcidid: 0000-0001-6057-3626
  surname: Yijian
  fullname: Yijian, Chen
BookMark eNp9kDuPEzEQgC10SOQOegqKkag3-LFrr-n2QriLdBEFdwXVyrHHxEduN9heUH4DfxqHpEAUVKMZzTeP75JcDOOAhLxmdM4Y1e_uV-s5p1zMBa8ZbdkzMmNNoyotJb8gM0pZW-m6kS_IZUqPlFIlazUjv1YOhxx8sCaHcYCfIW_hyzhFWIfBvYcObg-bGBxcL1ZwbRI66Ka8PTJnotvv42jsFvwYoSv1Km3Haecwwucp-jB8hS5nY78leEjHbLm8ATM4WB4Q1uMPfCrD4IPJ5iV57s0u4atzvCIPH5f3i9vq7tPNatHdVZZznqtae-e0Rrmx3nLWYN16aq3XWDuvqXJcIFdq4y1rtUHZKo1GWK6kkOipF1fk7WluOfz7hCn3j-XhoazsCyeVakVdly566rJxTCmi7_cxPJl46Bntj8r7orw_Ku_Pygsi_0FsyH8s5WjC7n_gmxMYEPGvPVTwpuXiNyZHkRE
CODEN IEIMAO
CitedBy_id crossref_primary_10_1109_TIM_2024_3384571
crossref_primary_10_1109_TIM_2024_3428591
crossref_primary_10_3390_math12131971
crossref_primary_10_1109_ACCESS_2024_3421264
crossref_primary_10_3390_s24247919
Cites_doi 10.1080/0144929x.2021.1979655
10.1109/cw.2019.00061
10.1109/wac.2016.7582945
10.1109/tim.2020.2967513
10.1109/tvcg.2020.2973052
10.1109/ijcb.2011.6117536
10.1109/btas.2013.6712724
10.1007/978-3-642-13437-1_48
10.1109/tii.2019.2946047
10.1109/isco.2016.7727122
10.1145/3287052
10.1109/hsi.2008.4581440
10.3389/fphys.2018.00098
10.1145/3338286.3340129
10.1016/j.cose.2020.101788
10.1109/tnsre.2020.3048422
10.1109/tsmc.2017.2756673
10.1109/icassda.2018.8477604
10.1007/978-3-319-60591-3_53
10.1109/kst48564.2020.9059376
10.1016/0730-725x(95)02020-t
10.1109/ccece.2001.933649
10.1109/btas.2012.6374579
10.3389/fninf.2011.00030
10.1109/icdsp.2018.8631698
10.1109/ispacs.2009.5383756
10.3389/fninf.2018.00066
10.1109/iccitechnology.2013.6579521
10.1109/tro.2012.2201310
10.1145/3161410
10.1145/3264959
10.1109/tim.2009.2030866
10.1145/3290605.3300340
10.1109/iced.2008.4786753
10.1145/3242969.3243008
10.1109/bcc.2007.4430555
10.1007/978-3-540-25976-3_23
10.1145/1358628.1358798
10.1039/an9941901547
10.1145/3491102.3517531
10.3901/cjme.2011.05.899
10.1007/978-1-4471-6584-2_7
10.1007/s00779-018-1115-8
10.1109/tgrs.2007.897425
10.1109/icc40277.2020.9148741
10.1109/isba.2018.8311458
10.1109/cspa.2013.6530058
10.1109/ncc48643.2020.9056027
10.1016/j.isprsjprs.2011.11.002
10.1109/tdsc.2022.3218782
10.1109/spmb.2014.7002950
10.1109/tim.2016.2642758
10.1007/11499145_79
10.1109/tcsi.2013.2264711
10.1145/3310986.3311001
10.1038/s41598-022-06527-7
10.1109/tim.2021.3063777
10.1109/tifs.2006.873653
10.1109/jproc.2003.819611
10.1007/s00521-020-05247-1
10.1109/itng.2015.27
10.1109/tim.2022.3149325
ContentType Journal Article
Copyright Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2023
Copyright_xml – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2023
DBID 97E
RIA
RIE
AAYXX
CITATION
7SP
7U5
8FD
L7M
DOI 10.1109/TIM.2023.3241081
DatabaseName IEEE All-Society Periodicals Package (ASPP) 2005-present
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE Electronic Library (IEL)
CrossRef
Electronics & Communications Abstracts
Solid State and Superconductivity Abstracts
Technology Research Database
Advanced Technologies Database with Aerospace
DatabaseTitle CrossRef
Solid State and Superconductivity Abstracts
Technology Research Database
Advanced Technologies Database with Aerospace
Electronics & Communications Abstracts
DatabaseTitleList Solid State and Superconductivity Abstracts

Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
Physics
EISSN 1557-9662
EndPage 1
ExternalDocumentID 10_1109_TIM_2023_3241081
10032582
Genre orig-research
GrantInformation_xml – fundername: Natural Science Foundation of Zhejiang Province
  grantid: LR22F020003
  funderid: 10.13039/501100004731
– fundername: National Natural Science Foundation of China
  grantid: 62172368
  funderid: 10.13039/501100001809
GroupedDBID -~X
0R~
29I
4.4
5GY
6IK
85S
97E
AAJGR
AARMG
AASAJ
AAWTH
ABAZT
ABQJQ
ABVLG
ACGFO
ACIWK
ACNCT
AENEX
AGQYO
AHBIQ
AKJIK
AKQYR
ALMA_UNASSIGNED_HOLDINGS
ATWAV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CS3
DU5
EBS
F5P
HZ~
IFIPE
IPLJI
JAVBF
LAI
M43
O9-
OCL
P2P
RIA
RIE
RNS
TN5
TWZ
5VS
8WZ
A6W
AAYOK
AAYXX
AETIX
AGSQL
AI.
AIBXA
ALLEH
CITATION
EJD
H~9
IAAWW
IBMZZ
ICLAB
IDIHD
IFJZH
RIG
VH1
VJK
7SP
7U5
8FD
L7M
ID FETCH-LOGICAL-c222t-49fdd99e6bcfc215e48f0ccf9e4df907d23e277bfc189ae6879ea3c27636ef0f3
IEDL.DBID RIE
ISSN 0018-9456
IngestDate Mon Jun 30 10:12:28 EDT 2025
Tue Jul 01 03:07:23 EDT 2025
Thu Apr 24 22:54:16 EDT 2025
Wed Aug 27 02:18:20 EDT 2025
IsPeerReviewed true
IsScholarly true
Language English
License https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html
https://doi.org/10.15223/policy-029
https://doi.org/10.15223/policy-037
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c222t-49fdd99e6bcfc215e48f0ccf9e4df907d23e277bfc189ae6879ea3c27636ef0f3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0002-2440-497X
0000-0002-9564-4786
0000-0001-6057-3626
0000-0003-4716-4179
PQID 2776778344
PQPubID 85462
PageCount 1
ParticipantIDs crossref_primary_10_1109_TIM_2023_3241081
proquest_journals_2776778344
ieee_primary_10032582
crossref_citationtrail_10_1109_TIM_2023_3241081
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2023-01-01
PublicationDateYYYYMMDD 2023-01-01
PublicationDate_xml – month: 01
  year: 2023
  text: 2023-01-01
  day: 01
PublicationDecade 2020
PublicationPlace New York
PublicationPlace_xml – name: New York
PublicationTitle IEEE transactions on instrumentation and measurement
PublicationTitleAbbrev TIM
PublicationYear 2023
Publisher IEEE
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml – name: IEEE
– name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References ref13
ref57
ref12
ref56
ref15
ref59
ref58
ref53
ref52
ref11
ref55
ref10
ref54
Bayat (ref3) 2018
ref16
ref19
ref18
ref51
ref50
Ram (ref65) 2021; 4
Dunphy (ref17)
ref46
ref45
ref48
ref47
ref42
ref41
ref44
ref43
ref49
ref8
ref4
ref6
ref5
ref40
ref35
ref34
ref37
ref36
ref31
ref30
ref33
ref32
Cheng (ref9) 2014; 26
ref2
ref1
Chen (ref7) 2021
ref39
Pham (ref68) 2016
ref38
ref24
ref23
ref67
ref26
ref25
ref20
ref64
ref63
ref22
ref66
ref21
ref28
ref27
ref29
Delorme (ref14) 2004; 134 pp
ref60
ref62
ref61
References_xml – ident: ref45
  doi: 10.1080/0144929x.2021.1979655
– volume: 134 pp
  year: 2004
  ident: ref14
  article-title: EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics
  publication-title: J. Neurosci. Methods
– ident: ref20
  doi: 10.1109/cw.2019.00061
– ident: ref37
  doi: 10.1109/wac.2016.7582945
– ident: ref58
  doi: 10.1109/tim.2020.2967513
– volume: 26
  start-page: 698
  issue: 5
  year: 2014
  ident: ref9
  article-title: A survey on visualization for eye tracking data
  publication-title: J. Comput.-Aided Des. Comput. Graph.
– ident: ref26
  doi: 10.1109/tvcg.2020.2973052
– ident: ref23
  doi: 10.1109/ijcb.2011.6117536
– ident: ref11
  doi: 10.1109/btas.2013.6712724
– ident: ref6
  doi: 10.1007/978-3-642-13437-1_48
– ident: ref32
  doi: 10.1109/tii.2019.2946047
– ident: ref24
  doi: 10.1109/isco.2016.7727122
– ident: ref29
  doi: 10.1145/3287052
– ident: ref46
  doi: 10.1109/hsi.2008.4581440
– ident: ref61
  doi: 10.3389/fphys.2018.00098
– ident: ref43
  doi: 10.1145/3338286.3340129
– ident: ref62
  doi: 10.1016/j.cose.2020.101788
– ident: ref10
  doi: 10.1109/tnsre.2020.3048422
– ident: ref27
  doi: 10.1109/tsmc.2017.2756673
– ident: ref39
  doi: 10.1109/icassda.2018.8477604
– start-page: 583
  volume-title: Advances in Human Factors in Simulation and Modeling
  year: 2018
  ident: ref3
  article-title: chapter identification through eye-movement patterns
  doi: 10.1007/978-3-319-60591-3_53
– ident: ref52
  doi: 10.1109/kst48564.2020.9059376
– ident: ref18
  doi: 10.1016/0730-725x(95)02020-t
– ident: ref40
  doi: 10.1109/ccece.2001.933649
– volume: 4
  start-page: 149
  issue: 7
  year: 2021
  ident: ref65
  article-title: Non-contact advanced ATM security through eye based password input for enhanced security
  publication-title: IJRESM
– ident: ref30
  doi: 10.1109/btas.2012.6374579
– ident: ref33
  doi: 10.3389/fninf.2011.00030
– ident: ref54
  doi: 10.1109/icdsp.2018.8631698
– ident: ref36
  doi: 10.1109/ispacs.2009.5383756
– ident: ref66
  doi: 10.3389/fninf.2018.00066
– ident: ref67
  doi: 10.1109/iccitechnology.2013.6579521
– ident: ref5
  doi: 10.1109/tro.2012.2201310
– ident: ref57
  doi: 10.1145/3161410
– volume-title: Biometric authentication technology based on eye tracking
  year: 2021
  ident: ref7
– ident: ref56
  doi: 10.1145/3264959
– ident: ref59
  doi: 10.1109/tim.2009.2030866
– ident: ref42
  doi: 10.1145/3290605.3300340
– ident: ref22
  doi: 10.1109/iced.2008.4786753
– ident: ref2
  doi: 10.1145/3242969.3243008
– ident: ref49
  doi: 10.1109/bcc.2007.4430555
– ident: ref28
  doi: 10.1007/978-3-540-25976-3_23
– ident: ref13
  doi: 10.1145/1358628.1358798
– ident: ref19
  doi: 10.1039/an9941901547
– ident: ref1
  doi: 10.1145/3491102.3517531
– ident: ref16
  doi: 10.3901/cjme.2011.05.899
– ident: ref31
  doi: 10.1007/978-1-4471-6584-2_7
– ident: ref8
  doi: 10.1007/s00779-018-1115-8
– ident: ref34
  doi: 10.1109/tgrs.2007.897425
– ident: ref60
  doi: 10.1109/icc40277.2020.9148741
– ident: ref44
  doi: 10.1109/isba.2018.8311458
– ident: ref35
  doi: 10.1109/cspa.2013.6530058
– ident: ref48
  doi: 10.1109/ncc48643.2020.9056027
– ident: ref47
  doi: 10.1016/j.isprsjprs.2011.11.002
– ident: ref64
  doi: 10.1109/tdsc.2022.3218782
– ident: ref21
  doi: 10.1109/spmb.2014.7002950
– ident: ref12
  doi: 10.1109/tim.2016.2642758
– start-page: 59
  volume-title: Proc. 4th Conf. Commun. Gaze Interact. (COGAIN)
  ident: ref17
  article-title: Gaze-contingent passwords at the ATM
– volume-title: EEG-based person authentication for security systems
  year: 2016
  ident: ref68
– ident: ref4
  doi: 10.1007/11499145_79
– ident: ref41
  doi: 10.1109/tcsi.2013.2264711
– ident: ref53
  doi: 10.1145/3310986.3311001
– ident: ref63
  doi: 10.1038/s41598-022-06527-7
– ident: ref50
  doi: 10.1109/tim.2021.3063777
– ident: ref25
  doi: 10.1109/tifs.2006.873653
– ident: ref38
  doi: 10.1109/jproc.2003.819611
– ident: ref55
  doi: 10.1007/s00521-020-05247-1
– ident: ref51
  doi: 10.1109/itng.2015.27
– ident: ref15
  doi: 10.1109/tim.2022.3149325
SSID ssj0007647
Score 2.4503875
Snippet Biometric authentication has been applied in many domains due to the promoting awareness of privacy and security risks. Most of the previous work has shown the...
SourceID proquest
crossref
ieee
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 1
SubjectTerms Authentication
Biometrics
Biometrics (access control)
brain computer interaction
electroencephalogram
Electroencephalography
Eye movements
eye tracking
Feasibility studies
Feature extraction
Gaze tracking
Human-computer interface
privacy
Security
Surfing
Task analysis
Title Identification with Your Mind: A Hybrid BCI Based Authentication Approach for Anti-shoulder Surfing Attacks Using EEG and Eye Movement Data
URI https://ieeexplore.ieee.org/document/10032582
https://www.proquest.com/docview/2776778344
Volume 72
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LT9wwELYoElJ7KM-KLQ_NoZceEpzY68S9BbqwIC2XgsQtSuyxKrXaRbvZA_0L_dMdO15Ei4q4RZEnsTQPz4xnvmHsk26ldkLyRDsnE2lQJWXbYELKxbXVaiiU73eeXKvxrby6G97FZvXQC4OIofgMU_8Y7vLtzCx9qow0nIt8WJLFfUORW9-s9Wh2CyV7gMyMNJjcgtWdJNcnN5eT1I8JT8l7yHiZ_XUGhaEqzyxxOF7ON9n1amN9VcmPdNm1qfn1D2bjq3e-xd5HRxOqXjK22RpOd9i7J_CDO2wjlH-axS773ffrupjAA5-dBTIEc5hQzP4FKhg_-NYuOD27hFM6-Cz43JqniRRVxCYHcoKhovfJ4rufno1z-LacO_ofVF3nG_ohVCnAaHQBzdTC6AFhMguo5R18bbpmj92ej27Oxkkc05AYci66hJhtrdaoWuMMeRAoS8eNcRqldRR721xgXhStM1mpG1RlobERJifLptBxJz6w9elsivsMTM6NU0IIlK203OpMWFFKKwsc2kY3A3ayYlxtIoa5H6Xxsw6xDNc1sbr2rK4jqwfs8yPFfY_f8cLaPc-5J-t6pg3Y4Uo46qjhizr3MEhhSsnH_5AdsLf-632-5pCtd_MlHpEH07XHQXL_AOb47FI
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV3NbtQwELZQEQIOBUoR2xaYAxcOSZ3YceLe0rJlF5q9sJV6ixJ7rEqgXbSbPZRX4KUZO9mqgEDcosgjW5pfj2e-YeytbqV2QvJIOycjaVBFRdtgRMrFtdUqE8r3O1czNbmUH6-yq6FZPfTCIGIoPsPYf4a3fLs0G58qIw3nIs0Ksrj3yfFnSd-udWt4cyV7iMyEdJgCg-2rJNfH82kV-0HhMcUPCS-SX7xQGKvyhy0ODub8CZttj9bXlXyJN10bm--_oTb-99mfst0h1ISyl41n7B4u9tjjOwCEe-xBKAA16-fsR9-x64YUHvj8LJApWEFFt_YTKGFy45u74PRsCqfk-iz47JqnGSjKAZ0cKAyGkv5H62s_PxtX8HmzcrQflF3nW_oh1CnAePwBmoWF8Q1CtQy45R28b7pmn12ej-dnk2gY1BAZCi-6iNhtrdaoWuMMxRAoC8eNcRqldXT7tqnANM9bZ5JCN6iKXGMjTEq2TaHjTrxgO4vlAl8yMCk3TgkhULbScqsTYUUhrcwxs41uRux4y7jaDCjmfpjG1zrcZriuidW1Z3U9sHrE3t1SfOsRPP6xdt9z7s66nmkjdrQVjnrQ8XWdeiCkMKfk4C9kb9jDyby6qC-ms0-H7JHfqc_eHLGdbrXBVxTPdO3rIMU_AWBH75s
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Identification+With+Your+Mind%3A+A+Hybrid+BCI-Based+Authentication+Approach+for+Anti-Shoulder-Surfing+Attacks+Using+EEG+and+Eye+Movement+Data&rft.jtitle=IEEE+transactions+on+instrumentation+and+measurement&rft.au=Cheng%2C+Shiwei&rft.au=Wang%2C+Jialing&rft.au=Danyi+Sheng&rft.au=Chen%2C+Yijian&rft.date=2023-01-01&rft.pub=The+Institute+of+Electrical+and+Electronics+Engineers%2C+Inc.+%28IEEE%29&rft.issn=0018-9456&rft.eissn=1557-9662&rft.volume=72&rft.spage=1&rft_id=info:doi/10.1109%2FTIM.2023.3241081&rft.externalDBID=NO_FULL_TEXT
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0018-9456&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0018-9456&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0018-9456&client=summon