Reciprocal Learning of Intent Inferral with Augmented Visual Feedback for Stroke

Intent inferral, the process by which a robotic device predicts a user's intent from biosignals, offers an effective and intuitive way to control wearable robots. Classical intent inferral methods treat biosignal inputs as unidirectional ground truths for training machine learning models, where...

Full description

Saved in:
Bibliographic Details
Published inIEEE International Conference on Rehabilitation Robotics Vol. 2025; pp. 1512 - 1517
Main Authors Xu, Jingxi, Chen, Ava, Winterbottom, Lauren, Palacios, Joaquin, Chivukula, Preethika, Nilsen, Dawn M., Stein, Joel, Ciocarlie, Matei
Format Conference Proceeding Journal Article
LanguageEnglish
Published United States IEEE 01.05.2025
Subjects
Online AccessGet full text
ISSN1945-7901
1945-7901
DOI10.1109/ICORR66766.2025.11062977

Cover

Abstract Intent inferral, the process by which a robotic device predicts a user's intent from biosignals, offers an effective and intuitive way to control wearable robots. Classical intent inferral methods treat biosignal inputs as unidirectional ground truths for training machine learning models, where the internal state of the model is not directly observable by the user. In this work, we propose reciprocal learning, a bidirectional paradigm that facilitates human adaptation to an intent inferral classifier. Our paradigm consists of iterative, interwoven stages that alternate between updating machine learning models and guiding human adaptation with the use of augmented visual feedback. We demonstrate this paradigm in the context of controlling a robotic hand orthosis for stroke, where the device predicts open, close, and relax intents from electromyographic (EMG) signals and provides appropriate assistance. We use LED progress-bar displays to communicate to the user the predicted probabilities for open and close intents by the classifier. Our experiments with stroke subjects show reciprocal learning improving performance in a subset of subjects (two out of five) without negatively impacting performance on the others. We hypothesize that, during reciprocal learning, subjects can learn to reproduce more distinguishable muscle activation patterns and generate more separable biosignals.
AbstractList Intent inferral, the process by which a robotic device predicts a user's intent from biosignals, offers an effective and intuitive way to control wearable robots. Classical intent inferral methods treat biosignal inputs as unidirectional ground truths for training machine learning models, where the internal state of the model is not directly observable by the user. In this work, we propose reciprocal learning, a bidirectional paradigm that facilitates human adaptation to an intent inferral classifier. Our paradigm consists of iterative, interwoven stages that alternate between updating machine learning models and guiding human adaptation with the use of augmented visual feedback. We demonstrate this paradigm in the context of controlling a robotic hand orthosis for stroke, where the device predicts open, close, and relax intents from electromyographic (EMG) signals and provides appropriate assistance. We use LED progress-bar displays to communicate to the user the predicted probabilities for open and close intents by the classifier. Our experiments with stroke subjects show reciprocal learning improving performance in a subset of subjects (two out of five) without negatively impacting performance on the others. We hypothesize that, during reciprocal learning, subjects can learn to reproduce more distinguishable muscle activation patterns and generate more separable biosignals.
Intent inferral, the process by which a robotic device predicts a user's intent from biosignals, offers an effective and intuitive way to control wearable robots. Classical intent inferral methods treat biosignal inputs as unidirectional ground truths for training machine learning models, where the internal state of the model is not directly observable by the user. In this work, we propose reciprocal learning, a bidirectional paradigm that facilitates human adaptation to an intent inferral classifier. Our paradigm consists of iterative, interwoven stages that alternate between updating machine learning models and guiding human adaptation with the use of augmented visual feedback. We demonstrate this paradigm in the context of controlling a robotic hand orthosis for stroke, where the device predicts open, close, and relax intents from electromyographic (EMG) signals and provides appropriate assistance. We use LED progress-bar displays to communicate to the user the predicted probabilities for open and close intents by the classifier. Our experiments with stroke subjects show reciprocal learning improving performance in a subset of subjects (two out of five) without negatively impacting performance on the others. We hypothesize that, during reciprocal learning, subjects can learn to reproduce more distinguishable muscle activation patterns and generate more separable biosignals.Intent inferral, the process by which a robotic device predicts a user's intent from biosignals, offers an effective and intuitive way to control wearable robots. Classical intent inferral methods treat biosignal inputs as unidirectional ground truths for training machine learning models, where the internal state of the model is not directly observable by the user. In this work, we propose reciprocal learning, a bidirectional paradigm that facilitates human adaptation to an intent inferral classifier. Our paradigm consists of iterative, interwoven stages that alternate between updating machine learning models and guiding human adaptation with the use of augmented visual feedback. We demonstrate this paradigm in the context of controlling a robotic hand orthosis for stroke, where the device predicts open, close, and relax intents from electromyographic (EMG) signals and provides appropriate assistance. We use LED progress-bar displays to communicate to the user the predicted probabilities for open and close intents by the classifier. Our experiments with stroke subjects show reciprocal learning improving performance in a subset of subjects (two out of five) without negatively impacting performance on the others. We hypothesize that, during reciprocal learning, subjects can learn to reproduce more distinguishable muscle activation patterns and generate more separable biosignals.
Author Palacios, Joaquin
Chen, Ava
Chivukula, Preethika
Ciocarlie, Matei
Xu, Jingxi
Winterbottom, Lauren
Stein, Joel
Nilsen, Dawn M.
Author_xml – sequence: 1
  givenname: Jingxi
  surname: Xu
  fullname: Xu, Jingxi
  email: jxu@cs.columbia.edu
  organization: Columbia University,Department of Computer Science,New York,NY,USA,10027
– sequence: 2
  givenname: Ava
  surname: Chen
  fullname: Chen, Ava
  email: ava.chen@columbia.edu
  organization: Columbia University,Department of Mechanical Engineering,New York,NY,USA,10027
– sequence: 3
  givenname: Lauren
  surname: Winterbottom
  fullname: Winterbottom, Lauren
  organization: Columbia University Irving Medical Center,Department of Rehabilitation and Regenerative Medicine,New York,NY,USA,10032
– sequence: 4
  givenname: Joaquin
  surname: Palacios
  fullname: Palacios, Joaquin
  organization: Columbia University,Department of Mechanical Engineering,New York,NY,USA,10027
– sequence: 5
  givenname: Preethika
  surname: Chivukula
  fullname: Chivukula, Preethika
  organization: Columbia University,Department of Biomedical Engineering,New York,NY,USA,10027
– sequence: 6
  givenname: Dawn M.
  surname: Nilsen
  fullname: Nilsen, Dawn M.
  organization: Columbia University Irving Medical Center,Department of Rehabilitation and Regenerative Medicine,New York,NY,USA,10032
– sequence: 7
  givenname: Joel
  surname: Stein
  fullname: Stein, Joel
  organization: Columbia University Irving Medical Center,Department of Rehabilitation and Regenerative Medicine,New York,NY,USA,10032
– sequence: 8
  givenname: Matei
  surname: Ciocarlie
  fullname: Ciocarlie, Matei
  email: matei.ciocarlie@columbia.edu
  organization: Columbia University,Department of Mechanical Engineering,New York,NY,USA,10027
BackLink https://www.ncbi.nlm.nih.gov/pubmed/40644264$$D View this record in MEDLINE/PubMed
BookMark eNpNkFtLw0AQhVep2Fr7D0T20ZfU2Wuyj6VYLRSUenkNye5sjc2l5oL47420FZ_OcM7HMHMuyKCsSiSEMpgyBuZ2OX9cr7UOtZ5y4OrX1NyE4QmZmNBEQoGIQEf8lIyYkSoIDbDBv3lIJk3zAQCMR5qH-pwMJWgpuZYj8rRGm-3qyiY5XWFSl1m5oZWny7LFsu3FY1332VfWvtNZtyl6Fx19y5qudxeILk3slvqqps9tXW3xkpz5JG9wctAxeV3cvcwfgtXj_XI-WwUZk6YNPCgPSYRapMpLjmCV0k46I9A4i8wZKUyKFiMPBq1x_Z-eoQNMMU0BxZjc7Pf2x3922LRxkTUW8zwpseqaWHBuFADXokevD2iXFujiXZ0VSf0dH1vogas9kCHiX3zsWfwAG9dv0w
ContentType Conference Proceeding
Journal Article
DBID 6IE
6IL
CBEJK
RIE
RIL
CGR
CUY
CVF
ECM
EIF
NPM
7X8
DOI 10.1109/ICORR66766.2025.11062977
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
Medline
MEDLINE
MEDLINE (Ovid)
MEDLINE
MEDLINE
PubMed
MEDLINE - Academic
DatabaseTitle MEDLINE
Medline Complete
MEDLINE with Full Text
PubMed
MEDLINE (Ovid)
MEDLINE - Academic
DatabaseTitleList
MEDLINE
MEDLINE - Academic
Database_xml – sequence: 1
  dbid: NPM
  name: PubMed
  url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed
  sourceTypes: Index Database
– sequence: 2
  dbid: EIF
  name: MEDLINE
  url: https://proxy.k.utb.cz/login?url=https://www.webofscience.com/wos/medline/basic-search
  sourceTypes: Index Database
– sequence: 3
  dbid: RIE
  name: IEEE Xplore
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Occupational Therapy & Rehabilitation
EISBN 9798350380682
EISSN 1945-7901
EndPage 1517
ExternalDocumentID 40644264
11062977
Genre orig-research
Journal Article
GroupedDBID 6IE
6IF
6IK
6IL
6IN
AAJGR
AAWTH
ADZIZ
ALMA_UNASSIGNED_HOLDINGS
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CBEJK
CHZPO
IPLJI
OCL
RIE
RIL
RNS
CGR
CUY
CVF
ECM
EIF
NPM
7X8
ID FETCH-LOGICAL-i149t-f05f0a8e63b5f42e0c556d4d93e9dce1d9439bece8f09ec9d835f1ed0ebebb0e3
IEDL.DBID RIE
ISSN 1945-7901
IngestDate Sat Jul 12 17:30:29 EDT 2025
Sun Jul 13 01:31:33 EDT 2025
Wed Jul 16 07:53:34 EDT 2025
IsPeerReviewed false
IsScholarly true
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i149t-f05f0a8e63b5f42e0c556d4d93e9dce1d9439bece8f09ec9d835f1ed0ebebb0e3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
PMID 40644264
PQID 3229500263
PQPubID 23479
PageCount 6
ParticipantIDs pubmed_primary_40644264
proquest_miscellaneous_3229500263
ieee_primary_11062977
PublicationCentury 2000
PublicationDate 2025-May
PublicationDateYYYYMMDD 2025-05-01
PublicationDate_xml – month: 05
  year: 2025
  text: 2025-May
PublicationDecade 2020
PublicationPlace United States
PublicationPlace_xml – name: United States
PublicationTitle IEEE International Conference on Rehabilitation Robotics
PublicationTitleAbbrev ICORR
PublicationTitleAlternate IEEE Int Conf Rehabil Robot
PublicationYear 2025
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssj0001286276
Score 2.291763
Snippet Intent inferral, the process by which a robotic device predicts a user's intent from biosignals, offers an effective and intuitive way to control wearable...
SourceID proquest
pubmed
ieee
SourceType Aggregation Database
Index Database
Publisher
StartPage 1512
SubjectTerms Adaptation models
Biological system modeling
Electromyography
Feedback, Sensory - physiology
Female
Humans
Intention
Iterative methods
Light emitting diodes
Machine Learning
Male
Muscles
Stroke - physiopathology
Stroke Rehabilitation - instrumentation
Stroke Rehabilitation - methods
Training
Visualization
Wearable robots
Title Reciprocal Learning of Intent Inferral with Augmented Visual Feedback for Stroke
URI https://ieeexplore.ieee.org/document/11062977
https://www.ncbi.nlm.nih.gov/pubmed/40644264
https://www.proquest.com/docview/3229500263
Volume 2025
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1bS8MwFA5uTz55mzpvRFDf2nVNmzaPMhxTcI65yd5K05yOMWhla1_89Z70Mqcw8KmlbZqQHDjfOfnOF0LutAQXFxjkYNTmGw6IrhG6MRjoKqLY5z5zClGf1yEfTJ2XmTuritWLWhgAKMhnYOrbYi9fpVGuU2UddFXcRsDSIA20s7JYayuhguDc4zVbxxKd597beKw5nJqKYLtm3bw6SGU3pix8S_-ADOtRlZSSpZln0oy-_gg2_nvYh6T1U8ZHRxsHdUT2IDkm99u6wnRSigrQBzr-Jdl9QkYIKBfaveFXlQjrnKYxLTjvGV6whxW-04lc-pjPC3FPRT8W6xyf9rFPGUZLipiYvmerdAktMu0_TXoDozp-wVhg2JQZseXGVugDZ9KNHRusyHW5cpRgIFQEXSUQzKAJgB9bAiKhEMzFXVAW2oWUFrBT0kzSBM4J9VwuOUOwgmjLUaEjfdvDaYo4MCbD0GuTlp624LNU2AjqGWuT23qJAjR7vZcRJpDm64DpY8h1AMna5Kxcu01rxCiOBnoXO_56Sfa1PZS0xSvSzFY5XCO0yORNYVLfUjPOGA
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV3JTsMwEB2xHODEVqCsRgJuKWm9NDkiRFW2UpWCuEVxPKmqSg0qyYWvZ5w0pSBV4pQoi23ZI82b8ZtngHMrwaV8CnIoavMcgX7dCWWMDrmKKPaUx0Uu6vPUUe1Xcf8u36fF6nktDCLm5DOs2dt8L98kUWZTZVfkqlSDAMsyrJLjF7Io15pLqRA8b6qSr-P6V3c3z72eZXFaMkJD1soGpkepLEaVuXdpbUCnHFdBKhnVslTXoq8_ko3_HvgmVH4K-Vh35qK2YAnH23AxryzM-oWsALtkvV-i3TvQJUg5tA6OvprKsA5YErOc9Z7ShXqY0DubymXX2SCX9zTsbfiZ0dMW9anDaMQIFbOXdJKMsAKvrdv-TduZHsDgDClwSp3YlbEbeqi4lrFooBtJqYwwPkffRFg3PsEZMgL0YtfHyDcE5-I6GpcsQ2sX-S6sjJMx7gNrSqUVJ7hCeEuYUGiv0aRpihRyrsOwWYWKnbbgo9DYCMoZq8JZuUQBGb7dzQjHmGSfAbcHkdsQkldhr1i72d-EUoSFegcLWj2FtXb_6TF4vOs8HMK6tY2CxHgEK-kkw2MCGqk-yc3rG0K40WU
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=IEEE+International+Conference+on+Rehabilitation+Robotics&rft.atitle=Reciprocal+Learning+of+Intent+Inferral+with+Augmented+Visual+Feedback+for+Stroke&rft.au=Xu%2C+Jingxi&rft.au=Chen%2C+Ava&rft.au=Winterbottom%2C+Lauren&rft.au=Palacios%2C+Joaquin&rft.date=2025-05-01&rft.pub=IEEE&rft.eissn=1945-7901&rft.spage=1512&rft.epage=1517&rft_id=info:doi/10.1109%2FICORR66766.2025.11062977&rft.externalDocID=11062977
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1945-7901&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1945-7901&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1945-7901&client=summon