Reciprocal Learning of Intent Inferral with Augmented Visual Feedback for Stroke
Intent inferral, the process by which a robotic device predicts a user's intent from biosignals, offers an effective and intuitive way to control wearable robots. Classical intent inferral methods treat biosignal inputs as unidirectional ground truths for training machine learning models, where...
Saved in:
Published in | IEEE International Conference on Rehabilitation Robotics Vol. 2025; pp. 1512 - 1517 |
---|---|
Main Authors | , , , , , , , |
Format | Conference Proceeding Journal Article |
Language | English |
Published |
United States
IEEE
01.05.2025
|
Subjects | |
Online Access | Get full text |
ISSN | 1945-7901 1945-7901 |
DOI | 10.1109/ICORR66766.2025.11062977 |
Cover
Abstract | Intent inferral, the process by which a robotic device predicts a user's intent from biosignals, offers an effective and intuitive way to control wearable robots. Classical intent inferral methods treat biosignal inputs as unidirectional ground truths for training machine learning models, where the internal state of the model is not directly observable by the user. In this work, we propose reciprocal learning, a bidirectional paradigm that facilitates human adaptation to an intent inferral classifier. Our paradigm consists of iterative, interwoven stages that alternate between updating machine learning models and guiding human adaptation with the use of augmented visual feedback. We demonstrate this paradigm in the context of controlling a robotic hand orthosis for stroke, where the device predicts open, close, and relax intents from electromyographic (EMG) signals and provides appropriate assistance. We use LED progress-bar displays to communicate to the user the predicted probabilities for open and close intents by the classifier. Our experiments with stroke subjects show reciprocal learning improving performance in a subset of subjects (two out of five) without negatively impacting performance on the others. We hypothesize that, during reciprocal learning, subjects can learn to reproduce more distinguishable muscle activation patterns and generate more separable biosignals. |
---|---|
AbstractList | Intent inferral, the process by which a robotic device predicts a user's intent from biosignals, offers an effective and intuitive way to control wearable robots. Classical intent inferral methods treat biosignal inputs as unidirectional ground truths for training machine learning models, where the internal state of the model is not directly observable by the user. In this work, we propose reciprocal learning, a bidirectional paradigm that facilitates human adaptation to an intent inferral classifier. Our paradigm consists of iterative, interwoven stages that alternate between updating machine learning models and guiding human adaptation with the use of augmented visual feedback. We demonstrate this paradigm in the context of controlling a robotic hand orthosis for stroke, where the device predicts open, close, and relax intents from electromyographic (EMG) signals and provides appropriate assistance. We use LED progress-bar displays to communicate to the user the predicted probabilities for open and close intents by the classifier. Our experiments with stroke subjects show reciprocal learning improving performance in a subset of subjects (two out of five) without negatively impacting performance on the others. We hypothesize that, during reciprocal learning, subjects can learn to reproduce more distinguishable muscle activation patterns and generate more separable biosignals. Intent inferral, the process by which a robotic device predicts a user's intent from biosignals, offers an effective and intuitive way to control wearable robots. Classical intent inferral methods treat biosignal inputs as unidirectional ground truths for training machine learning models, where the internal state of the model is not directly observable by the user. In this work, we propose reciprocal learning, a bidirectional paradigm that facilitates human adaptation to an intent inferral classifier. Our paradigm consists of iterative, interwoven stages that alternate between updating machine learning models and guiding human adaptation with the use of augmented visual feedback. We demonstrate this paradigm in the context of controlling a robotic hand orthosis for stroke, where the device predicts open, close, and relax intents from electromyographic (EMG) signals and provides appropriate assistance. We use LED progress-bar displays to communicate to the user the predicted probabilities for open and close intents by the classifier. Our experiments with stroke subjects show reciprocal learning improving performance in a subset of subjects (two out of five) without negatively impacting performance on the others. We hypothesize that, during reciprocal learning, subjects can learn to reproduce more distinguishable muscle activation patterns and generate more separable biosignals.Intent inferral, the process by which a robotic device predicts a user's intent from biosignals, offers an effective and intuitive way to control wearable robots. Classical intent inferral methods treat biosignal inputs as unidirectional ground truths for training machine learning models, where the internal state of the model is not directly observable by the user. In this work, we propose reciprocal learning, a bidirectional paradigm that facilitates human adaptation to an intent inferral classifier. Our paradigm consists of iterative, interwoven stages that alternate between updating machine learning models and guiding human adaptation with the use of augmented visual feedback. We demonstrate this paradigm in the context of controlling a robotic hand orthosis for stroke, where the device predicts open, close, and relax intents from electromyographic (EMG) signals and provides appropriate assistance. We use LED progress-bar displays to communicate to the user the predicted probabilities for open and close intents by the classifier. Our experiments with stroke subjects show reciprocal learning improving performance in a subset of subjects (two out of five) without negatively impacting performance on the others. We hypothesize that, during reciprocal learning, subjects can learn to reproduce more distinguishable muscle activation patterns and generate more separable biosignals. |
Author | Palacios, Joaquin Chen, Ava Chivukula, Preethika Ciocarlie, Matei Xu, Jingxi Winterbottom, Lauren Stein, Joel Nilsen, Dawn M. |
Author_xml | – sequence: 1 givenname: Jingxi surname: Xu fullname: Xu, Jingxi email: jxu@cs.columbia.edu organization: Columbia University,Department of Computer Science,New York,NY,USA,10027 – sequence: 2 givenname: Ava surname: Chen fullname: Chen, Ava email: ava.chen@columbia.edu organization: Columbia University,Department of Mechanical Engineering,New York,NY,USA,10027 – sequence: 3 givenname: Lauren surname: Winterbottom fullname: Winterbottom, Lauren organization: Columbia University Irving Medical Center,Department of Rehabilitation and Regenerative Medicine,New York,NY,USA,10032 – sequence: 4 givenname: Joaquin surname: Palacios fullname: Palacios, Joaquin organization: Columbia University,Department of Mechanical Engineering,New York,NY,USA,10027 – sequence: 5 givenname: Preethika surname: Chivukula fullname: Chivukula, Preethika organization: Columbia University,Department of Biomedical Engineering,New York,NY,USA,10027 – sequence: 6 givenname: Dawn M. surname: Nilsen fullname: Nilsen, Dawn M. organization: Columbia University Irving Medical Center,Department of Rehabilitation and Regenerative Medicine,New York,NY,USA,10032 – sequence: 7 givenname: Joel surname: Stein fullname: Stein, Joel organization: Columbia University Irving Medical Center,Department of Rehabilitation and Regenerative Medicine,New York,NY,USA,10032 – sequence: 8 givenname: Matei surname: Ciocarlie fullname: Ciocarlie, Matei email: matei.ciocarlie@columbia.edu organization: Columbia University,Department of Mechanical Engineering,New York,NY,USA,10027 |
BackLink | https://www.ncbi.nlm.nih.gov/pubmed/40644264$$D View this record in MEDLINE/PubMed |
BookMark | eNpNkFtLw0AQhVep2Fr7D0T20ZfU2Wuyj6VYLRSUenkNye5sjc2l5oL47420FZ_OcM7HMHMuyKCsSiSEMpgyBuZ2OX9cr7UOtZ5y4OrX1NyE4QmZmNBEQoGIQEf8lIyYkSoIDbDBv3lIJk3zAQCMR5qH-pwMJWgpuZYj8rRGm-3qyiY5XWFSl1m5oZWny7LFsu3FY1332VfWvtNZtyl6Fx19y5qudxeILk3slvqqps9tXW3xkpz5JG9wctAxeV3cvcwfgtXj_XI-WwUZk6YNPCgPSYRapMpLjmCV0k46I9A4i8wZKUyKFiMPBq1x_Z-eoQNMMU0BxZjc7Pf2x3922LRxkTUW8zwpseqaWHBuFADXokevD2iXFujiXZ0VSf0dH1vogas9kCHiX3zsWfwAG9dv0w |
ContentType | Conference Proceeding Journal Article |
DBID | 6IE 6IL CBEJK RIE RIL CGR CUY CVF ECM EIF NPM 7X8 |
DOI | 10.1109/ICORR66766.2025.11062977 |
DatabaseName | IEEE Electronic Library (IEL) Conference Proceedings IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume IEEE Xplore All Conference Proceedings IEEE Electronic Library (IEL) IEEE Proceedings Order Plans (POP All) 1998-Present Medline MEDLINE MEDLINE (Ovid) MEDLINE MEDLINE PubMed MEDLINE - Academic |
DatabaseTitle | MEDLINE Medline Complete MEDLINE with Full Text PubMed MEDLINE (Ovid) MEDLINE - Academic |
DatabaseTitleList | MEDLINE MEDLINE - Academic |
Database_xml | – sequence: 1 dbid: NPM name: PubMed url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 2 dbid: EIF name: MEDLINE url: https://proxy.k.utb.cz/login?url=https://www.webofscience.com/wos/medline/basic-search sourceTypes: Index Database – sequence: 3 dbid: RIE name: IEEE Xplore url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/ sourceTypes: Publisher |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Occupational Therapy & Rehabilitation |
EISBN | 9798350380682 |
EISSN | 1945-7901 |
EndPage | 1517 |
ExternalDocumentID | 40644264 11062977 |
Genre | orig-research Journal Article |
GroupedDBID | 6IE 6IF 6IK 6IL 6IN AAJGR AAWTH ADZIZ ALMA_UNASSIGNED_HOLDINGS BEFXN BFFAM BGNUA BKEBE BPEOZ CBEJK CHZPO IPLJI OCL RIE RIL RNS CGR CUY CVF ECM EIF NPM 7X8 |
ID | FETCH-LOGICAL-i149t-f05f0a8e63b5f42e0c556d4d93e9dce1d9439bece8f09ec9d835f1ed0ebebb0e3 |
IEDL.DBID | RIE |
ISSN | 1945-7901 |
IngestDate | Sat Jul 12 17:30:29 EDT 2025 Sun Jul 13 01:31:33 EDT 2025 Wed Jul 16 07:53:34 EDT 2025 |
IsPeerReviewed | false |
IsScholarly | true |
Language | English |
LinkModel | DirectLink |
MergedId | FETCHMERGED-LOGICAL-i149t-f05f0a8e63b5f42e0c556d4d93e9dce1d9439bece8f09ec9d835f1ed0ebebb0e3 |
Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23 |
PMID | 40644264 |
PQID | 3229500263 |
PQPubID | 23479 |
PageCount | 6 |
ParticipantIDs | pubmed_primary_40644264 proquest_miscellaneous_3229500263 ieee_primary_11062977 |
PublicationCentury | 2000 |
PublicationDate | 2025-May |
PublicationDateYYYYMMDD | 2025-05-01 |
PublicationDate_xml | – month: 05 year: 2025 text: 2025-May |
PublicationDecade | 2020 |
PublicationPlace | United States |
PublicationPlace_xml | – name: United States |
PublicationTitle | IEEE International Conference on Rehabilitation Robotics |
PublicationTitleAbbrev | ICORR |
PublicationTitleAlternate | IEEE Int Conf Rehabil Robot |
PublicationYear | 2025 |
Publisher | IEEE |
Publisher_xml | – name: IEEE |
SSID | ssj0001286276 |
Score | 2.291763 |
Snippet | Intent inferral, the process by which a robotic device predicts a user's intent from biosignals, offers an effective and intuitive way to control wearable... |
SourceID | proquest pubmed ieee |
SourceType | Aggregation Database Index Database Publisher |
StartPage | 1512 |
SubjectTerms | Adaptation models Biological system modeling Electromyography Feedback, Sensory - physiology Female Humans Intention Iterative methods Light emitting diodes Machine Learning Male Muscles Stroke - physiopathology Stroke Rehabilitation - instrumentation Stroke Rehabilitation - methods Training Visualization Wearable robots |
Title | Reciprocal Learning of Intent Inferral with Augmented Visual Feedback for Stroke |
URI | https://ieeexplore.ieee.org/document/11062977 https://www.ncbi.nlm.nih.gov/pubmed/40644264 https://www.proquest.com/docview/3229500263 |
Volume | 2025 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1bS8MwFA5uTz55mzpvRFDf2nVNmzaPMhxTcI65yd5K05yOMWhla1_89Z70Mqcw8KmlbZqQHDjfOfnOF0LutAQXFxjkYNTmGw6IrhG6MRjoKqLY5z5zClGf1yEfTJ2XmTuritWLWhgAKMhnYOrbYi9fpVGuU2UddFXcRsDSIA20s7JYayuhguDc4zVbxxKd597beKw5nJqKYLtm3bw6SGU3pix8S_-ADOtRlZSSpZln0oy-_gg2_nvYh6T1U8ZHRxsHdUT2IDkm99u6wnRSigrQBzr-Jdl9QkYIKBfaveFXlQjrnKYxLTjvGV6whxW-04lc-pjPC3FPRT8W6xyf9rFPGUZLipiYvmerdAktMu0_TXoDozp-wVhg2JQZseXGVugDZ9KNHRusyHW5cpRgIFQEXSUQzKAJgB9bAiKhEMzFXVAW2oWUFrBT0kzSBM4J9VwuOUOwgmjLUaEjfdvDaYo4MCbD0GuTlp624LNU2AjqGWuT23qJAjR7vZcRJpDm64DpY8h1AMna5Kxcu01rxCiOBnoXO_56Sfa1PZS0xSvSzFY5XCO0yORNYVLfUjPOGA |
linkProvider | IEEE |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV3JTsMwEB2xHODEVqCsRgJuKWm9NDkiRFW2UpWCuEVxPKmqSg0qyYWvZ5w0pSBV4pQoi23ZI82b8ZtngHMrwaV8CnIoavMcgX7dCWWMDrmKKPaUx0Uu6vPUUe1Xcf8u36fF6nktDCLm5DOs2dt8L98kUWZTZVfkqlSDAMsyrJLjF7Io15pLqRA8b6qSr-P6V3c3z72eZXFaMkJD1soGpkepLEaVuXdpbUCnHFdBKhnVslTXoq8_ko3_HvgmVH4K-Vh35qK2YAnH23AxryzM-oWsALtkvV-i3TvQJUg5tA6OvprKsA5YErOc9Z7ShXqY0DubymXX2SCX9zTsbfiZ0dMW9anDaMQIFbOXdJKMsAKvrdv-TduZHsDgDClwSp3YlbEbeqi4lrFooBtJqYwwPkffRFg3PsEZMgL0YtfHyDcE5-I6GpcsQ2sX-S6sjJMx7gNrSqUVJ7hCeEuYUGiv0aRpihRyrsOwWYWKnbbgo9DYCMoZq8JZuUQBGb7dzQjHmGSfAbcHkdsQkldhr1i72d-EUoSFegcLWj2FtXb_6TF4vOs8HMK6tY2CxHgEK-kkw2MCGqk-yc3rG0K40WU |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=IEEE+International+Conference+on+Rehabilitation+Robotics&rft.atitle=Reciprocal+Learning+of+Intent+Inferral+with+Augmented+Visual+Feedback+for+Stroke&rft.au=Xu%2C+Jingxi&rft.au=Chen%2C+Ava&rft.au=Winterbottom%2C+Lauren&rft.au=Palacios%2C+Joaquin&rft.date=2025-05-01&rft.pub=IEEE&rft.eissn=1945-7901&rft.spage=1512&rft.epage=1517&rft_id=info:doi/10.1109%2FICORR66766.2025.11062977&rft.externalDocID=11062977 |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1945-7901&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1945-7901&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1945-7901&client=summon |