Self-Supervised Learning for Data Scarcity in a Fatigue Damage Prognostic Problem
With the increasing availability of data for Prognostics and Health Management (PHM), Deep Learning (DL) techniques are now the subject of considerable attention for this application, often achieving more accurate Remaining Useful Life (RUL) predictions. However, one of the major challenges for DL t...
Saved in:
Published in | arXiv.org |
---|---|
Main Authors | , , , |
Format | Paper Journal Article |
Language | English |
Published |
Ithaca
Cornell University Library, arXiv.org
20.01.2023
|
Subjects | |
Online Access | Get full text |
ISSN | 2331-8422 |
DOI | 10.48550/arxiv.2301.08441 |
Cover
Abstract | With the increasing availability of data for Prognostics and Health Management (PHM), Deep Learning (DL) techniques are now the subject of considerable attention for this application, often achieving more accurate Remaining Useful Life (RUL) predictions. However, one of the major challenges for DL techniques resides in the difficulty of obtaining large amounts of labelled data on industrial systems. To overcome this lack of labelled data, an emerging learning technique is considered in our work: Self-Supervised Learning, a sub-category of unsupervised learning approaches. This paper aims to investigate whether pre-training DL models in a self-supervised way on unlabelled sensors data can be useful for RUL estimation with only Few-Shots Learning, i.e. with scarce labelled data. In this research, a fatigue damage prognostics problem is addressed, through the estimation of the RUL of aluminum alloy panels (typical of aerospace structures) subject to fatigue cracks from strain gauge data. Synthetic datasets composed of strain data are used allowing to extensively investigate the influence of the dataset size on the predictive performance. Results show that the self-supervised pre-trained models are able to significantly outperform the non-pre-trained models in downstream RUL prediction task, and with less computational expense, showing promising results in prognostic tasks when only limited labelled data is available. |
---|---|
AbstractList | With the increasing availability of data for Prognostics and Health Management (PHM), Deep Learning (DL) techniques are now the subject of considerable attention for this application, often achieving more accurate Remaining Useful Life (RUL) predictions. However, one of the major challenges for DL techniques resides in the difficulty of obtaining large amounts of labelled data on industrial systems. To overcome this lack of labelled data, an emerging learning technique is considered in our work: Self-Supervised Learning, a sub-category of unsupervised learning approaches. This paper aims to investigate whether pre-training DL models in a self-supervised way on unlabelled sensors data can be useful for RUL estimation with only Few-Shots Learning, i.e. with scarce labelled data. In this research, a fatigue damage prognostics problem is addressed, through the estimation of the RUL of aluminum alloy panels (typical of aerospace structures) subject to fatigue cracks from strain gauge data. Synthetic datasets composed of strain data are used allowing to extensively investigate the influence of the dataset size on the predictive performance. Results show that the self-supervised pre-trained models are able to significantly outperform the non-pre-trained models in downstream RUL prediction task, and with less computational expense, showing promising results in prognostic tasks when only limited labelled data is available. Eng. Appl. Artif. Intell. 120 (2023), 105837 With the increasing availability of data for Prognostics and Health Management (PHM), Deep Learning (DL) techniques are now the subject of considerable attention for this application, often achieving more accurate Remaining Useful Life (RUL) predictions. However, one of the major challenges for DL techniques resides in the difficulty of obtaining large amounts of labelled data on industrial systems. To overcome this lack of labelled data, an emerging learning technique is considered in our work: Self-Supervised Learning, a sub-category of unsupervised learning approaches. This paper aims to investigate whether pre-training DL models in a self-supervised way on unlabelled sensors data can be useful for RUL estimation with only Few-Shots Learning, i.e. with scarce labelled data. In this research, a fatigue damage prognostics problem is addressed, through the estimation of the RUL of aluminum alloy panels (typical of aerospace structures) subject to fatigue cracks from strain gauge data. Synthetic datasets composed of strain data are used allowing to extensively investigate the influence of the dataset size on the predictive performance. Results show that the self-supervised pre-trained models are able to significantly outperform the non-pre-trained models in downstream RUL prediction task, and with less computational expense, showing promising results in prognostic tasks when only limited labelled data is available. |
Author | Akrim, Anass Salaün, Michel Gogu, Christian Vingerhoeds, Rob |
Author_xml | – sequence: 1 givenname: Anass surname: Akrim fullname: Akrim, Anass – sequence: 2 givenname: Christian surname: Gogu fullname: Gogu, Christian – sequence: 3 givenname: Rob surname: Vingerhoeds fullname: Vingerhoeds, Rob – sequence: 4 givenname: Michel surname: Salaün fullname: Salaün, Michel |
BackLink | https://doi.org/10.48550/arXiv.2301.08441$$DView paper in arXiv https://doi.org/10.1016/j.engappai.2023.105837$$DView published paper (Access to full text may be restricted) |
BookMark | eNotj09PwkAUxDdGExH5AJ7cxHPxdf-wy9GgqAmJGrg3r9vXZglscdsS-fYU8DSTzGQyvzt2HepAjD2kMFZWa3jG-Of3YyEhHYNVKr1iAyFlmlglxC0bNc0aAMTECK3lgP0saVMmy25Hce8bKviCMAYfKl7Wkb9ii3zpMDrfHrgPHPkcW1911EdbrIh_x7oKddN6d7L5hrb37KbETUOjfx2y1fxtNftIFl_vn7OXRYJaqARLpQowpZoSOGmMBZDC5VMBuXM40cLqnJQ1BgslKBWyv4sFwRR1qVMs5JA9XmbPvNku-i3GQ3bizs7cfePp0tjF-rejps3WdRdD_ykTZmK1MVIqeQRJeFvn |
ContentType | Paper Journal Article |
Copyright | 2023. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. http://arxiv.org/licenses/nonexclusive-distrib/1.0 |
Copyright_xml | – notice: 2023. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. – notice: http://arxiv.org/licenses/nonexclusive-distrib/1.0 |
DBID | 8FE 8FG ABJCF ABUWG AFKRA AZQEC BENPR BGLVJ CCPQU DWQXO HCIFZ L6V M7S PHGZM PHGZT PIMPY PKEHL PQEST PQGLB PQQKQ PQUKI PRINS PTHSS AKY EPD GOX |
DOI | 10.48550/arxiv.2301.08441 |
DatabaseName | ProQuest SciTech Collection ProQuest Technology Collection Materials Science & Engineering Collection ProQuest Central (Alumni) ProQuest Central UK/Ireland ProQuest Central Essentials - QC ProQuest Central - New (Subscription) Technology collection ProQuest One Community College ProQuest Central Korea SciTech Premium Collection ProQuest Engineering Collection Engineering Database ProQuest Central Premium ProQuest One Academic (New) Publicly Available Content Database ProQuest One Academic Middle East (New) ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Applied & Life Sciences ProQuest One Academic ProQuest One Academic UKI Edition ProQuest Central China Engineering Collection arXiv Computer Science arXiv Statistics arXiv.org |
DatabaseTitle | Publicly Available Content Database Engineering Database Technology Collection ProQuest One Academic Middle East (New) ProQuest Central Essentials ProQuest One Academic Eastern Edition ProQuest Central (Alumni Edition) SciTech Premium Collection ProQuest One Community College ProQuest Technology Collection ProQuest SciTech Collection ProQuest Central China ProQuest Central ProQuest One Applied & Life Sciences ProQuest Engineering Collection ProQuest One Academic UKI Edition ProQuest Central Korea Materials Science & Engineering Collection ProQuest Central (New) ProQuest One Academic ProQuest One Academic (New) Engineering Collection |
DatabaseTitleList | Publicly Available Content Database |
Database_xml | – sequence: 1 dbid: GOX name: arXiv.org url: http://arxiv.org/find sourceTypes: Open Access Repository – sequence: 2 dbid: 8FG name: ProQuest Technology Collection url: https://search.proquest.com/technologycollection1 sourceTypes: Aggregation Database |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Physics |
EISSN | 2331-8422 |
ExternalDocumentID | 2301_08441 |
Genre | Working Paper/Pre-Print |
GroupedDBID | 8FE 8FG ABJCF ABUWG AFKRA ALMA_UNASSIGNED_HOLDINGS AZQEC BENPR BGLVJ CCPQU DWQXO FRJ HCIFZ L6V M7S M~E PHGZM PHGZT PIMPY PKEHL PQEST PQGLB PQQKQ PQUKI PRINS PTHSS AKY EPD GOX |
ID | FETCH-LOGICAL-a524-af44d07f49e0c37780032cb920bcca65285be4877ad42e123255ade09a5f51ad3 |
IEDL.DBID | 8FG |
IngestDate | Tue Jul 22 23:03:08 EDT 2025 Mon Jun 30 09:21:36 EDT 2025 |
IsDoiOpenAccess | true |
IsOpenAccess | true |
IsPeerReviewed | false |
IsScholarly | false |
Language | English |
LinkModel | DirectLink |
MergedId | FETCHMERGED-LOGICAL-a524-af44d07f49e0c37780032cb920bcca65285be4877ad42e123255ade09a5f51ad3 |
Notes | SourceType-Working Papers-1 ObjectType-Working Paper/Pre-Print-1 content type line 50 |
OpenAccessLink | https://www.proquest.com/docview/2768577334?pq-origsite=%requestingapplication% |
PQID | 2768577334 |
PQPubID | 2050157 |
ParticipantIDs | arxiv_primary_2301_08441 proquest_journals_2768577334 |
PublicationCentury | 2000 |
PublicationDate | 20230120 2023-01-20 |
PublicationDateYYYYMMDD | 2023-01-20 |
PublicationDate_xml | – month: 01 year: 2023 text: 20230120 day: 20 |
PublicationDecade | 2020 |
PublicationPlace | Ithaca |
PublicationPlace_xml | – name: Ithaca |
PublicationTitle | arXiv.org |
PublicationYear | 2023 |
Publisher | Cornell University Library, arXiv.org |
Publisher_xml | – name: Cornell University Library, arXiv.org |
SSID | ssj0002672553 |
Score | 1.822568 |
SecondaryResourceType | preprint |
Snippet | With the increasing availability of data for Prognostics and Health Management (PHM), Deep Learning (DL) techniques are now the subject of considerable... Eng. Appl. Artif. Intell. 120 (2023), 105837 With the increasing availability of data for Prognostics and Health Management (PHM), Deep Learning (DL)... |
SourceID | arxiv proquest |
SourceType | Open Access Repository Aggregation Database |
SubjectTerms | Aluminum base alloys Availability Computer Science - Artificial Intelligence Computer Science - Learning Crack propagation Damage Datasets Deep learning Fatigue cracks Fatigue failure Machine learning Performance prediction Self-supervised learning Statistics - Machine Learning Strain gauges Unsupervised learning |
SummonAdditionalLinks | – databaseName: arXiv.org dbid: GOX link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwdV3PS8MwGA1zJy-iqGw6JQevxS4_26Oocwj-YhN2K0nzZQy0G-sm_vl-STs8iLfQpD285Evea5L3EXKlhDIyUxZFjjWJGHoMKWfLRDmbCQ5llkbbxadnNX4XjzM56xC6uwtj1t-Lr8Yf2NbXyI-Dw6YIN9P3GAvi6uFl1mxORiuutv1vO-SY8dGfqTWuF6NDctASPXrT9MwR6UB1TN4m8OGTyXYVIrQGR1t70zlF7kjvzMbQsCNSIjWmi4oaOkLg5lvAqk8MfPq6XoaDcfjJUAyZYE7IdHQ_vR0nbVKDxEgmEuOFcKn2Ioe05FojX-OstDlLLWKpJMukBRQR2jjBIPAdKY2DNDfSy6Fx_JR0q2UFPUKHSgJXXmXegeBC2RSsUiZHBca0l6JPehGKYtX4VhQBpSKi1CeDHTpFO2brgqHykFpzLs7-f_Oc7IeE6-EnBEsHpLtZb-ECl-WNvYx98wOG8Iv_ priority: 102 providerName: Cornell University |
Title | Self-Supervised Learning for Data Scarcity in a Fatigue Damage Prognostic Problem |
URI | https://www.proquest.com/docview/2768577334 https://arxiv.org/abs/2301.08441 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1NT8JAEN0oxMSbnwFFsgevDe1-tT2ZqBRiAqJgwq3Z7W4JiQK2YDz5251dih5MvDRt9_Z2dubN7GQeQteCCckjoSDJUdJjQQ5HSqvME1pFjJos8t3YxcFQ9F_Yw5RPq4JbWbVV7nyic9R6mdkaeYcAL-ZhSCm7Wb17VjXK3q5WEhr7qB5ApLF2HiW9nxoLESEwZrq9zHSjuzqy-Jx_2O5nO7mTWR34uvv1xxW7-JIcofpIrkxxjPbM4gQduLbMrDxFT2Pzmnvjzcqe6NJoXI1DnWHgmvheriW2NygZUGk8X2CJEwB6tjGw9AaOAo-KpW2kA-Owr1Y55gxNku7kru9VIgie5IR5MmdM-2HOYuNnNAyB31GSqZj4CrAXnERcGUg6QqkZMZYfcS618WPJcx5ITc9RbbFcmAbCgeCGilxEuTaMMqF8o4SQMWRsJMw5a6KGgyJdbedcpBal1KHURK0dOmll42X6uyMX_y9fokMr0m4LF8Rvodq62JgrCOVr1Xb71Ub12-5w9AxfvccpPAdf3W8DZKCb |
linkProvider | ProQuest |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1ZS8NAEB5qi-ibJ97ugz4G072SPojgUVqPUm0F38JudiOCtrWHx4_yPzqTtvog-Na3kA2BzMxOvjl2PoADLbVRsbYY5FgTyHKGW8rZNNDOxlL4NA7zsYs3DV27l5cP6qEAX9OzMNRWOfWJuaN23ZRy5EcccbGKIiHkSe81INYoqq5OKTTGZnHlP98xZBsc189Rv4ecVy_aZ7VgwioQGMVlYDIpXRhlsuLDVEQRAibBU1vhocWP0YrHynpE8ZFxknsCHEoZ58OKUZkqGyfwtXNQknSgtQil04tG8-4nqcN1hI-LcfU0nxV2ZPofT2_Ubk2jQiURz5fyW398f_5Dqy5BqWl6vr8MBd9Zgfm8DzQdrMJtyz9nQWvUIxcy8I5N5q8-MgS37NwMDaOSTYrYnT11mGFV1OzjyOPSC3om1ux3qXMPrZEuiapmDdqzkM86FDvdjt8AVtbKC53pOHNeCqlt6K3WpoIhIo8yJTdhIxdF0hsP1khISkkupU3YmUonmWyqQfJrAlv_L-_DQq19c51c1xtX27BIDPGUNeHhDhSH_ZHfRRwxtHsT7TFIZmwv36Uh2cY |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Self-Supervised+Learning+for+Data+Scarcity+in+a+Fatigue+Damage+Prognostic+Problem&rft.jtitle=arXiv.org&rft.au=Akrim%2C+Anass&rft.au=Gogu%2C+Christian&rft.au=Vingerhoeds%2C+Rob&rft.au=Sala%C3%BCn%2C+Michel&rft.date=2023-01-20&rft.pub=Cornell+University+Library%2C+arXiv.org&rft.eissn=2331-8422&rft_id=info:doi/10.48550%2Farxiv.2301.08441 |