Self-Supervised Learning for Data Scarcity in a Fatigue Damage Prognostic Problem

With the increasing availability of data for Prognostics and Health Management (PHM), Deep Learning (DL) techniques are now the subject of considerable attention for this application, often achieving more accurate Remaining Useful Life (RUL) predictions. However, one of the major challenges for DL t...

Full description

Saved in:
Bibliographic Details
Published inarXiv.org
Main Authors Akrim, Anass, Gogu, Christian, Vingerhoeds, Rob, Salaün, Michel
Format Paper Journal Article
LanguageEnglish
Published Ithaca Cornell University Library, arXiv.org 20.01.2023
Subjects
Online AccessGet full text
ISSN2331-8422
DOI10.48550/arxiv.2301.08441

Cover

Abstract With the increasing availability of data for Prognostics and Health Management (PHM), Deep Learning (DL) techniques are now the subject of considerable attention for this application, often achieving more accurate Remaining Useful Life (RUL) predictions. However, one of the major challenges for DL techniques resides in the difficulty of obtaining large amounts of labelled data on industrial systems. To overcome this lack of labelled data, an emerging learning technique is considered in our work: Self-Supervised Learning, a sub-category of unsupervised learning approaches. This paper aims to investigate whether pre-training DL models in a self-supervised way on unlabelled sensors data can be useful for RUL estimation with only Few-Shots Learning, i.e. with scarce labelled data. In this research, a fatigue damage prognostics problem is addressed, through the estimation of the RUL of aluminum alloy panels (typical of aerospace structures) subject to fatigue cracks from strain gauge data. Synthetic datasets composed of strain data are used allowing to extensively investigate the influence of the dataset size on the predictive performance. Results show that the self-supervised pre-trained models are able to significantly outperform the non-pre-trained models in downstream RUL prediction task, and with less computational expense, showing promising results in prognostic tasks when only limited labelled data is available.
AbstractList With the increasing availability of data for Prognostics and Health Management (PHM), Deep Learning (DL) techniques are now the subject of considerable attention for this application, often achieving more accurate Remaining Useful Life (RUL) predictions. However, one of the major challenges for DL techniques resides in the difficulty of obtaining large amounts of labelled data on industrial systems. To overcome this lack of labelled data, an emerging learning technique is considered in our work: Self-Supervised Learning, a sub-category of unsupervised learning approaches. This paper aims to investigate whether pre-training DL models in a self-supervised way on unlabelled sensors data can be useful for RUL estimation with only Few-Shots Learning, i.e. with scarce labelled data. In this research, a fatigue damage prognostics problem is addressed, through the estimation of the RUL of aluminum alloy panels (typical of aerospace structures) subject to fatigue cracks from strain gauge data. Synthetic datasets composed of strain data are used allowing to extensively investigate the influence of the dataset size on the predictive performance. Results show that the self-supervised pre-trained models are able to significantly outperform the non-pre-trained models in downstream RUL prediction task, and with less computational expense, showing promising results in prognostic tasks when only limited labelled data is available.
Eng. Appl. Artif. Intell. 120 (2023), 105837 With the increasing availability of data for Prognostics and Health Management (PHM), Deep Learning (DL) techniques are now the subject of considerable attention for this application, often achieving more accurate Remaining Useful Life (RUL) predictions. However, one of the major challenges for DL techniques resides in the difficulty of obtaining large amounts of labelled data on industrial systems. To overcome this lack of labelled data, an emerging learning technique is considered in our work: Self-Supervised Learning, a sub-category of unsupervised learning approaches. This paper aims to investigate whether pre-training DL models in a self-supervised way on unlabelled sensors data can be useful for RUL estimation with only Few-Shots Learning, i.e. with scarce labelled data. In this research, a fatigue damage prognostics problem is addressed, through the estimation of the RUL of aluminum alloy panels (typical of aerospace structures) subject to fatigue cracks from strain gauge data. Synthetic datasets composed of strain data are used allowing to extensively investigate the influence of the dataset size on the predictive performance. Results show that the self-supervised pre-trained models are able to significantly outperform the non-pre-trained models in downstream RUL prediction task, and with less computational expense, showing promising results in prognostic tasks when only limited labelled data is available.
Author Akrim, Anass
Salaün, Michel
Gogu, Christian
Vingerhoeds, Rob
Author_xml – sequence: 1
  givenname: Anass
  surname: Akrim
  fullname: Akrim, Anass
– sequence: 2
  givenname: Christian
  surname: Gogu
  fullname: Gogu, Christian
– sequence: 3
  givenname: Rob
  surname: Vingerhoeds
  fullname: Vingerhoeds, Rob
– sequence: 4
  givenname: Michel
  surname: Salaün
  fullname: Salaün, Michel
BackLink https://doi.org/10.48550/arXiv.2301.08441$$DView paper in arXiv
https://doi.org/10.1016/j.engappai.2023.105837$$DView published paper (Access to full text may be restricted)
BookMark eNotj09PwkAUxDdGExH5AJ7cxHPxdf-wy9GgqAmJGrg3r9vXZglscdsS-fYU8DSTzGQyvzt2HepAjD2kMFZWa3jG-Of3YyEhHYNVKr1iAyFlmlglxC0bNc0aAMTECK3lgP0saVMmy25Hce8bKviCMAYfKl7Wkb9ii3zpMDrfHrgPHPkcW1911EdbrIh_x7oKddN6d7L5hrb37KbETUOjfx2y1fxtNftIFl_vn7OXRYJaqARLpQowpZoSOGmMBZDC5VMBuXM40cLqnJQ1BgslKBWyv4sFwRR1qVMs5JA9XmbPvNku-i3GQ3bizs7cfePp0tjF-rejps3WdRdD_ykTZmK1MVIqeQRJeFvn
ContentType Paper
Journal Article
Copyright 2023. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
http://arxiv.org/licenses/nonexclusive-distrib/1.0
Copyright_xml – notice: 2023. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
– notice: http://arxiv.org/licenses/nonexclusive-distrib/1.0
DBID 8FE
8FG
ABJCF
ABUWG
AFKRA
AZQEC
BENPR
BGLVJ
CCPQU
DWQXO
HCIFZ
L6V
M7S
PHGZM
PHGZT
PIMPY
PKEHL
PQEST
PQGLB
PQQKQ
PQUKI
PRINS
PTHSS
AKY
EPD
GOX
DOI 10.48550/arxiv.2301.08441
DatabaseName ProQuest SciTech Collection
ProQuest Technology Collection
Materials Science & Engineering Collection
ProQuest Central (Alumni)
ProQuest Central UK/Ireland
ProQuest Central Essentials - QC
ProQuest Central - New (Subscription)
Technology collection
ProQuest One Community College
ProQuest Central Korea
SciTech Premium Collection
ProQuest Engineering Collection
Engineering Database
ProQuest Central Premium
ProQuest One Academic (New)
Publicly Available Content Database
ProQuest One Academic Middle East (New)
ProQuest One Academic Eastern Edition (DO NOT USE)
ProQuest One Applied & Life Sciences
ProQuest One Academic
ProQuest One Academic UKI Edition
ProQuest Central China
Engineering Collection
arXiv Computer Science
arXiv Statistics
arXiv.org
DatabaseTitle Publicly Available Content Database
Engineering Database
Technology Collection
ProQuest One Academic Middle East (New)
ProQuest Central Essentials
ProQuest One Academic Eastern Edition
ProQuest Central (Alumni Edition)
SciTech Premium Collection
ProQuest One Community College
ProQuest Technology Collection
ProQuest SciTech Collection
ProQuest Central China
ProQuest Central
ProQuest One Applied & Life Sciences
ProQuest Engineering Collection
ProQuest One Academic UKI Edition
ProQuest Central Korea
Materials Science & Engineering Collection
ProQuest Central (New)
ProQuest One Academic
ProQuest One Academic (New)
Engineering Collection
DatabaseTitleList Publicly Available Content Database

Database_xml – sequence: 1
  dbid: GOX
  name: arXiv.org
  url: http://arxiv.org/find
  sourceTypes: Open Access Repository
– sequence: 2
  dbid: 8FG
  name: ProQuest Technology Collection
  url: https://search.proquest.com/technologycollection1
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Physics
EISSN 2331-8422
ExternalDocumentID 2301_08441
Genre Working Paper/Pre-Print
GroupedDBID 8FE
8FG
ABJCF
ABUWG
AFKRA
ALMA_UNASSIGNED_HOLDINGS
AZQEC
BENPR
BGLVJ
CCPQU
DWQXO
FRJ
HCIFZ
L6V
M7S
M~E
PHGZM
PHGZT
PIMPY
PKEHL
PQEST
PQGLB
PQQKQ
PQUKI
PRINS
PTHSS
AKY
EPD
GOX
ID FETCH-LOGICAL-a524-af44d07f49e0c37780032cb920bcca65285be4877ad42e123255ade09a5f51ad3
IEDL.DBID 8FG
IngestDate Tue Jul 22 23:03:08 EDT 2025
Mon Jun 30 09:21:36 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-a524-af44d07f49e0c37780032cb920bcca65285be4877ad42e123255ade09a5f51ad3
Notes SourceType-Working Papers-1
ObjectType-Working Paper/Pre-Print-1
content type line 50
OpenAccessLink https://www.proquest.com/docview/2768577334?pq-origsite=%requestingapplication%
PQID 2768577334
PQPubID 2050157
ParticipantIDs arxiv_primary_2301_08441
proquest_journals_2768577334
PublicationCentury 2000
PublicationDate 20230120
2023-01-20
PublicationDateYYYYMMDD 2023-01-20
PublicationDate_xml – month: 01
  year: 2023
  text: 20230120
  day: 20
PublicationDecade 2020
PublicationPlace Ithaca
PublicationPlace_xml – name: Ithaca
PublicationTitle arXiv.org
PublicationYear 2023
Publisher Cornell University Library, arXiv.org
Publisher_xml – name: Cornell University Library, arXiv.org
SSID ssj0002672553
Score 1.822568
SecondaryResourceType preprint
Snippet With the increasing availability of data for Prognostics and Health Management (PHM), Deep Learning (DL) techniques are now the subject of considerable...
Eng. Appl. Artif. Intell. 120 (2023), 105837 With the increasing availability of data for Prognostics and Health Management (PHM), Deep Learning (DL)...
SourceID arxiv
proquest
SourceType Open Access Repository
Aggregation Database
SubjectTerms Aluminum base alloys
Availability
Computer Science - Artificial Intelligence
Computer Science - Learning
Crack propagation
Damage
Datasets
Deep learning
Fatigue cracks
Fatigue failure
Machine learning
Performance prediction
Self-supervised learning
Statistics - Machine Learning
Strain gauges
Unsupervised learning
SummonAdditionalLinks – databaseName: arXiv.org
  dbid: GOX
  link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwdV3PS8MwGA1zJy-iqGw6JQevxS4_26Oocwj-YhN2K0nzZQy0G-sm_vl-STs8iLfQpD285Evea5L3EXKlhDIyUxZFjjWJGHoMKWfLRDmbCQ5llkbbxadnNX4XjzM56xC6uwtj1t-Lr8Yf2NbXyI-Dw6YIN9P3GAvi6uFl1mxORiuutv1vO-SY8dGfqTWuF6NDctASPXrT9MwR6UB1TN4m8OGTyXYVIrQGR1t70zlF7kjvzMbQsCNSIjWmi4oaOkLg5lvAqk8MfPq6XoaDcfjJUAyZYE7IdHQ_vR0nbVKDxEgmEuOFcKn2Ioe05FojX-OstDlLLWKpJMukBRQR2jjBIPAdKY2DNDfSy6Fx_JR0q2UFPUKHSgJXXmXegeBC2RSsUiZHBca0l6JPehGKYtX4VhQBpSKi1CeDHTpFO2brgqHykFpzLs7-f_Oc7IeE6-EnBEsHpLtZb-ECl-WNvYx98wOG8Iv_
  priority: 102
  providerName: Cornell University
Title Self-Supervised Learning for Data Scarcity in a Fatigue Damage Prognostic Problem
URI https://www.proquest.com/docview/2768577334
https://arxiv.org/abs/2301.08441
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1NT8JAEN0oxMSbnwFFsgevDe1-tT2ZqBRiAqJgwq3Z7W4JiQK2YDz5251dih5MvDRt9_Z2dubN7GQeQteCCckjoSDJUdJjQQ5HSqvME1pFjJos8t3YxcFQ9F_Yw5RPq4JbWbVV7nyic9R6mdkaeYcAL-ZhSCm7Wb17VjXK3q5WEhr7qB5ApLF2HiW9nxoLESEwZrq9zHSjuzqy-Jx_2O5nO7mTWR34uvv1xxW7-JIcofpIrkxxjPbM4gQduLbMrDxFT2Pzmnvjzcqe6NJoXI1DnWHgmvheriW2NygZUGk8X2CJEwB6tjGw9AaOAo-KpW2kA-Owr1Y55gxNku7kru9VIgie5IR5MmdM-2HOYuNnNAyB31GSqZj4CrAXnERcGUg6QqkZMZYfcS618WPJcx5ITc9RbbFcmAbCgeCGilxEuTaMMqF8o4SQMWRsJMw5a6KGgyJdbedcpBal1KHURK0dOmll42X6uyMX_y9fokMr0m4LF8Rvodq62JgrCOVr1Xb71Ub12-5w9AxfvccpPAdf3W8DZKCb
linkProvider ProQuest
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1ZS8NAEB5qi-ibJ97ugz4G072SPojgUVqPUm0F38JudiOCtrWHx4_yPzqTtvog-Na3kA2BzMxOvjl2PoADLbVRsbYY5FgTyHKGW8rZNNDOxlL4NA7zsYs3DV27l5cP6qEAX9OzMNRWOfWJuaN23ZRy5EcccbGKIiHkSe81INYoqq5OKTTGZnHlP98xZBsc189Rv4ecVy_aZ7VgwioQGMVlYDIpXRhlsuLDVEQRAibBU1vhocWP0YrHynpE8ZFxknsCHEoZ58OKUZkqGyfwtXNQknSgtQil04tG8-4nqcN1hI-LcfU0nxV2ZPofT2_Ubk2jQiURz5fyW398f_5Dqy5BqWl6vr8MBd9Zgfm8DzQdrMJtyz9nQWvUIxcy8I5N5q8-MgS37NwMDaOSTYrYnT11mGFV1OzjyOPSC3om1ux3qXMPrZEuiapmDdqzkM86FDvdjt8AVtbKC53pOHNeCqlt6K3WpoIhIo8yJTdhIxdF0hsP1khISkkupU3YmUonmWyqQfJrAlv_L-_DQq19c51c1xtX27BIDPGUNeHhDhSH_ZHfRRwxtHsT7TFIZmwv36Uh2cY
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Self-Supervised+Learning+for+Data+Scarcity+in+a+Fatigue+Damage+Prognostic+Problem&rft.jtitle=arXiv.org&rft.au=Akrim%2C+Anass&rft.au=Gogu%2C+Christian&rft.au=Vingerhoeds%2C+Rob&rft.au=Sala%C3%BCn%2C+Michel&rft.date=2023-01-20&rft.pub=Cornell+University+Library%2C+arXiv.org&rft.eissn=2331-8422&rft_id=info:doi/10.48550%2Farxiv.2301.08441