Approaches for Using Machine Learning Algorithms with Large Label Sets for Rotorcraft Maintenance

The US Army Aviation and Missile Research, Development, and Engineering Center (AMRDEC), in collaboration with the US Army Engineer Research and Development Center (ERDC), is using machine learning (ML) to transform the way rotorcraft maintenance logbook event data is scored for reporting purposes....

Full description

Saved in:
Bibliographic Details
Published in2019 IEEE Aerospace Conference pp. 1 - 8
Main Authors Seale, Maria, Hines, Amanda, Nabholz, Grace, Ruvinsky, Alicia, Eslinger, Owen, Rigoni, Nathan, Vega-Maisonet, Luis
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.03.2019
Subjects
Online AccessGet full text

Cover

Loading…
Abstract The US Army Aviation and Missile Research, Development, and Engineering Center (AMRDEC), in collaboration with the US Army Engineer Research and Development Center (ERDC), is using machine learning (ML) to transform the way rotorcraft maintenance logbook event data is scored for reporting purposes. Traditionally, human analysts manually inspect data fields completed by maintenance personnel and, using published guidelines in conjunction with their personal expertise, provide sets of labels or scores for each event. These labels are stored with the data and provide valuable insight into maintenance event histories. However, the inequity between the enormous volume of maintenance data generated daily and the ability of analysts to score the data results in only 10% of all data receiving scores; therefore, 90% of the recorded data does not contain this important value added feature. Classification algorithms for automating this scoring process trained on existing labeled data sets have been implemented with promising results. A particularly challenging element of this problem, however, involves the classification of the specific component on which maintenance was performed. Greater than 1200 unique labels exist that can be used to describe a rotorcraft component that is the subject of a maintenance action. Furthermore, the component labels are hierarchically structured, resulting in the occurrence of multiple levels of precision in identifying a component in the expert-labeled data used for training. Although computational efficiency of common classification algorithms has improved considerably, it is still quite challenging to harness these methods for problems that include large numbers of unique class labels. This paper describes several novel strategies for solving this problem, based on hierarchical ensemble models and strategic label set segmentation. Through these approaches, a best overall total component classification accuracy of 96% was achieved, in conjunction with a total per record accuracy for three different label categories of 93%. The approaches implemented to handle the large label set for classification of rotorcraft components, along with classification performance measures, are discussed.
AbstractList The US Army Aviation and Missile Research, Development, and Engineering Center (AMRDEC), in collaboration with the US Army Engineer Research and Development Center (ERDC), is using machine learning (ML) to transform the way rotorcraft maintenance logbook event data is scored for reporting purposes. Traditionally, human analysts manually inspect data fields completed by maintenance personnel and, using published guidelines in conjunction with their personal expertise, provide sets of labels or scores for each event. These labels are stored with the data and provide valuable insight into maintenance event histories. However, the inequity between the enormous volume of maintenance data generated daily and the ability of analysts to score the data results in only 10% of all data receiving scores; therefore, 90% of the recorded data does not contain this important value added feature. Classification algorithms for automating this scoring process trained on existing labeled data sets have been implemented with promising results. A particularly challenging element of this problem, however, involves the classification of the specific component on which maintenance was performed. Greater than 1200 unique labels exist that can be used to describe a rotorcraft component that is the subject of a maintenance action. Furthermore, the component labels are hierarchically structured, resulting in the occurrence of multiple levels of precision in identifying a component in the expert-labeled data used for training. Although computational efficiency of common classification algorithms has improved considerably, it is still quite challenging to harness these methods for problems that include large numbers of unique class labels. This paper describes several novel strategies for solving this problem, based on hierarchical ensemble models and strategic label set segmentation. Through these approaches, a best overall total component classification accuracy of 96% was achieved, in conjunction with a total per record accuracy for three different label categories of 93%. The approaches implemented to handle the large label set for classification of rotorcraft components, along with classification performance measures, are discussed.
Author Eslinger, Owen
Hines, Amanda
Vega-Maisonet, Luis
Nabholz, Grace
Ruvinsky, Alicia
Seale, Maria
Rigoni, Nathan
Author_xml – sequence: 1
  givenname: Maria
  surname: Seale
  fullname: Seale, Maria
  organization: US Army Engineer Research and Development Center, 3909 Halls Ferry Road, Vicksburg, MS, 39180
– sequence: 2
  givenname: Amanda
  surname: Hines
  fullname: Hines, Amanda
  organization: US Army Engineer Research and Development Center, 3909 Halls Ferry Road, Vicksburg, MS, 39180
– sequence: 3
  givenname: Grace
  surname: Nabholz
  fullname: Nabholz, Grace
  organization: US Army Engineer Research and Development Center, 3909 Halls Ferry Road, Vicksburg, MS, 39180
– sequence: 4
  givenname: Alicia
  surname: Ruvinsky
  fullname: Ruvinsky, Alicia
  organization: US Army Engineer Research and Development Center, 3909 Halls Ferry Road, Vicksburg, MS, 39180
– sequence: 5
  givenname: Owen
  surname: Eslinger
  fullname: Eslinger, Owen
  organization: US Army Engineer Research and Development Center, 3909 Halls Ferry Road, Vicksburg, MS, 39180
– sequence: 6
  givenname: Nathan
  surname: Rigoni
  fullname: Rigoni, Nathan
  organization: Aviation and Missile Research Development, and Engineering Center
– sequence: 7
  givenname: Luis
  surname: Vega-Maisonet
  fullname: Vega-Maisonet, Luis
  organization: University of Puerto Rico at Mayagüez, PR-108, Mayagüez, 00682, Puerto Rico
BookMark eNotj89Kw0AYxFfQg60-gHjZF0jcL_s3x1CqFiKFas9ls36bLqS7ZRMQ395Iexr4DTPMLMhtTBEJeQJWArD6pVnvtmXFoC6NFhWr9A1ZgORGKSOFuSe2OZ9zsu6II_Up0_0YYk8_ZhAi0hZtjv-gGfqUw3Q8jfRnFtra3M-27XCgnzhdsrs0peyy9dNcEOKE0UaHD-TO22HEx6suyf51_bV6L9rt22bVtEUALadCMOfRfTtdG-NQgJKs4iBcpeed0igAryRIxTXUHLwRYLtOGmF5xQR0li_J86U3IOLhnMPJ5t_D9TX_A1MIUIc
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1109/AERO.2019.8742027
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume
IEEE Xplore All Conference Proceedings
IEEE Electronic Library Online
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library Online
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
EISBN 1538668548
9781538668542
EndPage 8
ExternalDocumentID 8742027
Genre orig-research
GroupedDBID 6IE
6IL
CBEJK
RIE
RIL
ID FETCH-LOGICAL-i175t-40cfecdc7988ce416502314c2754858611f65156371931f841abb584a32041ba3
IEDL.DBID RIE
IngestDate Thu Jun 29 18:39:32 EDT 2023
IsPeerReviewed false
IsScholarly true
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i175t-40cfecdc7988ce416502314c2754858611f65156371931f841abb584a32041ba3
PageCount 8
ParticipantIDs ieee_primary_8742027
PublicationCentury 2000
PublicationDate 2019-March
PublicationDateYYYYMMDD 2019-03-01
PublicationDate_xml – month: 03
  year: 2019
  text: 2019-March
PublicationDecade 2010
PublicationTitle 2019 IEEE Aerospace Conference
PublicationTitleAbbrev AERO
PublicationYear 2019
Publisher IEEE
Publisher_xml – name: IEEE
Score 2.1339226
Snippet The US Army Aviation and Missile Research, Development, and Engineering Center (AMRDEC), in collaboration with the US Army Engineer Research and Development...
SourceID ieee
SourceType Publisher
StartPage 1
SubjectTerms Aircraft
Classification algorithms
Machine learning
Machine learning algorithms
Maintenance engineering
Prediction algorithms
Reliability
Title Approaches for Using Machine Learning Algorithms with Large Label Sets for Rotorcraft Maintenance
URI https://ieeexplore.ieee.org/document/8742027
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1NT8JAEN0AJ09qwPidPXi00KXttj0SAyFG1KAk3MjOdhaJSA2Ui7_e2W3FaDx4aZqmX5k5zHu7b94wdqUh1QkY7Yk4TomgRL6XKB887YNKIINUOG3O6F4OJ-HtNJrW2PWuFwYRnfgM2_bU7eVnud7apbJOQjyOaFSd1eNUlr1a1Ual8NNOrz9-sFotSn5534-BKa5eDPbZ6OtLpUzktb0toK0_fpkw_vdXDljruzOPP-5qziGr4arJVK8yBscNJwzKnQyAj5xMEnnloDrnveU8Xy-Kl7cNt6uv_M6KwOkIuORPWJTPjnMi4XqtTEEvsF4S1pADW2wy6D_fDL1qdIK3IDxQUNC1QZ1p60amkUBXZH3eQt2NiaFEiRTC2BnoMogJwAmThEIBEBZRQdcPBajgiDVW-QqPGZeZQAUGJRL1ENiFLJUgURsRUC0z8oQ1bXhm76U7xqyKzOnfl8_Ynk1RqeI6Z41ivcULKusFXLp8fgLgUaUV
link.rule.ids 309,310,780,784,789,790,796,27925,54758
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1NT8JAEN0gHvSkBozf7sGjhS5tt-2RGAgqRYOQcCO721klIjVQLv56Z7cVo_HgpWmafmXmMO_tvnlDyJWSsYqkVg4LwxgJSuA6kXClo1wpIpnKmFltTjLgvbF_NwkmFXK96YUBACs-g4Y5tXv5aabWZqmsGSGPQxq1RbYDH3Fu0a1VblUyN262O8MHo9bC9Bd3_hiZYitGd48kX98qhCKvjXUuG-rjlw3jf39mn9S_e_Po46bqHJAKLGpEtEtrcFhRRKHUCgFoYoWSQEsP1Wfanj9ny1n-8raiZv2V9o0MHI8S5vQJ8uLZYYY0XC2FzvEFxk3CWHJAnYy7ndFNzymHJzgzRAQ5hl1pUKkyfmQKEHYFxunNV60QOUoQcca0mYLOvRAhHNORz4SUiEaE13J9JoV3SKqLbAFHhPKUgZAaOCD5YNCSacwlB6WZh9VM82NSM-GZvhf-GNMyMid_X74kO71R0p_2bwf3p2TXpKvQdJ2Rar5cwzkW-Vxe2Nx-Ar7hqGg
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2019+IEEE+Aerospace+Conference&rft.atitle=Approaches+for+Using+Machine+Learning+Algorithms+with+Large+Label+Sets+for+Rotorcraft+Maintenance&rft.au=Seale%2C+Maria&rft.au=Hines%2C+Amanda&rft.au=Nabholz%2C+Grace&rft.au=Ruvinsky%2C+Alicia&rft.date=2019-03-01&rft.pub=IEEE&rft.spage=1&rft.epage=8&rft_id=info:doi/10.1109%2FAERO.2019.8742027&rft.externalDocID=8742027