Empirical Evaluation of Diagnostic Algorithm Performance Using a Generic Framework
A variety of rule-based, model-based and datadriven techniques have been proposed for detection and isolation of faults in physical systems. However, there have been few efforts to comparatively analyze the performance of these approaches on the same system under identical conditions. One reason for...
Saved in:
Published in | International journal of prognostics and health management Vol. 1; no. 1 |
---|---|
Main Authors | , , , , , , , |
Format | Journal Article |
Language | English |
Published |
22.03.2021
|
Online Access | Get full text |
Cover
Loading…
Abstract | A variety of rule-based, model-based and datadriven techniques have been proposed for detection and isolation of faults in physical systems. However, there have been few efforts to comparatively analyze the performance of these approaches on the same system under identical conditions. One reason for this was the lack of a standard framework to perform this comparison. In this paper we introduce a framework, called DXF, that provides a common language to represent the system description, sensor data and the fault diagnosis results; a run-time architecture to execute the diagnosis algorithms under identical conditions and collect the diagnosis results; and an evaluation component that can compute performance metrics from the diagnosis results to compare the algorithms. We have used DXF to perform an empirical evaluation of 13 diagnostic algorithms on a hardware testbed (ADAPT) at NASA Ames Research Center and on a set of synthetic circuits typically used as benchmarks in the model-based diagnosis community. Based on these empirical data we analyze the performance of each algorithm and suggest directions for future development. |
---|---|
AbstractList | A variety of rule-based, model-based and datadriven techniques have been proposed for detection and isolation of faults in physical systems. However, there have been few efforts to comparatively analyze the performance of these approaches on the same system under identical conditions. One reason for this was the lack of a standard framework to perform this comparison. In this paper we introduce a framework, called DXF, that provides a common language to represent the system description, sensor data and the fault diagnosis results; a run-time architecture to execute the diagnosis algorithms under identical conditions and collect the diagnosis results; and an evaluation component that can compute performance metrics from the diagnosis results to compare the algorithms. We have used DXF to perform an empirical evaluation of 13 diagnostic algorithms on a hardware testbed (ADAPT) at NASA Ames Research Center and on a set of synthetic circuits typically used as benchmarks in the model-based diagnosis community. Based on these empirical data we analyze the performance of each algorithm and suggest directions for future development. |
Author | Van Gemund, Arjan Kuhn, Lukas Kurtoglu, Tolga Poll, Scott De Kleer, Johan Narasimhan, Sriram Garcia, David Feldman, Alexander |
Author_xml | – sequence: 1 givenname: Alexander surname: Feldman fullname: Feldman, Alexander – sequence: 2 givenname: Tolga surname: Kurtoglu fullname: Kurtoglu, Tolga – sequence: 3 givenname: Sriram surname: Narasimhan fullname: Narasimhan, Sriram – sequence: 4 givenname: Scott surname: Poll fullname: Poll, Scott – sequence: 5 givenname: David surname: Garcia fullname: Garcia, David – sequence: 6 givenname: Johan surname: De Kleer fullname: De Kleer, Johan – sequence: 7 givenname: Lukas surname: Kuhn fullname: Kuhn, Lukas – sequence: 8 givenname: Arjan surname: Van Gemund fullname: Van Gemund, Arjan |
BookMark | eNqdz8FqwkAQBuClWDC2PoIwL5B0N4lpeywa61FKe16GsIljs7thNiq-vYn00LNz-YeB-eGbiYnzzgixUDLJCinVCx26vU1SORxOilSisjx_EFGqllmcFvnb5N8-FfMQDnKY4j1PX1UkvkrbEVOFLZQnbI_Yk3fga1gTNs6Hnir4aBvP1O8t7AzXni26ysBPINcAwqdxZiiADaM1Z8-_z-KxxjaY-V8-ieWm_F5t44p9CGxq3TFZ5ItWUt8M-mbQo0GPBj0asnv_rjcGVeE |
ContentType | Journal Article |
DBID | AAYXX CITATION |
DOI | 10.36001/ijphm.2010.v1i1.1344 |
DatabaseName | CrossRef |
DatabaseTitle | CrossRef |
DatabaseTitleList | CrossRef |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Engineering |
EISSN | 2153-2648 |
ExternalDocumentID | 10_36001_ijphm_2010_v1i1_1344 |
GroupedDBID | 5VS AAYXX ADBBV ALMA_UNASSIGNED_HOLDINGS BCNDV CITATION GROUPED_DOAJ KQ8 M~E OK1 |
ID | FETCH-crossref_primary_10_36001_ijphm_2010_v1i1_13443 |
ISSN | 2153-2648 |
IngestDate | Fri Aug 23 02:10:43 EDT 2024 |
IsPeerReviewed | true |
IsScholarly | true |
Issue | 1 |
Language | English |
LinkModel | OpenURL |
MergedId | FETCHMERGED-crossref_primary_10_36001_ijphm_2010_v1i1_13443 |
ParticipantIDs | crossref_primary_10_36001_ijphm_2010_v1i1_1344 |
PublicationCentury | 2000 |
PublicationDate | 2021-03-22 |
PublicationDateYYYYMMDD | 2021-03-22 |
PublicationDate_xml | – month: 03 year: 2021 text: 2021-03-22 day: 22 |
PublicationDecade | 2020 |
PublicationTitle | International journal of prognostics and health management |
PublicationYear | 2021 |
SSID | ssj0000694271 |
Score | 4.448877 |
Snippet | A variety of rule-based, model-based and datadriven techniques have been proposed for detection and isolation of faults in physical systems. However, there... |
SourceID | crossref |
SourceType | Aggregation Database |
Title | Empirical Evaluation of Diagnostic Algorithm Performance Using a Generic Framework |
Volume | 1 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1LT8JAEN4gXvRgfMZ39uC1aF-UHolCiIkcFBNvzbbdQk1LSQUP_hJ_rrM7ZVkIMeKlaTbtZNP5sjsz-81XQm5YGLa4FyZGy0lcw4k8ZjCfe0bEXct3TJ_fWaI5-anf7L06j2_uW632rbGWZtOwEX2t7Sv5j1dhDPwqumQ38KwyCgNwD_6FK3gYrn_ycSefpCjx0VGi3SL6e0D-nNBibWfDAvL_US647qpFAIkCDEWn4anunKKlx6rLxUJNYkJwutA8CjxjL2VFhNWZNF2exVWFVTXSaGdH02KYzSRgimyotoc-K9lHmo-qymyZlixXC3iBpyQvQlFCL1hYkrFlaTVMCDJsSazDLWjN2HxhXsXf6nJvN_E_A-n7ZJQjTe_TTM2GaaOm5LK89sq2p8iIkAZJQ4E0EwgzgTATCDNbZNvyfNfVknXc433Hktm8mjm2h0lLt-smpAU-WgQz2Cd7VepB24ijA1Lj40OyqwlSHpFnhSi6QBQtErpAFFWIohqiqEQUZbRCFFWIOiZutzO47xnzaQUTFDgJfv0i9gmpj4sxPyXUiyG8jVoxJMHMgZU8tOMEHk5aYWTG3OdnpLGZ7fNNX7ggOwuIXZL6tJzxK4gSp-G1dNgP1DhwrA |
link.rule.ids | 315,786,790,870,27955,27956 |
linkProvider | Directory of Open Access Journals |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Empirical+Evaluation+of+Diagnostic+Algorithm+Performance+Using+a+Generic+Framework&rft.jtitle=International+journal+of+prognostics+and+health+management&rft.au=Feldman%2C+Alexander&rft.au=Kurtoglu%2C+Tolga&rft.au=Narasimhan%2C+Sriram&rft.au=Poll%2C+Scott&rft.date=2021-03-22&rft.issn=2153-2648&rft.eissn=2153-2648&rft.volume=1&rft.issue=1&rft_id=info:doi/10.36001%2Fijphm.2010.v1i1.1344&rft.externalDBID=n%2Fa&rft.externalDocID=10_36001_ijphm_2010_v1i1_1344 |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2153-2648&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2153-2648&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2153-2648&client=summon |