Towards Comparability in Non-Intrusive Load Monitoring: On Data and Performance Evaluation
Non-Intrusive Load Monitoring (NILM) comprises of a set of techniques that provide insights into the energy consumption of households and industrial facilities. Latest contributions show significant improvements in terms of accuracy and generalisation abilities. Despite all progress made concerning...
Saved in:
Published in | 2020 IEEE Power & Energy Society Innovative Smart Grid Technologies Conference (ISGT) pp. 1 - 5 |
---|---|
Main Authors | , , |
Format | Conference Proceeding |
Language | English |
Published |
IEEE
01.02.2020
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | Non-Intrusive Load Monitoring (NILM) comprises of a set of techniques that provide insights into the energy consumption of households and industrial facilities. Latest contributions show significant improvements in terms of accuracy and generalisation abilities. Despite all progress made concerning disaggregation techniques, performance evaluation and comparability remains an open research question. The lack of standardisation and consensus on evaluation procedures makes reproducibility and comparability extremely difficult. In this paper, we draw attention to comparability in NILM with a focus on highlighting the considerable differences amongst common energy datasets used to test the performance of algorithms. We divide discussion on comparability into data aspects, performance metrics, and give a close view on evaluation processes. Detailed information on pre-processing as well as data cleaning methods, the importance of unified performance reporting, and the need for complexity measures in load disaggregation are found to be the most urgent issues in NILM-related research. In addition, our evaluation suggests that datasets should be chosen carefully. We conclude by formulating suggestions for future work to enhance comparability. |
---|---|
AbstractList | Non-Intrusive Load Monitoring (NILM) comprises of a set of techniques that provide insights into the energy consumption of households and industrial facilities. Latest contributions show significant improvements in terms of accuracy and generalisation abilities. Despite all progress made concerning disaggregation techniques, performance evaluation and comparability remains an open research question. The lack of standardisation and consensus on evaluation procedures makes reproducibility and comparability extremely difficult. In this paper, we draw attention to comparability in NILM with a focus on highlighting the considerable differences amongst common energy datasets used to test the performance of algorithms. We divide discussion on comparability into data aspects, performance metrics, and give a close view on evaluation processes. Detailed information on pre-processing as well as data cleaning methods, the importance of unified performance reporting, and the need for complexity measures in load disaggregation are found to be the most urgent issues in NILM-related research. In addition, our evaluation suggests that datasets should be chosen carefully. We conclude by formulating suggestions for future work to enhance comparability. |
Author | Makonin, Stephen Elmenreich, Wilfried Klemenjak, Christoph |
Author_xml | – sequence: 1 givenname: Christoph surname: Klemenjak fullname: Klemenjak, Christoph organization: University of Klagenfurt,Klagenfurt,Austria – sequence: 2 givenname: Stephen surname: Makonin fullname: Makonin, Stephen organization: Simon Fraser University,Burnaby,Canada – sequence: 3 givenname: Wilfried surname: Elmenreich fullname: Elmenreich, Wilfried organization: University of Klagenfurt,Klagenfurt,Austria |
BookMark | eNot0MFOAjEUQNFqNFGQLzAx_YHB13amnefOICIJiom4cUPeTFtTAy3pDBj-3oWs7u4s7oBdxBQdY3cCxkIA3s8_ZquyEohjCRLGCLUxoM_YQBhZCyVAwTm7lqWRRS0qecVGXfcDAEILrTRes69V-qVsOz5J2x1lasIm9EceIn9LsZjHPu-7cHB8kcjy1xRDn3KI3w98GfkT9cQpWv7usk95S7F1fHqgzZ76kOINu_S06dzo1CH7fJ6uJi_FYjmbTx4XRSsr3RcGGws1eGo0GCg1SquVBUtaihotaEQyXpXaaVU16Fsk9KSsbXVJsvJqyG7_3eCcW-9y2FI-rk8r1B8xpVWk |
CitedBy_id | crossref_primary_10_1109_TCE_2023_3237862 crossref_primary_10_1016_j_enbuild_2020_110222 crossref_primary_10_1007_s10994_021_06106_3 crossref_primary_10_1016_j_enbuild_2022_111951 crossref_primary_10_1007_s10586_022_03573_8 crossref_primary_10_1186_s42162_021_00137_9 crossref_primary_10_1007_s00521_020_04916_5 crossref_primary_10_1016_j_ijepes_2021_106834 crossref_primary_10_1016_j_enbuild_2021_111618 crossref_primary_10_1016_j_enbuild_2024_113890 crossref_primary_10_1080_15567036_2022_2046663 crossref_primary_10_3390_s23187936 crossref_primary_10_3390_inventions9010002 crossref_primary_10_3390_w13010036 crossref_primary_10_1109_TIM_2022_3232169 crossref_primary_10_3390_technologies10040085 crossref_primary_10_3390_su14084639 crossref_primary_10_3390_s23042051 crossref_primary_10_3390_en13164154 crossref_primary_10_1109_TII_2022_3206322 crossref_primary_10_1038_s41597_020_0434_6 crossref_primary_10_1109_TSG_2022_3189598 crossref_primary_10_1109_TIM_2023_3311066 crossref_primary_10_1109_TSG_2020_3010621 crossref_primary_10_3390_en16135115 |
ContentType | Conference Proceeding |
DBID | 6IE 6IL CBEJK RIE RIL |
DOI | 10.1109/ISGT45199.2020.9087706 |
DatabaseName | IEEE Electronic Library (IEL) Conference Proceedings IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume IEEE Xplore All Conference Proceedings IEEE/IET Electronic Library IEEE Proceedings Order Plans (POP All) 1998-Present |
DatabaseTitleList | |
Database_xml | – sequence: 1 dbid: RIE name: IEEE/IET Electronic Library url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/ sourceTypes: Publisher |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Engineering |
EISBN | 1728131030 9781728131030 |
EISSN | 2472-8152 |
EndPage | 5 |
ExternalDocumentID | 9087706 |
Genre | orig-research |
GroupedDBID | 6IE 6IF 6IK 6IL 6IN AAJGR ABLEC ADZIZ ALMA_UNASSIGNED_HOLDINGS BEFXN BFFAM BGNUA BKEBE BPEOZ CBEJK CHZPO IEGSK IPLJI OCL RIE RIL RNS |
ID | FETCH-LOGICAL-c256t-79bd080fab60704692d63d0da62189d0699a7f346e635b9fc9a9fa3ddc64a25f3 |
IEDL.DBID | RIE |
IngestDate | Wed Jun 26 19:26:54 EDT 2024 |
IsPeerReviewed | false |
IsScholarly | false |
Language | English |
LinkModel | DirectLink |
MergedId | FETCHMERGED-LOGICAL-c256t-79bd080fab60704692d63d0da62189d0699a7f346e635b9fc9a9fa3ddc64a25f3 |
PageCount | 5 |
ParticipantIDs | ieee_primary_9087706 |
PublicationCentury | 2000 |
PublicationDate | 2020-Feb. |
PublicationDateYYYYMMDD | 2020-02-01 |
PublicationDate_xml | – month: 02 year: 2020 text: 2020-Feb. |
PublicationDecade | 2020 |
PublicationTitle | 2020 IEEE Power & Energy Society Innovative Smart Grid Technologies Conference (ISGT) |
PublicationTitleAbbrev | ISGT |
PublicationYear | 2020 |
Publisher | IEEE |
Publisher_xml | – name: IEEE |
SSID | ssj0001616369 |
Score | 1.9934576 |
Snippet | Non-Intrusive Load Monitoring (NILM) comprises of a set of techniques that provide insights into the energy consumption of households and industrial... |
SourceID | ieee |
SourceType | Publisher |
StartPage | 1 |
SubjectTerms | comparability data engineering load disaggregation NILM performance evaluation |
Title | Towards Comparability in Non-Intrusive Load Monitoring: On Data and Performance Evaluation |
URI | https://ieeexplore.ieee.org/document/9087706 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV07T8MwED6VTrDwaBFveWDEqZuHE7OWlhbRUolWqlgqvyIhJAeJdIBfj-2EFhADmxXplNhn5-7s7_sMcKnczNW2UtVMZDjuqhCLbqJxpqwBzUQsPZF2PKHDeXy3SBYNuFpzYbTWHnymA9f0Z_mqkCu3VdZhTr3O6WtvZSSsuFqb_RRqMwvKahJwl7DO6PF25sRTHB0lJEFt_OMWFR9EBrsw_np9hR15CValCOTHL2XG_37fHrQ3dD00XQeifWhocwA735QGW_A08_DYN9Sr1L49JPYdPRs0KQweGUe9sP89dF9whap17gyv0YNBN7zkiBuFphuSAeqvVcLbMB_0Z70hrq9VwNLmNyVOmbAeIjkX1K53Wx6HikaKKE5tuGeKUMZ4mkcx1TYZESyXjLOcR0pJGvMwyaNDaJrC6CNAYUpzJWSUuzoz0omQgggnocWVtokcP4aWG6Xla6WcsawH6OTvx6ew7TxVYaLPoGm7rs9tyC_Fhff1J4P2rIM |
link.rule.ids | 310,311,786,790,795,796,802,23958,23959,25170,27956,55107 |
linkProvider | IEEE |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LSwMxEB5KPagXH634NgePZrvdR7bxWltbbWvBLRQvJa8FEbKC24P-epPs2qp48LYEBsLMJjOTfN8XgEtp_1xlOlVFeQdHbRlg3o4V7khjQDo8Eo5IO56QwSy6m8fzGlytuDBKKQc-U579dHf5MhdLe1TWola9zuprb5g87yclW2t9okJMbUFoRQNu-7Q1fLxNrXyKJaQEvleZ_3hHxaWR_g6MvyZQokdevGXBPfHxS5vxvzPcheaasIemq1S0BzWl92H7m9ZgA55SB5B9Q91S79uBYt_Rs0aTXOOhtuQLs_OhUc4kKle6NbxGDxrdsIIhpiWarmkGqLfSCW_CrN9LuwNcPayAhalwCpxQbmLkZ4wTs-JNgxxIEkpfMmISPpU-oZQlWRgRZcoRTjNBGc1YKKUgEQviLDyAus61OgQUJCSTXISZ7TRDFXPBfW5FtJhUppRjR9CwXlq8ltoZi8pBx38PX8DmIB2PFqPh5P4EtmzUSoT0KdSNG9SZKQAKfu7i_gnJTK_X |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=proceeding&rft.title=2020+IEEE+Power+%26+Energy+Society+Innovative+Smart+Grid+Technologies+Conference+%28ISGT%29&rft.atitle=Towards+Comparability+in+Non-Intrusive+Load+Monitoring%3A+On+Data+and+Performance+Evaluation&rft.au=Klemenjak%2C+Christoph&rft.au=Makonin%2C+Stephen&rft.au=Elmenreich%2C+Wilfried&rft.date=2020-02-01&rft.pub=IEEE&rft.eissn=2472-8152&rft.spage=1&rft.epage=5&rft_id=info:doi/10.1109%2FISGT45199.2020.9087706&rft.externalDocID=9087706 |