Model-Based Diagnosis of Real-Time Systems: Robustness Against Varying Latency, Clock Drift, and Out-of-Order Observations

Online fault diagnosis techniques are a key enabler of effective failure mitigation. For real-time systems, the problem of identifying faults is aggravated by timing imprecisions such as varying latency between events and their observation. This paper tackles the challenge of diagnosing faults based...

Full description

Saved in:
Bibliographic Details
Published inACM transactions on embedded computing systems Vol. 22; no. 4; pp. 1 - 48
Main Authors Köhl, Maximilian A., Hermanns, Holger
Format Journal Article
LanguageEnglish
Published New York, NY ACM 26.07.2023
Subjects
Online AccessGet full text

Cover

Loading…
Abstract Online fault diagnosis techniques are a key enabler of effective failure mitigation. For real-time systems, the problem of identifying faults is aggravated by timing imprecisions such as varying latency between events and their observation. This paper tackles the challenge of diagnosing faults based on partial observations which are subject to timing imprecisions and potentially made out-of-order due to latency. In this paper, we develop a theory of robust real-time diagnosis importing well-established notions from timed automata theory and the diagnosis of discrete event systems. The theory itself enables a foundational understanding and investigation of the problem and its intricacies. Based on this theory, we further devise an online diagnosis algorithm consuming observations incrementally as they are made and enabling diagnosis, whenever possible, within a bounded worst-case delay. We prove the correctness of the algorithm and its properties with respect to the theory. Aiming at practical feasibility, we also show how to obtain sound but not necessarily complete diagnosis results with space and time requirements bounded by the size of the system model and independent of the number of observations. Finally, using a prototypical implementation, we report on first empirical results obtained by simulation of a small excerpt of an industrial automation example.
AbstractList Online fault diagnosis techniques are a key enabler of effective failure mitigation. For real-time systems, the problem of identifying faults is aggravated by timing imprecisions such as varying latency between events and their observation. This paper tackles the challenge of diagnosing faults based on partial observations which are subject to timing imprecisions and potentially made out-of-order due to latency. In this paper, we develop a theory of robust real-time diagnosis importing well-established notions from timed automata theory and the diagnosis of discrete event systems. The theory itself enables a foundational understanding and investigation of the problem and its intricacies. Based on this theory, we further devise an online diagnosis algorithm consuming observations incrementally as they are made and enabling diagnosis, whenever possible, within a bounded worst-case delay. We prove the correctness of the algorithm and its properties with respect to the theory. Aiming at practical feasibility, we also show how to obtain sound but not necessarily complete diagnosis results with space and time requirements bounded by the size of the system model and independent of the number of observations. Finally, using a prototypical implementation, we report on first empirical results obtained by simulation of a small excerpt of an industrial automation example.
ArticleNumber 68
Author Hermanns, Holger
Köhl, Maximilian A.
Author_xml – sequence: 1
  givenname: Maximilian A.
  orcidid: 0000-0003-2551-2814
  surname: Köhl
  fullname: Köhl, Maximilian A.
  email: koehl@cs.uni-saarland.de
  organization: Saarland University, Germany
– sequence: 2
  givenname: Holger
  orcidid: 0000-0002-2766-9615
  surname: Hermanns
  fullname: Hermanns, Holger
  email: hermanns@cs.uni-saarland.de
  organization: Saarland University, Germany
BookMark eNptkM1LAzEUxINUsK3i3VNuXhpNdpP98FZbv6CyUKvXks2-lOg2kSQV6l9va6sHcS5v4P0YhumhjnUWEDpl9IIxLi5TUeYJLQ9QlwlRkJRnorP1aUlKWuRHqBfCK6UsT7joos9H10BLrmWABo-NXFgXTMBO4ynIlszMEvDTOkRYhis8dfUqRAsh4OFCGhsifpF-bewCT2QEq9YDPGqdesNjb3QcYGkbXK0icZpUvgGPqzqA_5DROBuO0aGWbYCT_e2j59ub2eieTKq7h9FwQmSS55E0HDjIXAtNC1AcWKaogDovKKvzVGYNZ4pnhW4SpusiyVJel1slGVOyFHXaR-e7XOVdCB70_N2b5ab3nNH5drL5frINSf6QysTvstFL0_7Dn-14qZa_oT_PL1sSd28
CitedBy_id crossref_primary_10_1007_s11704_024_40894_w
Cites_doi 10.1016/j.automatica.2012.09.017
10.1109/WODES.2006.1678446
10.5281/zenodo.7896268
10.1109/REAL.2002.1181581
10.1007/3-540-52148-8_17
10.1109/LICS.1992.185551
10.1109/EMRTS.2000.854002
10.1109/ACC.2008.4586649
10.1016/j.promfg.2020.04.106
10.1007/978-3-540-27755-2_3
10.1007/978-3-662-54580-5_9
10.1016/0304-3975(94)00202-T
10.1109/REAL.1997.641265
10.1109/JPROC.2005.849720
10.1007/s11241-007-9040-3
10.1109/87.486338
10.1016/0967-0661(95)00112-8
10.1007/978-3-030-72013-1_23
10.1145/1879021.1879053
10.1007/3-540-45739-9_14
10.1007/978-3-540-31982-5_14
10.1007/978-0-387-09680-3_36
10.1007/s10703-008-0056-7
10.1007/978-1-4614-0314-2
10.1007/BFb0055349
10.1109/9.412626
10.1007/11603009_10
10.1016/0304-3975(94)90010-8
10.1109/RTAS.2010.24
10.1016/S1474-6670(17)36467-4
ContentType Journal Article
Copyright Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the owner/author(s).
Copyright_xml – notice: Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the owner/author(s).
DBID AAYXX
CITATION
DOI 10.1145/3597209
DatabaseName CrossRef
DatabaseTitle CrossRef
DatabaseTitleList CrossRef

DeliveryMethod fulltext_linktorsrc
Discipline Engineering
DocumentTitleAlternate Robust Model-Based Diagnosis of Real-Time Systems
EISSN 1558-3465
EndPage 48
ExternalDocumentID 10_1145_3597209
3597209
GrantInformation_xml – fundername: VolkswagenStiftung
  grantid: AZ 98514
– fundername: DFG
  grantid: 389792660
GroupedDBID -DZ
-~X
.4S
.DC
23M
4.4
5GY
5VS
6J9
8US
AAKMM
AALFJ
AAYFX
ABPPZ
ACGFO
ACM
ADBCU
ADL
ADMLS
ADPZR
AEBYY
AEGXH
AENEX
AENSD
AFWIH
AFWXC
AIAGR
AIKLT
ALMA_UNASSIGNED_HOLDINGS
ARCSS
ASPBG
AVWKF
BDXCO
CCLIF
CS3
D0L
EBS
EDO
FEDTE
GUFHI
HGAVV
H~9
I07
LHSKQ
P1C
P2P
PQQKQ
RNS
ROL
TUS
UPT
W7O
ZCA
AAYXX
AEFXT
AEJOY
AKRVB
CITATION
ID FETCH-LOGICAL-a277t-d4e4ea7f5f08ec4e16c05eb7801b73a6d41c468fd21fb82634b99999261ca95b3
ISSN 1539-9087
IngestDate Thu Jul 03 08:18:31 EDT 2025
Thu Apr 24 23:13:05 EDT 2025
Fri Feb 21 01:12:44 EST 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 4
Keywords timed automata
Online fault diagnosis
embedded real-time systems
Language English
LinkModel OpenURL
MergedId FETCHMERGED-LOGICAL-a277t-d4e4ea7f5f08ec4e16c05eb7801b73a6d41c468fd21fb82634b99999261ca95b3
ORCID 0000-0003-2551-2814
0000-0002-2766-9615
OpenAccessLink https://dl.acm.org/doi/10.1145/3597209
PageCount 48
ParticipantIDs crossref_primary_10_1145_3597209
crossref_citationtrail_10_1145_3597209
acm_primary_3597209
PublicationCentury 2000
PublicationDate 2023-07-26
PublicationDateYYYYMMDD 2023-07-26
PublicationDate_xml – month: 07
  year: 2023
  text: 2023-07-26
  day: 26
PublicationDecade 2020
PublicationPlace New York, NY
PublicationPlace_xml – name: New York, NY
PublicationTitle ACM transactions on embedded computing systems
PublicationTitleAbbrev ACM TECS
PublicationYear 2023
Publisher ACM
Publisher_xml – name: ACM
References (Bib0021) 1997
(Bib0025) 1995; 40
(Bib0003) 2006
(Bib0028) 2008
(Bib0012) 2003; 36
(Bib0015) 1989; 407
(Bib0019) 2023
(Bib0024) 1998
(Bib0001) 1995; 138
(Bib0018) 2000
(Bib0029) 2008
(Bib0031) 2002
(Bib0027) 2010
(Bib0009) 2017; 10206
(Bib0023) 2008; 39
(Bib0026) 1996; 4
(Bib0006) 2005
(Bib0011) 2009
(Bib0017) 1992
(Bib0007) 2002
(Bib0010) 2013; 49
(Bib0016) 2005; 93
(Bib0013) 2008; 33
(Bib0020) 2021
(Bib0014) 2012
(Bib0030) 1995; 3
(Bib0004) 2004
(Bib0005) 2005
(Bib0002) 1994; 126
(Bib0008) 2010
(Bib0022) 2020; 45
Cassandras Christos G. (e_1_3_3_12_2) 2009
Tripakis Stavros (e_1_3_3_32_2) 2002
e_1_3_3_17_2
Bouyer Patricia (e_1_3_3_6_2) 2005
e_1_3_3_16_2
e_1_3_3_19_2
e_1_3_3_18_2
e_1_3_3_13_2
e_1_3_3_15_2
e_1_3_3_14_2
Köhl Maximilian A. (e_1_3_3_21_2) 2021
e_1_3_3_11_2
e_1_3_3_30_2
e_1_3_3_10_2
e_1_3_3_31_2
e_1_3_3_5_2
e_1_3_3_8_2
e_1_3_3_7_2
e_1_3_3_28_2
e_1_3_3_9_2
e_1_3_3_27_2
e_1_3_3_29_2
e_1_3_3_24_2
e_1_3_3_23_2
e_1_3_3_26_2
e_1_3_3_25_2
e_1_3_3_2_2
e_1_3_3_20_2
e_1_3_3_4_2
e_1_3_3_22_2
e_1_3_3_3_2
References_xml – volume: 49
  start-page: 223
  issue: 1
  year: 2013
  end-page: 231
  ident: Bib0010
  article-title: Robust diagnosis of discrete-event systems against permanent loss of observations
  publication-title: Automatica
  doi: 10.1016/j.automatica.2012.09.017
– volume: 93
  start-page: 1118
  issue: 6
  year: 2005
  end-page: 1129
  ident: Bib0016
  article-title: Real-time ethernet-industry prospective
  publication-title: Proc. IEEE
– start-page: 210
  year: 1998
  end-page: 227
  ident: Bib0024
  article-title: Dynamical properties of timed automata
  publication-title: Formal Techniques in Real-Time and Fault-Tolerant Systems
– start-page: 301
  year: 2006
  end-page: 306
  ident: Bib0003
  article-title: Probabilistic failure diagnosis in finite state machines under unreliable observations
  publication-title: 2006 8th International Workshop on Discrete Event Systems
  doi: 10.1109/WODES.2006.1678446
– year: 2023
  ident: Bib0019
  publication-title: Artifact: Robust Model-Based Diagnosis of Real-Time Systems
  doi: 10.5281/zenodo.7896268
– volume: 3
  start-page: 1163
  issue: 8
  year: 1995
  end-page: 1169
  ident: Bib0030
  article-title: Calculating controller area network (CAN) message response times
  publication-title: Control Engineering Practice
– start-page: 269
  year: 2002
  end-page: 278
  ident: Bib0007
  article-title: Probabilistic analysis of CAN with faults
  publication-title: 23rd IEEE Real-Time Systems Symposium, 2002. RTSS 2002.
  doi: 10.1109/REAL.2002.1181581
– volume: 407
  start-page: 197
  year: 1989
  end-page: 212
  ident: Bib0015
  article-title: Timing assumptions and verification of finite-state concurrent systems
  publication-title: Automatic Verification Methods for Finite State Systems, International Workshop, Grenoble, France, June 12–14, 1989, Proceedings
  doi: 10.1007/3-540-52148-8_17
– start-page: 394
  year: 1992
  end-page: 406
  ident: Bib0017
  article-title: Symbolic model checking for real-time systems
  publication-title: Proceedings of the Seventh Annual Symposium on Logic in Computer Science (LICS’92), Santa Cruz, California, USA, June 22–25, 1992
  doi: 10.1109/LICS.1992.185551
– volume: 33
  start-page: 45
  issue: 1–3
  year: 2008
  end-page: 84
  ident: Bib0013
  article-title: Robust safety of timed automata
  publication-title: Formal Methods in System Design
– volume: 36
  start-page: 25
  issue: 5
  year: 2003
  end-page: 36
  ident: Bib0012
  article-title: Fundamentals of model-based diagnosis
  publication-title: IFAC Proceedings Volumes
– start-page: 147
  year: 2000
  end-page: 155
  ident: Bib0018
  article-title: Model-checking real-time control programs: Verifying LEGO MINDSTORMSTM systems using UPPAAL
  publication-title: Proceedings 12th Euromicro Conference on Real-Time Systems. Euromicro RTS 2000
  doi: 10.1109/EMRTS.2000.854002
– year: 2009
  ident: Bib0011
  publication-title: Introduction to Discrete Event Systems
– start-page: 1158
  year: 2008
  end-page: 1165
  ident: Bib0029
  article-title: Diagnosability of stochastic discrete-event systems under unreliable observations
  publication-title: 2008 American Control Conference
  doi: 10.1109/ACC.2008.4586649
– start-page: 219
  year: 2005
  end-page: 233
  ident: Bib0005
  article-title: Fault diagnosis using timed automata
  publication-title: Foundations of Software Science and Computational Structures
– year: 2012
  ident: Bib0014
  publication-title: Understanding and Using the Controller Area Network Communication Protocol: Theory and Practice
– volume: 45
  start-page: 271
  year: 2020
  end-page: 276
  ident: Bib0022
  article-title: A new learning factory experience exploiting LEGO for teaching manufacturing systems integration
  publication-title: Procedia Manufacturing
  doi: 10.1016/j.promfg.2020.04.106
– start-page: 87
  year: 2004
  end-page: 124
  ident: Bib0004
  publication-title: Timed Automata: Semantics, Algorithms and Tools
  doi: 10.1007/978-3-540-27755-2_3
– volume: 4
  start-page: 105
  issue: 2
  year: 1996
  end-page: 124
  ident: Bib0026
  article-title: Failure diagnosis using discrete-event models
  publication-title: IEEE Transactions on Control Systems Technology
– start-page: 112
  year: 2005
  end-page: 126
  ident: Bib0006
  article-title: Diagonal constraints in timed automata: Forward analysis of timed systems
  publication-title: International Conference on Formal Modeling and Analysis of Timed Systems
– volume: 10206
  start-page: 151
  year: 2017
  end-page: 168
  ident: Bib0009
  article-title: JANI: Quantitative model and tool interaction
  publication-title: Tools and Algorithms for the Construction and Analysis of Systems - 23rd International Conference, TACAS 2017, Held as Part of the European Joint Conferences on Theory and Practice of Software, ETAPS 2017, Uppsala, Sweden, April 22–29, 2017, Proceedings, Part II
  doi: 10.1007/978-3-662-54580-5_9
– volume: 39
  start-page: 205
  issue: 1–3
  year: 2008
  end-page: 235
  ident: Bib0023
  article-title: Timing analysis of the FlexRay communication protocol
  publication-title: Real-time Systems
– volume: 138
  start-page: 3
  issue: 1
  year: 1995
  end-page: 34
  ident: Bib0001
  article-title: The algorithmic analysis of hybrid systems
  publication-title: Theor. Comput. Sci.
  doi: 10.1016/0304-3975(94)00202-T
– volume: 126
  start-page: 183
  issue: 2
  year: 1994
  end-page: 235
  ident: Bib0002
  article-title: A theory of timed automata
  publication-title: Theoretical Computer Science
– start-page: 389
  year: 2021
  end-page: 398
  ident: Bib0020
  article-title: Momba: JANI meets Python
  publication-title: Tools and Algorithms for the Construction and Analysis of Systems
– start-page: 537
  year: 2008
  end-page: 553
  ident: Bib0028
  article-title: The surprising robustness of (closed) timed automata against clock-drift
  publication-title: Fifth IFIPInternational Conference on Theoretical Computer Science – TCS 2008
– start-page: 215
  year: 2010
  end-page: 224
  ident: Bib0027
  article-title: Timing analysis for TDMA arbitration in resource sharing systems
  publication-title: 2010 16th IEEE Real-Time and Embedded Technology and Applications Symposium
– start-page: 14
  year: 1997
  end-page: 24
  ident: Bib0021
  article-title: Efficient verification of real-time systems: Compact data structure and state-space reduction
  publication-title: Proceedings Real-Time Systems Symposium
  doi: 10.1109/REAL.1997.641265
– start-page: 239
  year: 2010
  end-page: 248
  ident: Bib0008
  article-title: Model-based specification of timing requirements
  publication-title: Proceedings of the Tenth ACM International Conference on Embedded Software
– volume: 40
  start-page: 1555
  issue: 9
  year: 1995
  end-page: 1575
  ident: Bib0025
  article-title: Diagnosability of discrete-event systems
  publication-title: IEEE Trans. Automat. Control
– start-page: 205
  year: 2002
  end-page: 221
  ident: Bib0031
  article-title: Fault diagnosis for timed automata
  publication-title: Formal Techniques in Real-Time and Fault-Tolerant Systems
– ident: e_1_3_3_22_2
  doi: 10.1109/REAL.1997.641265
– ident: e_1_3_3_11_2
  doi: 10.1016/j.automatica.2012.09.017
– ident: e_1_3_3_16_2
  doi: 10.1007/3-540-52148-8_17
– ident: e_1_3_3_18_2
  doi: 10.1109/LICS.1992.185551
– ident: e_1_3_3_17_2
  doi: 10.1109/JPROC.2005.849720
– ident: e_1_3_3_24_2
  doi: 10.1007/s11241-007-9040-3
– ident: e_1_3_3_27_2
  doi: 10.1109/87.486338
– ident: e_1_3_3_20_2
  doi: 10.5281/zenodo.7896268
– ident: e_1_3_3_23_2
  doi: 10.1016/j.promfg.2020.04.106
– ident: e_1_3_3_31_2
  doi: 10.1016/0967-0661(95)00112-8
– start-page: 389
  volume-title: Tools and Algorithms for the Construction and Analysis of Systems
  year: 2021
  ident: e_1_3_3_21_2
  doi: 10.1007/978-3-030-72013-1_23
– ident: e_1_3_3_9_2
  doi: 10.1145/1879021.1879053
– start-page: 205
  volume-title: Formal Techniques in Real-Time and Fault-Tolerant Systems
  year: 2002
  ident: e_1_3_3_32_2
  doi: 10.1007/3-540-45739-9_14
– start-page: 219
  volume-title: Foundations of Software Science and Computational Structures
  year: 2005
  ident: e_1_3_3_6_2
  doi: 10.1007/978-3-540-31982-5_14
– ident: e_1_3_3_4_2
  doi: 10.1109/WODES.2006.1678446
– ident: e_1_3_3_29_2
  doi: 10.1007/978-0-387-09680-3_36
– ident: e_1_3_3_14_2
  doi: 10.1007/s10703-008-0056-7
– ident: e_1_3_3_15_2
  doi: 10.1007/978-1-4614-0314-2
– ident: e_1_3_3_30_2
  doi: 10.1109/ACC.2008.4586649
– ident: e_1_3_3_2_2
  doi: 10.1016/0304-3975(94)00202-T
– ident: e_1_3_3_25_2
  doi: 10.1007/BFb0055349
– ident: e_1_3_3_26_2
  doi: 10.1109/9.412626
– ident: e_1_3_3_7_2
  doi: 10.1007/11603009_10
– ident: e_1_3_3_19_2
  doi: 10.1109/EMRTS.2000.854002
– ident: e_1_3_3_3_2
  doi: 10.1016/0304-3975(94)90010-8
– ident: e_1_3_3_8_2
  doi: 10.1109/REAL.2002.1181581
– volume-title: Introduction to Discrete Event Systems
  year: 2009
  ident: e_1_3_3_12_2
– ident: e_1_3_3_28_2
  doi: 10.1109/RTAS.2010.24
– ident: e_1_3_3_5_2
  doi: 10.1007/978-3-540-27755-2_3
– ident: e_1_3_3_10_2
  doi: 10.1007/978-3-662-54580-5_9
– ident: e_1_3_3_13_2
  doi: 10.1016/S1474-6670(17)36467-4
SSID ssj0017245
Score 2.3197668
Snippet Online fault diagnosis techniques are a key enabler of effective failure mitigation. For real-time systems, the problem of identifying faults is aggravated by...
SourceID crossref
acm
SourceType Enrichment Source
Index Database
Publisher
StartPage 1
SubjectTerms Computer systems organization
Embedded systems
Fault tolerance
Formal languages and automata theory
Hardware
Real-time systems
Theory of computation
SubjectTermsDisplay Computer systems organization -- Embedded systems
Computer systems organization -- Real-time systems
Hardware -- Fault tolerance
Theory of computation -- Formal languages and automata theory
Title Model-Based Diagnosis of Real-Time Systems: Robustness Against Varying Latency, Clock Drift, and Out-of-Order Observations
URI https://dl.acm.org/doi/10.1145/3597209
Volume 22
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1LbxMxELZCe4FDBQVEKCAfEJfUJev1vrhtW1CECDnQot4i2-ttIzbZKtmVUH8Ev5nxYzdWQOKRwyqy7JXi-TIPe-YbhF4nTMH_oOBEZmFBGGWCZCqjRARMs04W4dhwd04_x5NL9vEquhoMfnhZS20jTuTdb-tK_keqMAZy1VWy_yDZ_qUwAN9BvvAECcPzr2SsG5lV5BQMUQG6y-TMdfQivCK6uqNjJDd5b7VoN41Rbfk1X4BfOPrK17bMiWvX2ebhgnX7NjpfL6x61ufqs7YhdUlmmqVzNBP9Oe7G92zzs6nuN9E1Hze3EGopFCg2Uzh325oE643HkK71vL6oP41vKls39H2xXJhzl_xke0iryxqstz-pq2uXTewOKmioT0BtNXyvWzOSjZ19VW4sSknIbLuITiFT6gGPedo18My05ef81QAwzZURQphEx9nWxnX3-jumr09ItOXZ0dwtvIf2KYQdoDf38_Pppy_9vVRCTdvr_qfYMmy99K1bqr0cufS8HM9duXiIDlycgXMLmkdooFaH6IHHPvkY3XnwwT18cF3iHj7Ywecd3oIHO_BgBx7swHOMDXSwgc4xBuBgHzjYB84TdPnh_cXZhLhWHITDRjSkYIopnpRROU6VZCqI5ThSIgH_RiQhjwsWSBanZUGDUkDEGjKR6Q_E55JnkQifor1VvVLPEM5KzlSUFjr0YEGqBA0BAAlPTXgi5RAdwgbOby3ZSieRIXrTbehcOvZ63USlmu-IbohwP7F7x86U53-ecoTubyH8Au0161a9BO-zEa8cJH4Cc1mD8g
linkProvider EBSCOhost
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Model-Based+Diagnosis+of+Real-Time+Systems%3A+Robustness+Against+Varying+Latency%2C+Clock+Drift%2C+and+Out-of-Order+Observations&rft.jtitle=ACM+transactions+on+embedded+computing+systems&rft.au=K%C3%B6hl%2C+Maximilian+A.&rft.au=Hermanns%2C+Holger&rft.date=2023-07-26&rft.issn=1539-9087&rft.eissn=1558-3465&rft.volume=22&rft.issue=4&rft.spage=1&rft.epage=48&rft_id=info:doi/10.1145%2F3597209&rft.externalDBID=n%2Fa&rft.externalDocID=10_1145_3597209
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1539-9087&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1539-9087&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1539-9087&client=summon