Holistic System Design Evaluation Through Expanded MATE

According to Buede and Miller, not applying a holistic simulation and modeling approach to early design evaluation practices and trade studies results in greater developmental costs, time to market, and unforeseeable system-level design consequences. Completed research is presented for an innovative...

Full description

Saved in:
Bibliographic Details
Published inIEEE engineering management review Vol. 48; no. 2; pp. 136 - 150
Main Authors Yeager, Matthew P., Holzer, Thomas H., Willy, Christopher J., Sarkani, Shahryar
Format Journal Article
LanguageEnglish
Published New York IEEE 01.06.2020
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects
Online AccessGet full text
ISSN0360-8581
1937-4178
DOI10.1109/EMR.2020.2985373

Cover

Abstract According to Buede and Miller, not applying a holistic simulation and modeling approach to early design evaluation practices and trade studies results in greater developmental costs, time to market, and unforeseeable system-level design consequences. Completed research is presented for an innovative methodology that enhances the capacity of conventional design evaluations by integrating new types of simulations consistently into the existing Multi-attribute Tradespace Exploration (MATE) design evaluation architecture. This enhancement is particularly important for any envisioned software-intensive system that introduces greater system complexity. According to Ross et al., MATE was originally developed to guide engineering design and initial product selection by exploring candidate designs to deliver utility-based solutions. Unfortunately, the MATE methodology does not support software design evaluation and integration into complex systems. The results presented validate MATE improvements that are scalable and extensible to any software-based system of varying complexity and application. The subject research provides proof of this concept by focusing on sensor systems as an initial practical demonstration due to their rapidly expanding commercial use and Internet of Things (IoT) applications. Project engineers and especially software developers in any product field will benefit from this design method by leveraging its holistic evaluation of software and hardware system design performance for more efficient product design identification and implementation.
AbstractList According to Buede and Miller, not applying a holistic simulation and modeling approach to early design evaluation practices and trade studies results in greater developmental costs, time to market, and unforeseeable system-level design consequences. Completed research is presented for an innovative methodology that enhances the capacity of conventional design evaluations by integrating new types of simulations consistently into the existing Multi-attribute Tradespace Exploration (MATE) design evaluation architecture. This enhancement is particularly important for any envisioned software-intensive system that introduces greater system complexity. According to Ross et al., MATE was originally developed to guide engineering design and initial product selection by exploring candidate designs to deliver utility-based solutions. Unfortunately, the MATE methodology does not support software design evaluation and integration into complex systems. The results presented validate MATE improvements that are scalable and extensible to any software-based system of varying complexity and application. The subject research provides proof of this concept by focusing on sensor systems as an initial practical demonstration due to their rapidly expanding commercial use and Internet of Things (IoT) applications. Project engineers and especially software developers in any product field will benefit from this design method by leveraging its holistic evaluation of software and hardware system design performance for more efficient product design identification and implementation.
Author Willy, Christopher J.
Sarkani, Shahryar
Yeager, Matthew P.
Holzer, Thomas H.
Author_xml – sequence: 1
  givenname: Matthew P.
  orcidid: 0000-0002-6313-2997
  surname: Yeager
  fullname: Yeager, Matthew P.
  organization: Engineering Management and Systems Engineering, George Washington University, Washington, DC, USA
– sequence: 2
  givenname: Thomas H.
  orcidid: 0000-0002-1475-2137
  surname: Holzer
  fullname: Holzer, Thomas H.
  organization: Engineering Management and Systems Engineering, George Washington University, Washington, DC, USA
– sequence: 3
  givenname: Christopher J.
  surname: Willy
  fullname: Willy, Christopher J.
  organization: Engineering Management and Systems Engineering, George Washington University, Washington, DC, USA
– sequence: 4
  givenname: Shahryar
  surname: Sarkani
  fullname: Sarkani, Shahryar
  organization: Engineering Management and Systems Engineering, George Washington University, Washington, DC, USA
BookMark eNp9kM9PwjAUxxuDiYDeTbws8Tx8_bF2PRKcYgIxUTw3peugZGzYbkT-e4cQDx48vcv38973fQaoV9WVRegWwwhjkA_Z_G1EgMCIyDShgl6gPpZUxAyLtIf6QDnEaZLiKzQIYQOAOaOyj8S0Ll1onIneD6Gx2-jRBreqomyvy1Y3rq6ixdrX7WodZV87XeU2j-bjRXaNLgtdBntznkP08ZQtJtN49vr8MhnPYkOANzGXxogkLwSRHIBpbgtqmDDYEkiELTgUOTEUNNUCOMkh1cJ03fSS2KWGlA7R_WnvztefrQ2N2tStr7qTijDMEspkIrsUP6WMr0PwtlDGNT_tG69dqTCooyTVSVJHSeosqQPhD7jzbqv94T_k7oQ4a-1vXHbvMI7pN3QPclI
CODEN IEMRAP
CitedBy_id crossref_primary_10_1109_EMR_2021_3063747
Cites_doi 10.2514/1.9204
10.1109/EMR.2019.2915961
10.1007/978-3-642-24031-7_20
10.1109/EMR.2017.2734299
10.1117/12.2074664
10.2514/1.A32789
10.1017/CBO9781139174084
10.1002/sys.21384
10.1029/2011RS004685
10.1109/TITS.2011.2119372
10.1109/EMR.2015.2469471
10.1016/j.cad.2012.08.006
10.1109/EMR.2014.6966952
10.1109/SYSTEMS.2009.4815813
10.1109/CCIE.2010.112
10.1115/1.2771574
10.1287/educ.1100.0070
10.1117/12.531864
10.1002/j.2334-5837.2005.tb00783.x
10.1109/EMR.2017.2765439
10.1109/JPROC.2010.2065790
10.1080/09544828.2016.1214693
10.1002/sys.20098
10.1108/SR-12-2013-755
10.1002/sys.21332
10.1109/IGARSS.2014.6946543
10.1016/j.jsg.2014.10.007
10.1201/9781420066449
10.1016/j.rse.2014.11.001
10.1016/j.jss.2016.01.017
ContentType Journal Article
Copyright Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2020
Copyright_xml – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2020
DBID 97E
RIA
RIE
AAYXX
CITATION
7SC
7SP
7TA
7TB
7U5
8FD
F28
FR3
JG9
JQ2
KR7
L7M
L~C
L~D
DOI 10.1109/EMR.2020.2985373
DatabaseName IEEE All-Society Periodicals Package (ASPP) 2005–Present
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE Electronic Library (IEL)
CrossRef
Computer and Information Systems Abstracts
Electronics & Communications Abstracts
Materials Business File
Mechanical & Transportation Engineering Abstracts
Solid State and Superconductivity Abstracts
Technology Research Database
ANTE: Abstracts in New Technology & Engineering
Engineering Research Database
Materials Research Database
ProQuest Computer Science Collection
Civil Engineering Abstracts
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
DatabaseTitle CrossRef
Materials Research Database
Civil Engineering Abstracts
Technology Research Database
Computer and Information Systems Abstracts – Academic
Mechanical & Transportation Engineering Abstracts
Electronics & Communications Abstracts
ProQuest Computer Science Collection
Computer and Information Systems Abstracts
Materials Business File
Computer and Information Systems Abstracts Professional
Solid State and Superconductivity Abstracts
Engineering Research Database
Advanced Technologies Database with Aerospace
ANTE: Abstracts in New Technology & Engineering
DatabaseTitleList Materials Research Database

Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
Business
EISSN 1937-4178
EndPage 150
ExternalDocumentID 10_1109_EMR_2020_2985373
9057461
Genre orig-research
GroupedDBID -~X
0R~
29I
4.4
5GY
6IK
97E
AAJGR
AARMG
AASAJ
AAVXG
AAWTH
ABAZT
ABQJQ
ABVLG
ACIWK
ACNCT
AFOGA
AGQYO
AHBIQ
AKJIK
AKQYR
ALLEH
ALMA_UNASSIGNED_HOLDINGS
ATWAV
AZLTO
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CS3
DU5
EBS
HZ~
IFIPE
IPLJI
JAVBF
LAI
M43
O9-
OCL
RIA
RIE
TN5
AAYXX
CITATION
7SC
7SP
7TA
7TB
7U5
8FD
F28
FR3
JG9
JQ2
KR7
L7M
L~C
L~D
ID FETCH-LOGICAL-c206t-69cc75df7296004a6ef3c47c1e2057ef60fd2c30a3a7062d08a7c016ab2eba083
IEDL.DBID RIE
ISSN 0360-8581
IngestDate Sun Jun 29 16:39:42 EDT 2025
Tue Jul 01 03:53:55 EDT 2025
Thu Apr 24 23:12:57 EDT 2025
Wed Aug 27 02:51:11 EDT 2025
IsPeerReviewed true
IsScholarly true
Issue 2
Language English
License https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html
https://doi.org/10.15223/policy-029
https://doi.org/10.15223/policy-037
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c206t-69cc75df7296004a6ef3c47c1e2057ef60fd2c30a3a7062d08a7c016ab2eba083
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0002-6313-2997
0000-0002-1475-2137
PQID 2414534959
PQPubID 85487
PageCount 15
ParticipantIDs ieee_primary_9057461
crossref_citationtrail_10_1109_EMR_2020_2985373
crossref_primary_10_1109_EMR_2020_2985373
proquest_journals_2414534959
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2020-Secondquarter,june-1
PublicationDateYYYYMMDD 2020-06-01
PublicationDate_xml – month: 06
  year: 2020
  text: 2020-Secondquarter,june-1
  day: 01
PublicationDecade 2020
PublicationPlace New York
PublicationPlace_xml – name: New York
PublicationTitle IEEE engineering management review
PublicationTitleAbbrev EMR
PublicationYear 2020
Publisher IEEE
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml – name: IEEE
– name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References ref35
ref13
ref12
ref37
ref15
ref36
ref31
ref30
bryzek (ref14) 2012
ref33
ref11
ref10
ref2
ref38
ref16
ref18
benezeth (ref34) 2010; 19
tang (ref28) 2013; 46
lan (ref23) 2010; 3
ref24
ref26
ref25
buede (ref1) 2016
ref22
ref21
ref27
mian (ref17) 2002
ref29
ross (ref39) 2005
ref8
ref7
ref9
ref4
ref3
wang (ref19) 2006; 14
ref6
richards (ref20) 2009
ref5
chattopadhyay (ref32) 2009
References_xml – volume: 46
  start-page: 35
  year: 2013
  ident: ref28
  article-title: Application of unmanned aerial vehicle in inspecting transmission lines
  publication-title: Electric Power
– volume: 3
  start-page: 88
  year: 2010
  ident: ref23
  article-title: Aircraft design material-selection method based on MAUT theory
  publication-title: Journal of aeronautical materials
– ident: ref2
  doi: 10.2514/1.9204
– ident: ref13
  doi: 10.1109/EMR.2019.2915961
– ident: ref31
  doi: 10.1007/978-3-642-24031-7_20
– ident: ref9
  doi: 10.1109/EMR.2017.2734299
– ident: ref33
  doi: 10.1117/12.2074664
– ident: ref36
  doi: 10.2514/1.A32789
– ident: ref15
  doi: 10.1017/CBO9781139174084
– ident: ref4
  doi: 10.1002/sys.21384
– ident: ref35
  doi: 10.1029/2011RS004685
– ident: ref26
  doi: 10.1109/TITS.2011.2119372
– ident: ref5
  doi: 10.1109/EMR.2015.2469471
– ident: ref7
  doi: 10.1016/j.cad.2012.08.006
– ident: ref6
  doi: 10.1109/EMR.2014.6966952
– ident: ref22
  doi: 10.1109/SYSTEMS.2009.4815813
– ident: ref16
  doi: 10.1109/CCIE.2010.112
– year: 2012
  ident: ref14
  article-title: Emergence of a $1 trillion MEMS sensor market
  publication-title: Sensor
– year: 2002
  ident: ref17
  publication-title: Details of Project Economics and Decision Analysis Volume 2 Probabilistic Models
– ident: ref21
  doi: 10.1115/1.2771574
– year: 2009
  ident: ref32
  article-title: Demonstration of system of systems multi-attribute tradespace exploration on a multi-concept surveillance architecture
  publication-title: Proceedings of the 7th Annual Conference on Systems Engineering Research
– ident: ref18
  doi: 10.1287/educ.1100.0070
– ident: ref37
  doi: 10.1117/12.531864
– year: 2005
  ident: ref39
  article-title: The tradespace exploration paradigm
  publication-title: Proceedings of the International Symposium of the INCOSE
  doi: 10.1002/j.2334-5837.2005.tb00783.x
– ident: ref10
  doi: 10.1109/EMR.2017.2765439
– year: 2009
  ident: ref20
  article-title: Multi-Attribute Tradespace Exploration for Survivability, Doctoral dissertation, Engineering Systems Division, Massachusetts Institute of Technology
– ident: ref11
  doi: 10.1109/JPROC.2010.2065790
– ident: ref3
  doi: 10.1080/09544828.2016.1214693
– ident: ref24
  doi: 10.1002/sys.20098
– ident: ref12
  doi: 10.1108/SR-12-2013-755
– ident: ref25
  doi: 10.1002/sys.21332
– ident: ref38
  doi: 10.1109/IGARSS.2014.6946543
– year: 2016
  ident: ref1
  publication-title: The Engineering Design of Systems Models and Methods
– ident: ref30
  doi: 10.1016/j.jsg.2014.10.007
– volume: 19
  year: 2010
  ident: ref34
  article-title: Comparative study of background subtraction algorithms
  publication-title: Journal of Electronic Imaging
– volume: 14
  start-page: 65
  year: 2006
  ident: ref19
  article-title: Analysing the consistency of comparison matrix based on GI method
  publication-title: Chinese Journal of Management Science
– ident: ref27
  doi: 10.1201/9781420066449
– ident: ref29
  doi: 10.1016/j.rse.2014.11.001
– ident: ref8
  doi: 10.1016/j.jss.2016.01.017
SSID ssj0016439
Score 2.1488771
Snippet According to Buede and Miller, not applying a holistic simulation and modeling approach to early design evaluation practices and trade studies results in...
SourceID proquest
crossref
ieee
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 136
SubjectTerms Complex systems
Complexity
Computer simulation
Design analysis
Design engineering
Engineering management
Hardware
Internet of Things
Microelectronics
Modeling
product assessment
Product design
product development
Software
Software development
software engineering
Stakeholders
System analysis and design
system modeling and simulation
Systems design
Title Holistic System Design Evaluation Through Expanded MATE
URI https://ieeexplore.ieee.org/document/9057461
https://www.proquest.com/docview/2414534959
Volume 48
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LS8NAEB5qD6IHH61itUoOXgQ33WSz2eyxaEoR4kFa6C1sdjcXS1s0BfHXu5sXvhAvIYdsGGYm2W92Zr4BuGZMC8_4ClJMUBTwiKIoyjGSytM8VITwzPYOJ4_hdB48LOiiA7dtL4zWuiw-0669LXP5ai239qhsxA24CGyss2PcrOrVajMGdmet8pIYRTTympQk5qM4eTKBoI9d34hCGPmyBZUzVX78iMvdZXIISSNXVVTy7G6LzJXv3ygb_yv4ERzUMNMZV35xDB296sFuU-Xeg_1PPIR9YNP1siRsdioCc-e-rOtw4pYK3JlV83yc-G1jj52Vk4xn8QnMJ_HsborqiQpI-jgsUMilZFTlBlEboBOIUOdEBkx62jcS6jzEufIlwYIIhkNf4UgwaXQrMl9nwqC1U-iu1it9Bo7HKRXK4BFpL5lt0VUBsVQzRPiMBgMYNUpOZU03bqdeLNMy7MA8NWZJrVnS2iwDuGlXbCqqjT-e7Vstt8_VCh7AsLFjWn-Lr6nBKAElJhDk57-vuoA9--6qAGwI3eJlqy8N1Ciyq9LHPgDPYMxy
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LS8QwEB4WBR8HX6u4PnvwItjdtEma5ijapT7qQSrsraRJenHZXXQXxF9v0he-EC-lh4YOM2nnm8zMNwBnjGnhmb3iKiaoS3hI3TAskCuVp3mgMOa57R1OHoL4idyO6KgDF20vjNa6LD7TfXtb5vLVVC7sUdmAG3BBbKyzbPw-oVW3VpszsL61ykwiN6Sh1yQlER9EyaMJBX3U940wmOEvTqicqvLjV1z6l-EmJI1kVVnJc38xz_vy_Rtp439F34KNGmg6l9XO2IaOnuzASlPnvgPrn5gIu8Di6bikbHYqCnPnuqzscKKWDNxJq4k-TvQ2swfPykku02gXnoZRehW79UwFV_oomLsBl5JRVRhMbaAOEYEusCRMeto3EuoiQIXyJUYCC4YCX6FQMGl0K3Jf58LgtT1Ymkwneh8cj1MqlEEk0l5y26SrCLZkM1j4jJIeDBolZ7ImHLdzL8ZZGXggnhmzZNYsWW2WHpy3K2YV2cYfz3atltvnagX34KixY1Z_ja-ZQSmEYhMK8oPfV53Capwm99n9zcPdIazZ91TlYEewNH9Z6GMDPOb5SbnfPgCzmM-_
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Holistic+System+Design+Evaluation+Through+Expanded+MATE&rft.jtitle=IEEE+engineering+management+review&rft.au=Yeager%2C+Matthew+P&rft.au=Holzer%2C+Thomas+H&rft.au=Willy%2C+Christopher+J&rft.au=Sarkani%2C+Shahryar&rft.date=2020-06-01&rft.pub=The+Institute+of+Electrical+and+Electronics+Engineers%2C+Inc.+%28IEEE%29&rft.issn=0360-8581&rft.eissn=1937-4178&rft.volume=48&rft.issue=2&rft.spage=136&rft_id=info:doi/10.1109%2FEMR.2020.2985373&rft.externalDBID=NO_FULL_TEXT
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0360-8581&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0360-8581&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0360-8581&client=summon