Using the Homeland Security Exercise and Evaluation Program (HSEEP) Building Block Approach to Implement System Evaluation Theory (SET)

• Published in: The American journal of evaluation Vol. 42; no. 4; pp. 586 - 601
• Main Authors: Renger, Ralph, Renger, Jessica, Basson, Marc D., Van Eck, Richard N., Renger, Jirina, Souvannasacd, Eric, Hart, Gary
• Format: Journal Article
• Language: English
• Published: Los Angeles, CA SAGE Publications 01.12.2021
• Subjects: Cancer; Evaluation; Medical Research; Organizational Change; Organizational Culture; Systems Approach; Theories; mixed methods; homeland security exercise and evaluation; systems; systems evaluation; system evaluation theory
• ISSN: 1098-2140; 1557-0878
• DOI: 10.1177/1098214020986619

This article shares lessons learned in applying system evaluation theory (SET) to evaluate a Clinical and Translational Research Center (CTR) funded by the National Institutes of Health. After describing how CTR support cores are intended to work interdependently as a system, the case is made for SET as the best fit for evaluating this evaluand. The article then details how the evaluation was also challenged to facilitate a CTR culture shift, helping support cores to move from working autonomously to working together and understanding how the cores’ individual operating processes impact each other. This was achieved by incorporating the Homeland Security Exercise and Evaluation Program (HSEEP) building block approach to implement SET. Each of the seven HSEEP building blocks is examined for alignment with each of SET’s three steps and the ability to systematically support the goal of moving CTR cores toward working interdependently. The implications of using HSEEP to support SET implementation for future evaluations are discussed.