Advice from local/site evaluators: How to manage “up” within a large‐scale initiative
BUilding Infrastructure Leading to Diversity (BUILD), an initiative of the National Institutes of Health (NIH), provides grants to undergraduate institutions to implement and study innovative approaches to engaging and retaining students from diverse backgrounds in biomedical research. The NIH award...
Saved in:
| Published in | New directions for evaluation Vol. 2022; no. 174; pp. 79 - 95 |
|---|---|
| Main Authors | , , |
| Format | Journal Article |
| Language | English |
| Published |
United States
Wiley Subscription Services, Inc
2022
|
| Subjects | |
| Online Access | Get full text |
Cover
Loading…
| Abstract | BUilding Infrastructure Leading to Diversity (BUILD), an initiative of the National Institutes of Health (NIH), provides grants to undergraduate institutions to implement and study innovative approaches to engaging and retaining students from diverse backgrounds in biomedical research. The NIH awarded BUILD grants to 10 higher education institutions in multiple states, including funding for local evaluations. This chapter presents findings from an online survey and interviews with 15 local evaluators from nine of the 10 BUILD sites. Participants shared their perspectives on the role of professional local evaluators in national evaluations, ideal national–local multisite evaluation partnerships, and the ways that funders can support these partnerships to maximize impact. They argued for customized technical assistance and other support for local evaluations; the importance of including local results in national evaluation findings; the value of local evaluators’ subject‐matter expertise; and the potential for funders to act as central organizing entities in national–local evaluation partnerships. |
|---|---|
| AbstractList | BUilding Infrastructure Leading to Diversity (BUILD), an initiative of the National Institutes of Health (NIH), provides grants to undergraduate institutions to implement and study innovative approaches to engaging and retaining students from diverse backgrounds in biomedical research. The NIH awarded BUILD grants to 10 higher education institutions in multiple states, including funding for local evaluations. This chapter presents findings from an online survey and interviews with 15 local evaluators from nine of the 10 BUILD sites. Participants shared their perspectives on the role of professional local evaluators in national evaluations, ideal national–local multisite evaluation partnerships, and the ways that funders can support these partnerships to maximize impact. They argued for customized technical assistance and other support for local evaluations; the importance of including local results in national evaluation findings; the value of local evaluators’ subject‐matter expertise; and the potential for funders to act as central organizing entities in national–local evaluation partnerships. BUilding Infrastructure Leading to Diversity (BUILD), an initiative of the National Institutes of Health (NIH), provides grants to undergraduate institutions to implement and study innovative approaches to engaging and retaining students from diverse backgrounds in biomedical research. The NIH awarded BUILD grants to 10 higher education institutions in multiple states, including funding for local evaluations. This chapter presents findings from an online survey and interviews with 15 local evaluators from nine of the 10 BUILD sites. Participants shared their perspectives on the role of professional local evaluators in national evaluations, ideal national-local multisite evaluation partnerships, and the ways that funders can support these partnerships to maximize impact. They argued for customized technical assistance and other support for local evaluations; the importance of including local results in national evaluation findings; the value of local evaluators' subject-matter expertise; and the potential for funders to act as central organizing entities in national-local evaluation partnerships.BUilding Infrastructure Leading to Diversity (BUILD), an initiative of the National Institutes of Health (NIH), provides grants to undergraduate institutions to implement and study innovative approaches to engaging and retaining students from diverse backgrounds in biomedical research. The NIH awarded BUILD grants to 10 higher education institutions in multiple states, including funding for local evaluations. This chapter presents findings from an online survey and interviews with 15 local evaluators from nine of the 10 BUILD sites. Participants shared their perspectives on the role of professional local evaluators in national evaluations, ideal national-local multisite evaluation partnerships, and the ways that funders can support these partnerships to maximize impact. They argued for customized technical assistance and other support for local evaluations; the importance of including local results in national evaluation findings; the value of local evaluators' subject-matter expertise; and the potential for funders to act as central organizing entities in national-local evaluation partnerships. |
| Author | Brown, Shavonnea Hwalek, Melanie Honoré, Matt |
| AuthorAffiliation | 2 Oregon Health & Science University, Portland, Oregon, USA 1 SPEC Associates, Southfield, Michigan, USA |
| AuthorAffiliation_xml | – name: 1 SPEC Associates, Southfield, Michigan, USA – name: 2 Oregon Health & Science University, Portland, Oregon, USA |
| Author_xml | – sequence: 1 givenname: Melanie surname: Hwalek fullname: Hwalek, Melanie email: mhwalek@specassociates.org organization: SPEC Associates – sequence: 2 givenname: Matt surname: Honoré fullname: Honoré, Matt organization: Oregon Health & Science University – sequence: 3 givenname: Shavonnea surname: Brown fullname: Brown, Shavonnea organization: SPEC Associates |
| BackLink | https://www.ncbi.nlm.nih.gov/pubmed/37284175$$D View this record in MEDLINE/PubMed |
| BookMark | eNp1kUtqHDEQhkVwiB8J5ARBkE02bZce3erOJhhjxwZDNkkIZCE0muqxTLc0kbp78G6OkAM4l5uTWM44zgOyUoG--uuv-vfJjg8eCXnJ4JAB8COcDjmUIJ-QPVYKWdSq_LKTa2hUUSlR7ZL9lK4ho4qVz8iuULyWTJV75OvxfHIWaRtDT7tgTXeU3IAUJ9ONZggxvaXnYUWHQHvjzQLpZn07LjfrH3TlhivnqaGdiQvcrL-n3I3UeTc4M7gJn5OnrekSvnh4D8ins9OPJ-fF5Yf3FyfHl4UVrJSFwcYKq5rWWt7OkLVQy7bhBuQMRNsgZKcW2BzASlRyPqubite2qgQHYUUrDsi7re5ynPU4t-iHaDq9jK438UYH4_TfP95d6UWYNAMuhSrLrPDmQSGGbyOmQfcuWew64zGMSfOaixJAgczo63_Q6zBGn_fTvGqaqslB3Au--tPSo5dfh_890caQUsT2EWGg7zPVOOmfmWa02KIr1-HNfzl9-nnL3wGugKPz |
| Cites_doi | 10.1177/2F1356389006066974 10.1177/2F13563890022209398 10.1177/2F1098214010373645 10.1016/j.evalprogplan.2007.06.005 10.1016/j.ameval.2003.09.003 10.1177/109821400302400308 10.1037/vio0000043 10.1016/j.evalprogplan.2008.10.001 10.3138/cjpe.0019.003 10.1002/jcop.10001 10.1521/aeap.2019.31.2.179 10.1300/J125v11n01_04 10.1177/2F13563890260620630 10.56645/jmde.v7i15.278 10.1037/h0025715 10.1002/ev.47 |
| ContentType | Journal Article |
| Copyright | 2022 SPEC Associates (Social Program Evaluators and Consultants), Inc. published by American Evaluation Association and Wiley Periodicals LLC. 2022. This article is published under http://creativecommons.org/licenses/by-nc-nd/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. |
| Copyright_xml | – notice: 2022 SPEC Associates (Social Program Evaluators and Consultants), Inc. published by American Evaluation Association and Wiley Periodicals LLC. – notice: 2022. This article is published under http://creativecommons.org/licenses/by-nc-nd/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. |
| DBID | 24P AAYXX CITATION NPM 7U4 7UB BHHNA DWI WZK 7X8 5PM |
| DOI | 10.1002/ev.20504 |
| DatabaseName | Wiley Online Library Open Access CrossRef PubMed Sociological Abstracts (pre-2017) Worldwide Political Science Abstracts Sociological Abstracts Sociological Abstracts Sociological Abstracts (Ovid) MEDLINE - Academic PubMed Central (Full Participant titles) |
| DatabaseTitle | CrossRef PubMed Sociological Abstracts (pre-2017) Sociological Abstracts Worldwide Political Science Abstracts MEDLINE - Academic |
| DatabaseTitleList | CrossRef PubMed Sociological Abstracts (pre-2017) MEDLINE - Academic |
| Database_xml | – sequence: 1 dbid: 24P name: Wiley Online Library Open Access url: https://authorservices.wiley.com/open-science/open-access/browse-journals.html sourceTypes: Publisher – sequence: 2 dbid: NPM name: PubMed url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Education Social Sciences (General) |
| EISSN | 1534-875X |
| EndPage | 95 |
| ExternalDocumentID | PMC10243755 37284175 10_1002_ev_20504 EV20504 |
| Genre | article Journal Article |
| GroupedDBID | -W8 -~X .3N .GA .GO .Y3 05W 0R~ 123 1L6 1OB 1OC 24P 31~ 33P 3WU 4.4 4ZD 50Y 50Z 52M 52O 52T 52U 52W 5VS 66C 702 7PT 8-0 8-1 8-3 8-4 8-5 8UM 930 A04 AABNI AAESR AAHHS AAHQN AAHSB AAMNL AANHP AAONW AAOUF AASGY AAXRX AAYCA AAZKR ABCQN ABCUV ABEML ABIJN ABJNI ABPVW ABSOO ACAHQ ACBKW ACBWZ ACCFJ ACCZN ACGFO ACGFS ACKOT ACPOU ACRPL ACSCC ACXQS ACYXJ ADBBV ADEMA ADEOM ADIZJ ADKYN ADMGS ADNMO ADXAS ADZMN AEEZP AEGXH AEIGN AEIMD AEQDE AEUQT AEUYR AFBPY AFFPM AFGKR AFKFF AFPWT AFWVQ AFYRF AFZJQ AHBTC AIFKG AIURR AIWBW AJBDE ALAGY ALMA_UNASSIGNED_HOLDINGS ALUQN ALVPJ AMBMR AMYDB ASPBG ASTYK AVWKF AZBYB AZFZN AZVAB BAFTC BDRZF BFHJK BMXJE BNVMJ BQESF BROTX BRXPI CAG COF CS3 D-C D-D DCZOG DPXWK DR1 DR2 DRFUL DRMBU DRSSH EBS EDJ EJD F00 F01 F21 FEDTE G-S G.N G50 GNP GODZA HBH HF~ HGLYW HHY HVGLF HZ~ IX1 JPC KQQ LATKE LAW LEEKS LH4 LITHE LOXES LP6 LP7 LUTES LW6 LYRES M6N MEWTI MK4 MRFUL MRSSH MSFUL MSSSH MXFUL MXSSH N04 N06 NF~ NNB O66 O9- OHT OIG P2P P2W P2Y P4C PALCI Q.N QB0 QRW R.K RIWAO RJQFR ROL RWI RX1 SAMSI SUPJJ UB1 V2E V8K W8V W99 WBKPD WGMDG WH7 WIB WIH WII WOHZO WQZ WRC WSUWO WXSBR XSW XV2 YCJ YHZ YYQ ZKG ZUP ZZTAW ~IA ~WP AAYXX AEYWJ AGHNM AGQPQ CITATION AAMMB AEFGJ AGXDD AIDQK AIDYY NPM 7U4 7UB BHHNA DWI WZK 7X8 5PM |
| ID | FETCH-LOGICAL-c3154-ae9c3c79fcc2fbe1f084f92a04b03f9e0417c01d00c4e74db89628c663203c3f3 |
| IEDL.DBID | DR2 |
| ISSN | 1097-6736 |
| IngestDate | Thu Aug 21 18:38:10 EDT 2025 Thu Jul 10 22:41:08 EDT 2025 Fri Jul 25 03:18:03 EDT 2025 Mon Jul 21 06:06:11 EDT 2025 Tue Jul 01 02:44:22 EDT 2025 Wed Jan 22 16:25:19 EST 2025 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | false |
| IsScholarly | true |
| Issue | 174 |
| Language | English |
| License | Attribution-NonCommercial-NoDerivs This is an open access article under the terms of the CreativeCommonsAttribution-NonCommercial-NoDerivs License, which permits use and distribution in any medium, provided the original work is properly cited, the use is non-commercial and no modifications or adaptations are made. |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c3154-ae9c3c79fcc2fbe1f084f92a04b03f9e0417c01d00c4e74db89628c663203c3f3 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 content type line 23 |
| OpenAccessLink | https://proxy.k.utb.cz/login?url=https://onlinelibrary.wiley.com/doi/abs/10.1002%2Fev.20504 |
| PMID | 37284175 |
| PQID | 2699692055 |
| PQPubID | 2039497 |
| PageCount | 17 |
| ParticipantIDs | pubmedcentral_primary_oai_pubmedcentral_nih_gov_10243755 proquest_miscellaneous_2823500704 proquest_journals_2699692055 pubmed_primary_37284175 crossref_primary_10_1002_ev_20504 wiley_primary_10_1002_ev_20504_EV20504 |
| ProviderPackageCode | CITATION AAYXX |
| PublicationCentury | 2000 |
| PublicationDate | Summer 2022 |
| PublicationDateYYYYMMDD | 2022-01-01 |
| PublicationDate_xml | – year: 2022 text: Summer 2022 |
| PublicationDecade | 2020 |
| PublicationPlace | United States |
| PublicationPlace_xml | – name: United States – name: Fairhaven |
| PublicationTitle | New directions for evaluation |
| PublicationTitleAlternate | New Dir Eval |
| PublicationYear | 2022 |
| Publisher | Wiley Subscription Services, Inc |
| Publisher_xml | – name: Wiley Subscription Services, Inc |
| References | 1968; 23 2016; 6 2010; 31 2009; 32 2006; 12 2000; 6 2002; 30 2019; 31 2004; 19 2002; 94 2002; 8 2003; 24 2007; 30 1985; 33 2011; 7 2003; 11 Dewa C. S. (e_1_2_6_6_1) 2004; 19 e_1_2_6_10_1 Lancaster J. (e_1_2_6_11_1) 1985; 33 Uehara D. L. (e_1_2_6_18_1) 2011; 7 e_1_2_6_9_1 e_1_2_6_8_1 e_1_2_6_5_1 e_1_2_6_4_1 e_1_2_6_7_1 e_1_2_6_13_1 e_1_2_6_14_1 e_1_2_6_3_1 e_1_2_6_2_1 e_1_2_6_12_1 e_1_2_6_17_1 e_1_2_6_15_1 e_1_2_6_16_1 |
| References_xml | – volume: 24 start-page: 471 issue: 4 year: 2003 end-page: 482 article-title: How can multi‐site evaluations be participatory? publication-title: American Journal of Evaluation – volume: 6 start-page: 399 issue: 4 year: 2000 end-page: 413 article-title: Local evaluation in a national Early Years Excellence Centres pilot programme: Integrating performance management and participatory evaluation publication-title: Evaluation – volume: 33 start-page: 231 issue: 5 year: 1985 end-page: 232 article-title: The perils and joys of collaborative research publication-title: Nursing Outlook – volume: 94 start-page: 5 year: 2002 end-page: 16 article-title: A framework for understanding and improving multisite evaluations publication-title: New Directions for Evaluation – volume: 12 start-page: 237 issue: 2 year: 2006 end-page: 249 article-title: Dual level evaluation and complex community initiatives: The local evaluation of Sure Start publication-title: Evaluation – volume: 32 start-page: 91 issue: 2 year: 2009 end-page: 98 article-title: The unique character of involvement in multi‐site evaluation settings publication-title: Evaluation and Program Planning – volume: 8 start-page: 440 issue: 4 year: 2002 end-page: 453 article-title: Pro‐active evaluators: Enabling research to be useful, usable and used publication-title: Evaluation – volume: 31 start-page: 400 issue: 3 year: 2010 end-page: 413 article-title: Eyes on the prize: Multicultural validity and evaluation theory publication-title: American Journal of Evaluation – volume: 30 start-page: 416 issue: 4 year: 2007 end-page: 421 article-title: Where local and national evaluators meet: Unintended threats to ethical evaluation practice publication-title: Evaluation and Program Planning – volume: 24 start-page: 399 issue: 3 year: 2003 end-page: 408 article-title: Rapid assessment with qualitative telephone interviews: Lessons from an evaluation of California's Healthy Families program & Medi‐Cal for children publication-title: American Journal of Evaluation – volume: 30 start-page: 173 issue: 2 year: 2002 end-page: 187 article-title: Considering a multisite study? How to take the leap and have a soft landing publication-title: Journal of Community Psychology – volume: 23 start-page: 180 issue: 3 year: 1968 end-page: 186 article-title: The role of the behavioral scientist in the civil rights movement publication-title: The American Psychologist – volume: 7 start-page: 296 issue: 15 year: 2011 end-page: 305 article-title: The context of evaluation: Balancing rigor and relevance publication-title: Journal of MultiDisciplinary Evaluation – volume: 6 start-page: 452 issue: 3 year: 2016 end-page: 458 article-title: Lessons learned in evaluating a multisite, comprehensive teen dating violence prevention strategy: Design and challenges of the evaluation of dating matters: Strategies to promote healthy teen relationships publication-title: Psychology of Violence – volume: 11 start-page: 61 issue: 1 year: 2003 end-page: 83 article-title: The challenge of two‐tiered evaluation in community initiatives publication-title: Journal of Community Practice – volume: 31 start-page: 179 issue: 2 year: 2019 end-page: 192 article-title: I don't want the tray to tip: Experiences of peer evaluators in a multisite HIV retention in care study publication-title: AIDS Education and Prevention – volume: 19 start-page: 1 issue: 3 year: 2004 end-page: 28 article-title: No matter how you land: Challenges of a longitudinal multi‐site evaluation publication-title: The Canadian Journal of Program Evaluation – ident: e_1_2_6_2_1 doi: 10.1177/2F1356389006066974 – ident: e_1_2_6_3_1 doi: 10.1177/2F13563890022209398 – ident: e_1_2_6_10_1 doi: 10.1177/2F1098214010373645 – ident: e_1_2_6_14_1 doi: 10.1016/j.evalprogplan.2007.06.005 – ident: e_1_2_6_12_1 doi: 10.1016/j.ameval.2003.09.003 – ident: e_1_2_6_15_1 doi: 10.1177/109821400302400308 – ident: e_1_2_6_13_1 doi: 10.1037/vio0000043 – ident: e_1_2_6_17_1 doi: 10.1016/j.evalprogplan.2008.10.001 – volume: 33 start-page: 231 issue: 5 year: 1985 ident: e_1_2_6_11_1 article-title: The perils and joys of collaborative research publication-title: Nursing Outlook – volume: 19 start-page: 1 issue: 3 year: 2004 ident: e_1_2_6_6_1 article-title: No matter how you land: Challenges of a longitudinal multi‐site evaluation publication-title: The Canadian Journal of Program Evaluation doi: 10.3138/cjpe.0019.003 – ident: e_1_2_6_7_1 doi: 10.1002/jcop.10001 – ident: e_1_2_6_8_1 doi: 10.1521/aeap.2019.31.2.179 – ident: e_1_2_6_5_1 doi: 10.1300/J125v11n01_04 – ident: e_1_2_6_4_1 doi: 10.1177/2F13563890260620630 – volume: 7 start-page: 296 issue: 15 year: 2011 ident: e_1_2_6_18_1 article-title: The context of evaluation: Balancing rigor and relevance publication-title: Journal of MultiDisciplinary Evaluation doi: 10.56645/jmde.v7i15.278 – ident: e_1_2_6_9_1 doi: 10.1037/h0025715 – ident: e_1_2_6_16_1 doi: 10.1002/ev.47 |
| SSID | ssj0002715 |
| Score | 2.1888354 |
| Snippet | BUilding Infrastructure Leading to Diversity (BUILD), an initiative of the National Institutes of Health (NIH), provides grants to undergraduate institutions... |
| SourceID | pubmedcentral proquest pubmed crossref wiley |
| SourceType | Open Access Repository Aggregation Database Index Database Publisher |
| StartPage | 79 |
| SubjectTerms | Biomedicine Evaluation Grants Higher education Institutes Internet Medical research Technical assistance |
| Title | Advice from local/site evaluators: How to manage “up” within a large‐scale initiative |
| URI | https://onlinelibrary.wiley.com/doi/abs/10.1002%2Fev.20504 https://www.ncbi.nlm.nih.gov/pubmed/37284175 https://www.proquest.com/docview/2699692055 https://www.proquest.com/docview/2823500704 https://pubmed.ncbi.nlm.nih.gov/PMC10243755 |
| Volume | 2022 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV3dSuQwFA7qlTfrqvsz6w8RlsW9qKZJOm29E1EGwUVEF8GLkqSnOCit2BmFvZpH2AfQl5snMSdpR2dlQbzqRf7aJifny8mXL4R8t4hVFUyxQKVQBHa9AYHmKQQSrC8UOZhcY7zj6Fe3dyYPz6PzhlWJZ2G8PsQk4IaW4eZrNHCl6-1n0VC4s6u7yEmBIlUL8dDJs3IUj93lBbi_6tjtre4s49ttwWlP9ApevmZJvkSvzv0cLJCL9sU96-RqazjQW-bPP5qO7_uyj-RDg0rprh9Gi2QGyiW80LkhfyyRjj_GS5upoKabjV71z2VysZvjdEPxpAr1oWHckqaNkHh1W-_QXnVPBxX1XFk6Hj0Mb8ajR4pR4H5JFb1GQvp49Le2pYH2kdHkFMk_kbOD_dO9XtDc2RAYYdFYoCA1wsRpYQwvNIQFS2SRcsWkZqJIgckwNizMGTMSYpnrJO3yxFjcw5kwohCfyVxZlfCVUMYUOlisK5Fa5iqXMUDYdYumSPEO2Wj7L7vx0hyZF2HmGdxl7hd2yGrbsVljnHXGu3aRl9r0yFYxSbZmhXslqoRqaPMkXESohWSr-OLHwaQREVufbmFXhyRTI2SSASW7p1PK_qWT7g6dACQ2_MONgP--eLb_2z2_vTXjCpnneDLDRYdWydzgdghrFi8N9DqZ5fJ43dnHE0ITFLg |
| linkProvider | Wiley-Blackwell |
| linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1fT9RAEJ8QfMAXUUA9RFwSQ_ShsN3dXlt5IgZyKvBgwJBo0my303iBtIS7w8Sn-wh-APhy90nc2W0PTmJifOrD_mu7Mzt_duY3AK-txqpLrnmgUywDa29gkIsUA4VWFsoCTZGTv-PwqNs7UR9Po9M52GlzYTw-xNThRpzhzmticHJIb9-ihuKVNe8iwgJ9QAW9nT31-RY7SsSufAHdsLr49hZ5lovtduSsLLqnYN6Pk7yrvzoBtL8I39pX93EnZ1ujYb5lfv6B6vif3_YYHjWKKdv1lPQE5rBaoprOTfzHEnR8Ji9rToMBe9NAVr9dhq-7BZ04jJJVmPcO0600a7DE68vBO9arf7BhzXy4LJuMr0cXk_ENI0dwv2KanVNM-mT8a2BHI-tTUJMDJV-Bk_294_e9oCnbEBhpFbJAY2qkidPSGFHmGJY8UWUqNFc5l2WKXIWx4WHBuVEYqyJP0q5IjFV9BJdGlvIpzFd1hc-Bca5JxtJcicpVoQsVI4ZdZzdFWnRgo93A7MKjc2Qeh1lkeJW5X9iBtXZns4Y_B5noWjsvte2RnWLabDmLrkt0hfXI9kmEjAgOyU7xzBPCdBEZW7FuNa8OJDMkMu1AqN2zLVX_u0PvDh0GJC286Ujgry-e7X1xz9V_7fgKFnrHhwfZwYejTy_goaBEDecsWoP54eUIX1r1aZivOzb5DegrF_w |
| linkToPdf | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV3NTtwwELYqkFAvbYHSLoVipKqCQ8CxnT9uqLDa_qEKlQqJQ-Q4Y3VVlKzYXZB62kfoA7Qvt0-Cx06WblGlqqcc_JfEM55vxuPPhLyyiFUZpligMjCB9TcgKHgGgQRrC0UJuiww3vHxJO6dyXfn0XmTVYlnYTw_xCzghprh1mtU8EFp9u9IQ-HaencRUoEuypilKNFHp3fUUTxxtxfgBqtLb2-JZxnfb1vOm6J7-PJ-muTv8NXZn-5jctG-uU87-bY3HhV7-vsfpI7_92lPyKMGltJDL0fL5AFUK3ijc5P9sUI6_hwvbdaCId1pCKt3V8nFYYnrDcWjKtTHhnFPmjZM4vXV8ID26hs6qqlPlqXTyc_xYDr5RTEM3K-oopeYkT6d_Bja1kD7mNLkKMmfkrPu8ec3vaC5tCHQwsKxQEGmhU4yozU3BYSGpdJkXDFZMGEyYDJMNAtLxrSERJZFmsU81Rb4cCa0MGKNLFR1Bc8JZUyhhcW-UlnIUpUyAQhj5zVFinfIdjt_-cBzc-SehZnncJ27X9ghG-3E5o12DnMeWy8vs-WR7WJWbPUKN0tUBfXY1km5iJAMyXbxzMvBbBCRWKNucVeHpHMSMquAnN3zJVX_q-PuDh0DJA782knAX188P_7inuv_WnGLLH066uYf3p68f0Eecjyl4SJFG2RhdDWGTYudRsVLpyS3tzwWtA |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Advice+from+local%2Fsite+evaluators%3A+How+to+manage+%E2%80%9Cup%E2%80%9D+within+a+large%E2%80%90scale+initiative&rft.jtitle=New+directions+for+evaluation&rft.au=Hwalek%2C+Melanie&rft.au=Honor%C3%A9%2C+Matt&rft.au=Brown%2C+Shavonnea&rft.date=2022-01-01&rft.pub=Wiley+Subscription+Services%2C+Inc&rft.issn=1097-6736&rft.eissn=1534-875X&rft.volume=2022&rft.issue=174&rft.spage=79&rft.epage=95&rft_id=info:doi/10.1002%2Fev.20504&rft.externalDBID=NO_FULL_TEXT |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1097-6736&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1097-6736&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1097-6736&client=summon |