The Best of Both Worlds: Building on the COPUS and RTOP Observation Protocols to Easily and Reliably Measure Various Levels of Reformed Instructional Practice
Researchers, university administrators, and faculty members are increasingly interested in measuring and describing instructional practices provided in science, technology, engineering, and mathematics (STEM) courses at the college level. Specifically, there is keen interest in comparing instruction...
Saved in:
Published in | CBE life sciences education Vol. 14; no. 2; p. ar18 |
---|---|
Main Authors | , , , , , , |
Format | Journal Article |
Language | English |
Published |
United States
American Society for Cell Biology
01.06.2015
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | Researchers, university administrators, and faculty members are increasingly interested in measuring and describing instructional practices provided in science, technology, engineering, and mathematics (STEM) courses at the college level. Specifically, there is keen interest in comparing instructional practices between courses, monitoring changes over time, and mapping observed practices to research-based teaching. While increasingly common observation protocols (Reformed Teaching Observation Protocol [RTOP] and Classroom Observation Protocol in Undergraduate STEM [COPUS]) at the postsecondary level help achieve some of these goals, they also suffer from weaknesses that limit their applicability. In this study, we leverage the strengths of these protocols to provide an easy method that enables the reliable and valid characterization of instructional practices. This method was developed empirically via a cluster analysis using observations of 269 individual class periods, corresponding to 73 different faculty members, 28 different research-intensive institutions, and various STEM disciplines. Ten clusters, called COPUS profiles, emerged from this analysis; they represent the most common types of instructional practices enacted in the classrooms observed for this study. RTOP scores were used to validate the alignment of the 10 COPUS profiles with reformed teaching. Herein, we present a detailed description of the cluster analysis method, the COPUS profiles, and the distribution of the COPUS profiles across various STEM courses at research-intensive universities. |
---|---|
AbstractList | Researchers, university administrators, and faculty members are increasingly interested in measuring and describing instructional practices provided in science, technology, engineering, and mathematics (STEM) courses at the college level. Specifically, there is keen interest in comparing instructional practices between courses, monitoring changes over time, and mapping observed practices to research-based teaching. While increasingly common observation protocols (Reformed Teaching Observation Protocol [RTOP] and Classroom Observation Protocol in Undergraduate STEM [COPUS]) at the postsecondary level help achieve some of these goals, they also suffer from weaknesses that limit their applicability. In this study, we leverage the strengths of these protocols to provide an easy method that enables the reliable and valid characterization of instructional practices. This method was developed empirically via a cluster analysis using observations of 269 individual class periods, corresponding to 73 different faculty members, 28 different research-intensive institutions, and various STEM disciplines. Ten clusters, called COPUS profiles, emerged from this analysis; they represent the most common types of instructional practices enacted in the classrooms observed for this study. RTOP scores were used to validate the alignment of the 10 COPUS profiles with reformed teaching. Herein, we present a detailed description of the cluster analysis method, the COPUS profiles, and the distribution of the COPUS profiles across various STEM courses at research-intensive universities. The authors performed a cluster analysis using observational data from 269 class periods and including 73 science, technology, engineering, and mathematics (STEM) faculty from 28 research universities. They used eight of the 25 Classroom Observation Protocol in Undergraduate STEM codes to produce 10 clusters of instructional styles across a range of Reformed Teaching Observation Protocol scores. A description of the clusters and their distribution across various STEM courses are provided. Researchers, university administrators, and faculty members are increasingly interested in measuring and describing instructional practices provided in science, technology, engineering, and mathematics (STEM) courses at the college level. Specifically, there is keen interest in comparing instructional practices between courses, monitoring changes over time, and mapping observed practices to research-based teaching. While increasingly common observation protocols (Reformed Teaching Observation Protocol [RTOP] and Classroom Observation Protocol in Undergraduate STEM [COPUS]) at the postsecondary level help achieve some of these goals, they also suffer from weaknesses that limit their applicability. In this study, we leverage the strengths of these protocols to provide an easy method that enables the reliable and valid characterization of instructional practices. This method was developed empirically via a cluster analysis using observations of 269 individual class periods, corresponding to 73 different faculty members, 28 different research-intensive institutions, and various STEM disciplines. Ten clusters, called COPUS profiles, emerged from this analysis; they represent the most common types of instructional practices enacted in the classrooms observed for this study. RTOP scores were used to validate the alignment of the 10 COPUS profiles with reformed teaching. Herein, we present a detailed description of the cluster analysis method, the COPUS profiles, and the distribution of the COPUS profiles across various STEM courses at research-intensive universities. |
Audience | Higher Education Postsecondary Education |
Author | Pilarz, Matthew Velasco, Jonathan B Chakraverty, Devasmita Stains, Marilyne Lund, Travis J Undersander, Molly Rosploch, Kaitlyn |
Author_xml | – sequence: 1 fullname: Lund, Travis J – sequence: 2 fullname: Pilarz, Matthew – sequence: 3 fullname: Velasco, Jonathan B – sequence: 4 fullname: Chakraverty, Devasmita – sequence: 5 fullname: Rosploch, Kaitlyn – sequence: 6 fullname: Undersander, Molly – sequence: 7 fullname: Stains, Marilyne |
BackLink | http://eric.ed.gov/ERICWebPortal/detail?accno=EJ1097013$$DView record in ERIC https://www.ncbi.nlm.nih.gov/pubmed/25976654$$D View this record in MEDLINE/PubMed |
BookMark | eNpVkU9vEzEQxS1URP_AlRvIRy4bPGuvvcsBqYlCKQpKVFI4Wl7vbGO0WRd7N1K_DJ-1jlKicvKM3s9vxn7n5KT3PRLyFtgEoFQfbY0TEBmwjIEsX5AzqDhkqgJ-8qw-Jecx_mZMSAbFK3KaF5WSshBn5O96g3SKcaC-pVM_bOgvH7omfqLT0XWN6--o7-mQoNlydfuDmr6hN-vlii7riGFnBpfkVfCDt76LdPB0bqLrHg4gds7UqfmOJo4B6U8TnB8jXeAOE51G3mDrwxYbet3HIYx272e65GhSafE1edmaLuKbp_OC3H6Zr2dfs8Xy6np2ucisgHzIamWaGttKtDXLDW8KBozLXAkLbQGG1ShFjpJDw6xoc9byRtZlK3hZ5gqh4Rfk88H3fqzTNhb7IZhO3we3NeFBe-P0_0rvNvrO77QQSikuksGHJ4Pg_4zpP_XWRYtdZ3pML9YpHMilkKASOjmgNvgYA7bHMcD0PlSdQtUg9u0-1HTh_fPljvi_FBPw7gBgcPYoz78BqxQDzh8BcoarNQ |
CitedBy_id | crossref_primary_10_1186_s40594_018_0143_2 crossref_primary_10_1080_03043797_2021_1934406 crossref_primary_10_1002_sce_21175 crossref_primary_10_1187_cbe_17_12_0257 crossref_primary_10_1187_cbe_16_05_0162 crossref_primary_10_1080_10899995_2020_1768005 crossref_primary_10_1021_acs_jchemed_0c00399 crossref_primary_10_29333_ejmste_7833 crossref_primary_10_1126_science_aap8892 crossref_primary_10_1080_22054952_2018_1519984 crossref_primary_10_1080_87567555_2023_2221017 crossref_primary_10_1080_02602938_2016_1188057 crossref_primary_10_1187_cbe_17_04_0061 crossref_primary_10_1186_s40594_018_0128_1 crossref_primary_10_3389_feduc_2021_740344 crossref_primary_10_1021_acs_jchemed_6b00062 crossref_primary_10_1096_fasebj_30_1_supplement_662_17 crossref_primary_10_1126_sciadv_1600193 crossref_primary_10_2505_4_jcst19_049_01_31 crossref_primary_10_1187_cbe_15_10_0224 crossref_primary_10_1093_biosci_biab077 crossref_primary_10_1130_GES01479_1 crossref_primary_10_1186_s40594_020_00214_7 crossref_primary_10_1080_02602938_2019_1645091 crossref_primary_10_1093_biosci_biy145 crossref_primary_10_1080_13664530_2021_1905706 crossref_primary_10_1039_C8RP00104A crossref_primary_10_1021_acs_jchemed_9b01066 crossref_primary_10_1080_09500693_2024_2320060 crossref_primary_10_1187_cbe_16_06_0181 crossref_primary_10_1088_1361_6552_ac69a2 crossref_primary_10_1002_tea_21444 crossref_primary_10_1080_02602938_2017_1343799 crossref_primary_10_1080_87567555_2018_1463505 crossref_primary_10_1186_s40594_018_0154_z crossref_primary_10_1186_s40594_023_00407_w crossref_primary_10_3390_educsci12110736 crossref_primary_10_1080_0047231X_2022_12315651 crossref_primary_10_1186_s40594_022_00333_3 crossref_primary_10_3389_feduc_2022_1016415 crossref_primary_10_1187_cbe_18_07_0116 crossref_primary_10_1187_cbe_17_08_0180 crossref_primary_10_1371_journal_pone_0243731 crossref_primary_10_1108_JARHE_07_2023_0277 crossref_primary_10_1186_s40594_018_0100_0 crossref_primary_10_1186_s40594_023_00413_y crossref_primary_10_1007_s11165_016_9544_8 crossref_primary_10_1080_10899995_2024_2358727 crossref_primary_10_1080_0020739X_2024_2310620 crossref_primary_10_1002_rev3_3235 crossref_primary_10_1103_PhysRevPhysEducRes_12_020136 crossref_primary_10_61508_refl_v30i2_267417 crossref_primary_10_1186_s40594_022_00365_9 crossref_primary_10_1187_cbe_19_11_0260 crossref_primary_10_1016_j_heliyon_2021_e07352 crossref_primary_10_1128_jmbe_v18i1_1241 crossref_primary_10_1186_s40594_022_00340_4 crossref_primary_10_1080_0047231X_2022_12315663 crossref_primary_10_1187_cbe_15_12_0261 crossref_primary_10_1109_TE_2023_3259882 crossref_primary_10_1021_acs_jchemed_2c00269 crossref_primary_10_1187_cbe_21_08_0199 crossref_primary_10_1186_s40594_020_00251_2 crossref_primary_10_1186_s40594_015_0026_8 crossref_primary_10_1187_cbe_22_03_0047 crossref_primary_10_2505_4_jcst19_049_02_68 crossref_primary_10_1080_03043797_2021_1937946 crossref_primary_10_1007_s41979_020_00047_7 crossref_primary_10_1039_C5RP00225G crossref_primary_10_1187_cbe_21_03_0083 crossref_primary_10_1039_D0RP00125B crossref_primary_10_1186_s43031_019_0015_8 crossref_primary_10_1187_cbe_20_11_0259 crossref_primary_10_1080_09500693_2019_1649503 crossref_primary_10_1187_cbe_20_04_0077 crossref_primary_10_1007_s40670_023_01816_w crossref_primary_10_1187_cbe_15_03_0062 crossref_primary_10_1187_cbe_20_09_0218 crossref_primary_10_1021_acs_jchemed_5b00324 crossref_primary_10_1021_acs_jchemed_2c00973 crossref_primary_10_1128_jmbe_v20i3_1535 crossref_primary_10_3389_feduc_2017_00068 |
Cites_doi | 10.2307/256262 10.1187/cbe.14-06-0108 10.3102/00028312040003731 10.1021/ed500547n 10.1007/978-3-642-12541-6 10.1119/1.1374249 10.1525/bio.2011.61.7.9 10.1080/10508406.2012.729767 10.1103/PhysRevSTPER.3.020102 10.3102/00346543072002177 10.1007/s11092-011-9135-1 10.1145/568574.568575 10.1353/rhe.2012.0001 10.1119/1.3446763 10.1007/s11165-009-9163-8 10.1187/cbe.14-11-0198 10.1187/cbe.13-08-0154 10.1111/j.1949-8594.2002.tb17883.x 10.1111/j.1949-8594.2011.00091.x |
ContentType | Journal Article |
Copyright | 2015 T. J. Lund et al. CBE—Life Sciences Education © 2015 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0). 2015 T. J. Lund © 2015 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License ( ). 2015 |
Copyright_xml | – notice: 2015 T. J. Lund et al. CBE—Life Sciences Education © 2015 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0). – notice: 2015 T. J. Lund © 2015 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License ( ). 2015 |
DBID | 7SW BJH BNH BNI BNJ BNO ERI PET REK WWN CGR CUY CVF ECM EIF NPM AAYXX CITATION 7X8 5PM |
DOI | 10.1187/cbe.14-10-0168 |
DatabaseName | ERIC ERIC (Ovid) ERIC ERIC ERIC (Legacy Platform) ERIC( SilverPlatter ) ERIC ERIC PlusText (Legacy Platform) Education Resources Information Center (ERIC) ERIC Medline MEDLINE MEDLINE (Ovid) MEDLINE MEDLINE PubMed CrossRef MEDLINE - Academic PubMed Central (Full Participant titles) |
DatabaseTitle | ERIC MEDLINE Medline Complete MEDLINE with Full Text PubMed MEDLINE (Ovid) CrossRef MEDLINE - Academic |
DatabaseTitleList | MEDLINE CrossRef ERIC MEDLINE - Academic |
Database_xml | – sequence: 1 dbid: NPM name: PubMed url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 2 dbid: EIF name: MEDLINE url: https://proxy.k.utb.cz/login?url=https://www.webofscience.com/wos/medline/basic-search sourceTypes: Index Database – sequence: 3 dbid: ERI name: ERIC url: https://eric.ed.gov/ sourceTypes: Index Database |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Biology |
DocumentTitleAlternate | T. J. Lund et al |
EISSN | 1931-7913 |
ERIC | EJ1097013 |
Editor | Momsen, Jennifer |
Editor_xml | – sequence: 1 givenname: Jennifer surname: Momsen fullname: Momsen, Jennifer |
ExternalDocumentID | 10_1187_cbe_14_10_0168 25976654 EJ1097013 |
Genre | Research Support, U.S. Gov't, Non-P.H.S Journal Article |
GroupedDBID | --- 18M 29B 2WC 53G 5GY 6J9 6~0 6~1 7SW ABOPQ ABSQV ADBBV AENEX AIPOO ALMA_UNASSIGNED_HOLDINGS AOIJS BAWUL BJH BNH BNI BNJ BNO C1A DIK E3Z EBS EE- EJD EMOBN ERI F5P F9R GX1 H13 HYE IAO IER IGS INIJC M~E OK1 PET R0Z REK RHF RNS RPM TCB W8F WOQ WWN ZBA CGR CUY CVF ECM EIF NPM AAYXX CITATION 7X8 5PM |
ID | FETCH-LOGICAL-c412t-b7adbef94fb02a3d501036274c1f51a0be642e631d0c4f20f3d6b8f438827e1d3 |
IEDL.DBID | RPM |
ISSN | 1931-7913 |
IngestDate | Tue Sep 17 21:14:50 EDT 2024 Fri Jun 28 11:23:14 EDT 2024 Fri Aug 23 03:19:12 EDT 2024 Tue Aug 27 13:51:51 EDT 2024 Fri Sep 06 12:22:51 EDT 2024 |
IsDoiOpenAccess | true |
IsOpenAccess | true |
IsPeerReviewed | true |
IsScholarly | true |
Issue | 2 |
Language | English |
License | 2015 T. J. Lund et al. CBE—Life Sciences Education © 2015 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0). “ASCB®”and“ The American Society for Cell Biology ®” are regis-tered trademarks of The American Society for Cell Biology. |
LinkModel | DirectLink |
MergedId | FETCHMERGED-LOGICAL-c412t-b7adbef94fb02a3d501036274c1f51a0be642e631d0c4f20f3d6b8f438827e1d3 |
Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23 |
OpenAccessLink | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4477734/ |
PMID | 25976654 |
PQID | 1681264617 |
PQPubID | 23479 |
PageCount | 12 |
ParticipantIDs | pubmedcentral_primary_oai_pubmedcentral_nih_gov_4477734 proquest_miscellaneous_1681264617 crossref_primary_10_1187_cbe_14_10_0168 pubmed_primary_25976654 eric_primary_EJ1097013 |
PublicationCentury | 2000 |
PublicationDate | 2015-06-01 |
PublicationDateYYYYMMDD | 2015-06-01 |
PublicationDate_xml | – month: 06 year: 2015 text: 2015-06-01 day: 01 |
PublicationDecade | 2010 |
PublicationPlace | United States |
PublicationPlace_xml | – name: United States |
PublicationTitle | CBE life sciences education |
PublicationTitleAlternate | CBE Life Sci Educ |
PublicationYear | 2015 |
Publisher | American Society for Cell Biology |
Publisher_xml | – name: American Society for Cell Biology |
References | 24297289 - CBE Life Sci Educ. 2013 Winter;12(4):618-27 25713095 - CBE Life Sci Educ. 2015 Mar 2;14(1):es3 25452485 - CBE Life Sci Educ. 2014 Winter;13(4):624-35 B20 B21 Gafney L (B11) 2008 B22 Jones AP (B17) 1983; 26 Ebert-May D (B9) 2011; 61 Estivill-Castro V (B10) 2002; 4 B26 Piburn M (B24) 2000 B27 B28 B29 Hora M (B16) 2012; 22 Marshall JC (B19) 2011; 111 Amrein-Beardsley A (B2) 2011; 24 Sawada D (B25) 2002; 102 Dancy M (B8) 2010; 78 Council of Scientific Society Presidents and American Chemical Society (B6) 2013 Crouch CH (B7) 2001; 69 Hora M (B14) 2012; 35 Kane R (B18) 2002; 72 Park S (B23) 2010; 41 Budd DA (B4) 2013; 61 Henderson C (B13) 2007; 3 Hora M (B15) 2010 Gess-Newsome J (B12) 2003; 40 Baker LA (B3) 2014; 91 Carnegie Foundation for the Advancement of Teaching (B5) 2014 American Association for the Advancement of Science (B1) 2012 |
References_xml | – volume-title: The Teaching Dimensions Observation Protocol (TDOP), year: 2010 ident: B15 contributor: fullname: Hora M – start-page: 156 volume-title: In: Innovations in Science Education and Technology, ed. year: 2008 ident: B11 contributor: fullname: Gafney L – year: 2000 ident: B24 publication-title: Reformed Teaching Observation Protocol (RTOP) Reference Manual, contributor: fullname: Piburn M – volume: 26 start-page: 507 year: 1983 ident: B17 publication-title: Acad Manag J doi: 10.2307/256262 contributor: fullname: Jones AP – ident: B20 – ident: B28 doi: 10.1187/cbe.14-06-0108 – volume: 40 start-page: 731 year: 2003 ident: B12 publication-title: Am Educ Res J doi: 10.3102/00028312040003731 contributor: fullname: Gess-Newsome J – volume-title: The Role of Scientific Societies in STEM Faculty Workshops year: 2013 ident: B6 contributor: fullname: Council of Scientific Society Presidents and American Chemical Society – volume: 91 start-page: 1874 year: 2014 ident: B3 publication-title: J Chem Educ doi: 10.1021/ed500547n contributor: fullname: Baker LA – volume: 61 start-page: 461 year: 2013 ident: B4 publication-title: J Geosci Educ contributor: fullname: Budd DA – ident: B21 doi: 10.1007/978-3-642-12541-6 – volume: 69 start-page: 970 year: 2001 ident: B7 publication-title: Am J Phys doi: 10.1119/1.1374249 contributor: fullname: Crouch CH – volume: 61 start-page: 550 year: 2011 ident: B9 publication-title: Bioscience doi: 10.1525/bio.2011.61.7.9 contributor: fullname: Ebert-May D – volume: 22 start-page: 212 year: 2012 ident: B16 publication-title: J Learn Sci doi: 10.1080/10508406.2012.729767 contributor: fullname: Hora M – volume: 3 start-page: 20102 year: 2007 ident: B13 publication-title: Phys Rev Spec Top Phys Educ Res doi: 10.1103/PhysRevSTPER.3.020102 contributor: fullname: Henderson C – volume: 72 start-page: 177 year: 2002 ident: B18 publication-title: Rev Educ Res doi: 10.3102/00346543072002177 contributor: fullname: Kane R – volume: 24 start-page: 5 issue: 1 year: 2011 ident: B2 publication-title: Educ Assessment Eval Account doi: 10.1007/s11092-011-9135-1 contributor: fullname: Amrein-Beardsley A – volume: 4 start-page: 65 year: 2002 ident: B10 publication-title: SIGKDD Explorations doi: 10.1145/568574.568575 contributor: fullname: Estivill-Castro V – ident: B26 – volume: 35 start-page: 207 year: 2012 ident: B14 publication-title: Rev High Educ doi: 10.1353/rhe.2012.0001 contributor: fullname: Hora M – volume: 78 start-page: 1056 year: 2010 ident: B8 publication-title: Am J Phys doi: 10.1119/1.3446763 contributor: fullname: Dancy M – ident: B22 – volume: 41 start-page: 245 year: 2010 ident: B23 publication-title: Res Sci Educ doi: 10.1007/s11165-009-9163-8 contributor: fullname: Park S – ident: B29 doi: 10.1187/cbe.14-11-0198 – volume-title: Describing and Measuring Undergraduate STEM Teaching Practices. year: 2012 ident: B1 contributor: fullname: American Association for the Advancement of Science – volume-title: The Carnegie Classification of Institutions of Higher Education. year: 2014 ident: B5 contributor: fullname: Carnegie Foundation for the Advancement of Teaching – ident: B27 doi: 10.1187/cbe.13-08-0154 – volume: 102 start-page: 245 year: 2002 ident: B25 publication-title: Sch Sci Math doi: 10.1111/j.1949-8594.2002.tb17883.x contributor: fullname: Sawada D – volume: 111 start-page: 306 year: 2011 ident: B19 publication-title: Sch Sci Math doi: 10.1111/j.1949-8594.2011.00091.x contributor: fullname: Marshall JC |
SSID | ssj0046015 |
Score | 2.39404 |
Snippet | Researchers, university administrators, and faculty members are increasingly interested in measuring and describing instructional practices provided in... The authors performed a cluster analysis using observational data from 269 class periods and including 73 science, technology, engineering, and mathematics... |
SourceID | pubmedcentral proquest crossref pubmed eric |
SourceType | Open Access Repository Aggregation Database Index Database |
StartPage | ar18 |
SubjectTerms | Classroom Observation Techniques Cluster Analysis College Science Comparative Analysis Correlation Educational Change Educational Measurement Educational Practices Engineering - education Higher Education Humans Mathematics - education Multivariate Analysis Observation Questioning Techniques Research - education Science - education Science Instruction STEM Education Students Teaching Teaching Experience Teaching Methods Technology - education United States (Midwest) |
Title | The Best of Both Worlds: Building on the COPUS and RTOP Observation Protocols to Easily and Reliably Measure Various Levels of Reformed Instructional Practice |
URI | http://eric.ed.gov/ERICWebPortal/detail?accno=EJ1097013 https://www.ncbi.nlm.nih.gov/pubmed/25976654 https://search.proquest.com/docview/1681264617 https://pubmed.ncbi.nlm.nih.gov/PMC4477734 |
Volume | 14 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1db9MwFLW2SUi8oPExCLDpIiHxlDWpvxLeaNVpTJRGY0V7i-zYFpW6ZFrKw_4Mv5XrOOlWHnmM4nwo58Y-xz6-l5CPziSZdgn2ftLmMY5QJtY6YbEaWyF0rgW3fnPy_Ls4X7KLa369R_iwF6Yz7Vd6dVqvb07r1a_OW3l7U40Gn9iomE8Zk1JSNton-5LSQaKH7pehwuBhKTn1uRhpn6kxzeSo0hZ7hmDFEr5SH3J_6cvv7gxKu77nR4TzX9_ko4Ho7JA86xkkfAlv-pzs2foFeRJqSt6_JH8QeJjgDaFxMEEcoPPLtJ9h0lfAhqYGpH0wXRTLH6BqA5dXiwIWejtBC8Vds2kwRFrYNDBT7Wp9Hxra9UppPJiHqUX4iVK7-d3CN-89av0jL62nwdbA14fctPi6Rb8b6xVZns2upudxX4Qhrlg63sRaKqOty5nTyVhRw31hCF-wp0odT1WiLSoYKxDkpGJunDhqhM4co0jdpU0NPSIHdVPbNwSQqXChcofalzPtWI7xw0zqKDe5yHITkU8DCuVtyLVRdholkyVChyrFH3roInLkQdq2ml34hXRksxH5MMBW4n_iFz9UbfE7lKlPtCYYEraIvA4wbi8fwiAicgfgbQOfg3v3DIZml4u7D8W3_33lO_IUORgP7rP35ACRscfIczb6pNPyJ110_wXlyv5Z |
link.rule.ids | 220,230,315,733,786,790,891,27957,27958,53827,53829 |
linkProvider | National Library of Medicine |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1bb9MwFD4aQwheuA_C1UhIPKXNxY4T3mjVqRvtGo122lsUx7ao6JKJZA_jx_BbOY6Tsu4NHi3byuV8tr9jfz4H4KOWXiy0h7MfV4mLK5R0hfComwcqikQiIqbM5eT5STRd0eNzdr4HrL8L04r2C7EelJuLQbn-3morLy-KYa8TG6bzMaWc85AO78BdHK8B7510OwFT9DGYPUz2TTTGsIvV6Md8WAiFc4MVY0UmVx-yf24S8O4sS7vK5xuU87Zy8sZSdPgIzvqPsAqUH4OrRgyKX7fiO_7zVz6Ghx05JV9s9RPYU-VTuGfTVV4_g9-IKTLCNyWVJiM0MWmlOPVnMuqSa5OqJMgoyXiRrr6RvJTkdLlIyUJs935J-rNqKkRfTZqKTPJ6vbm2DdVmnQsszO2uJTlDL766qsnMyJpq88hTZRi2kuTob9hbfN20u-j1HFaHk-V46nb5HdyC-kHjCp5LoXRCtfCCPJTM5JwwuYAKXzM_94RC50hFiB-voDrwdCgjEWsaolfAlS_DA9gvq1K9BIIkiEV5otGtZlRomiA0qfR1yGQSxYl04FNv3uzShvHIWvcn5hliAh0gUzSYcODAWH_banJszuiRKDvwocdDhkPQnKvkpcL_kPkmhltEkQs68MLiY9u9x5cDfAc52wYmvPduDeKhDfPd2f_Vf_d8D_eny_ksmx2dfH0ND5DqMStyewP7aCX1FulUI961g-cP7iwfYw |
linkToPdf | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1bb9MwGP0EQyBeuA_C1UhIPKW5OXbCGy2ttrGu0VjRxEsUx7ao6JKKdA_jx_Bb-Rwnpd3jHqPYysXH9jn28fcBfNDST4T2cfTjKnVxhpKuED51i1AxJlLBYmUOJ09P2MGcHp3H51upvlrTfikWg2p5MagWP1tv5eqi9HqfmJdNR5RyziPqraT2bsMd7LNh2gt1OwhT1Bmx3VAOTETGqIvXGCTcK4XC8cEaspjJ14cKgJskvDtT0677eYt2XndPbk1Hk4fwo_8Q60L5Nbhci0H551qMxxt96SN40JFU8tkWeQy3VPUE7tq0lVdP4S9iiwzxbUmtyRCbmrSWnOYTGXZJtkldEWSWZDTL5t9IUUlyejbLyExs1oBJ9rte14jChqxrMi6axfLKFlTLRSHwYmpXL8l3VPP1ZUOOjb2pMY88VYZpK0kO_4e_xdfNugNfz2A-GZ-NDtwuz4Nb0iBcu4IXUiidUi38sIhkbHJPmJxAZaDjoPCFQpGkGOLIL6kOfR1JJhJNI1QHXAUy2oe9qq7UCyBIhmJWpBrldUyFpilClMpAR7FMWZJKBz72TZyvbDiPvJVBCc8RFyiEzKXBhQP7BgGbUuMjs1ePhNmB9z0mcuyKZn-lqBT-hzwwsdwYRU7owHOLkU31HmMO8B30bAqYMN-7dxATbbjvDgMvb1zzHdzLvkzy48OTr6_gPjK-2HrdXsMeNpJ6g6xqLd62_ecf6FQh4w |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+best+of+both+worlds%3A+Building+on+the+COPUS+and+RTOP+observation+protocols+to+easily+and+reliably+measure+various+levels+of+reformed+instructional+practice&rft.jtitle=CBE+life+sciences+education&rft.au=Lund%2C+Travis+J&rft.au=Pilarz%2C+Matthew&rft.au=Velasco%2C+Jonathan+B&rft.au=Chakraverty%2C+Devasmita&rft.date=2015-06-01&rft.eissn=1931-7913&rft.volume=14&rft.issue=2&rft_id=info:doi/10.1187%2Fcbe.14-10-0168&rft.externalDBID=NO_FULL_TEXT |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1931-7913&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1931-7913&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1931-7913&client=summon |