Educational impact of in-training assessment (ITA) in postgraduate medical education: a qualitative study of an ITA programme in actual practice

Objectives  To investigate the experiences and opinions of programme directors, clinical supervisors and trainees on an in‐training assessment (ITA) programme on a broad spectrum of competence for first year training in anaesthesiology. How does the programme work in practice and what are the benefi...

Full description

Saved in:
Bibliographic Details
Published inMedical education Vol. 38; no. 7; pp. 767 - 777
Main Authors Ringsted, C, Henriksen, A H, Skaarup, A M, Van der Vleuten, C P M
Format Journal Article
LanguageEnglish
Published Oxford, UK Blackwell Science Ltd 01.07.2004
Blackwell
Wiley Subscription Services, Inc
Subjects
Online AccessGet full text
ISSN0308-0110
1365-2923
DOI10.1111/j.1365-2929.2004.01841.x

Cover

Abstract Objectives  To investigate the experiences and opinions of programme directors, clinical supervisors and trainees on an in‐training assessment (ITA) programme on a broad spectrum of competence for first year training in anaesthesiology. How does the programme work in practice and what are the benefits and barriers? What are the users' experiences and thoughts about its effect on training, teaching and learning? What are their attitudes towards this concept of assessment? Methods  Semistructured interviews were conducted with programme directors, supervisors and trainees from 3 departments. Interviews were audiotaped and transcribed. The content of the interviews was analysed in a consensus process among the authors. Results  The programme was of benefit in making goals and objectives clear, in structuring training, teaching and learning, and in monitoring progress and managing problem trainees. There was a generally positive attitude towards assessment. Trainees especially appreciated the coupling of theory with practice and, in general, the programme inspired an academic dialogue. Issues of uncertainty regarding standards of performance and conflict with service declined over time and experience with the programme, and departments tended to resolve practical problems through structured planning. Discussion  Three interrelated factors appeared to influence the perceived value of assessment in postgraduate education: (1) the link between patient safety and individual practice when assessment is used as a licence to practise without supervision rather than as an end‐of‐training examination; (2) its benefits to educators and learners as an educational process rather than as merely a method of documenting competence, and (3) the attitude and rigour of assessment practice.
AbstractList Objectives  To investigate the experiences and opinions of programme directors, clinical supervisors and trainees on an in‐training assessment (ITA) programme on a broad spectrum of competence for first year training in anaesthesiology. How does the programme work in practice and what are the benefits and barriers? What are the users' experiences and thoughts about its effect on training, teaching and learning? What are their attitudes towards this concept of assessment? Methods  Semistructured interviews were conducted with programme directors, supervisors and trainees from 3 departments. Interviews were audiotaped and transcribed. The content of the interviews was analysed in a consensus process among the authors. Results  The programme was of benefit in making goals and objectives clear, in structuring training, teaching and learning, and in monitoring progress and managing problem trainees. There was a generally positive attitude towards assessment. Trainees especially appreciated the coupling of theory with practice and, in general, the programme inspired an academic dialogue. Issues of uncertainty regarding standards of performance and conflict with service declined over time and experience with the programme, and departments tended to resolve practical problems through structured planning. Discussion  Three interrelated factors appeared to influence the perceived value of assessment in postgraduate education: (1) the link between patient safety and individual practice when assessment is used as a licence to practise without supervision rather than as an end‐of‐training examination; (2) its benefits to educators and learners as an educational process rather than as merely a method of documenting competence, and (3) the attitude and rigour of assessment practice.
OBJECTIVESTo investigate the experiences and opinions of programme directors, clinical supervisors and trainees on an in-training assessment (ITA) programme on a broad spectrum of competence for first year training in anaesthesiology. How does the programme work in practice and what are the benefits and barriers? What are the users' experiences and thoughts about its effect on training, teaching and learning? What are their attitudes towards this concept of assessment?METHODSSemistructured interviews were conducted with programme directors, supervisors and trainees from 3 departments. Interviews were audiotaped and transcribed. The content of the interviews was analysed in a consensus process among the authors.RESULTSThe programme was of benefit in making goals and objectives clear, in structuring training, teaching and learning, and in monitoring progress and managing problem trainees. There was a generally positive attitude towards assessment. Trainees especially appreciated the coupling of theory with practice and, in general, the programme inspired an academic dialogue. Issues of uncertainty regarding standards of performance and conflict with service declined over time and experience with the programme, and departments tended to resolve practical problems through structured planning.DISCUSSIONThree interrelated factors appeared to influence the perceived value of assessment in postgraduate education: (1) the link between patient safety and individual practice when assessment is used as a licence to practise without supervision rather than as an end-of-training examination; (2) its benefits to educators and learners as an educational process rather than as merely a method of documenting competence, and (3) the attitude and rigour of assessment practice.
To investigate the experiences and opinions of programme directors, clinical supervisors and trainees on an in-training assessment (ITA) programme on a broad spectrum of competence for first year training in anaesthesiology. How does the programme work in practice and what are the benefits and barriers? What are the users' experiences and thoughts about its effect on training, teaching and learning? What are their attitudes towards this concept of assessment? Semistructured interviews were conducted with programme directors, supervisors and trainees from 3 departments. Interviews were audiotaped and transcribed. The content of the interviews was analysed in a consensus process among the authors. The programme was of benefit in making goals and objectives clear, in structuring training, teaching and learning, and in monitoring progress and managing problem trainees. There was a generally positive attitude towards assessment. Trainees especially appreciated the coupling of theory with practice and, in general, the programme inspired an academic dialogue. Issues of uncertainty regarding standards of performance and conflict with service declined over time and experience with the programme, and departments tended to resolve practical problems through structured planning. Three interrelated factors appeared to influence the perceived value of assessment in postgraduate education: (1) the link between patient safety and individual practice when assessment is used as a licence to practise without supervision rather than as an end-of-training examination; (2) its benefits to educators and learners as an educational process rather than as merely a method of documenting competence, and (3) the attitude and rigour of assessment practice.
Author Henriksen, A H
Ringsted, C
Van der Vleuten, C P M
Skaarup, A M
Author_xml – sequence: 1
  givenname: C
  surname: Ringsted
  fullname: Ringsted, C
  organization: Copenhagen Hospital Corporation (CHC), Postgraduate Medical Institute, Bispebjerg Hospital, Copenhagen, Denmark
– sequence: 2
  givenname: A H
  surname: Henriksen
  fullname: Henriksen, A H
  organization: Copenhagen Hospital Corporation (CHC), Postgraduate Medical Institute, Bispebjerg Hospital, Copenhagen, Denmark
– sequence: 3
  givenname: A M
  surname: Skaarup
  fullname: Skaarup, A M
  organization: Copenhagen Hospital Corporation (CHC), Postgraduate Medical Institute, Bispebjerg Hospital, Copenhagen, Denmark
– sequence: 4
  givenname: C P M
  surname: Van der Vleuten
  fullname: Van der Vleuten, C P M
  organization: Department of Educational Development & Research, Maastricht University, Maastricht, the Netherlands
BackLink http://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&idt=15959446$$DView record in Pascal Francis
https://www.ncbi.nlm.nih.gov/pubmed/15200401$$D View this record in MEDLINE/PubMed
BookMark eNqNktFu0zAYhS00xLrBKyALCQQXCXYcOw4XSNNWxqQxBOoEd5bjOJNL4nR2Au1b8Mj8WdsJ7QZyEzs-5zvR8X-EDnzvLUKYkpTC83aZUiZ4kpVZmWaE5CmhMqfp-hGa7Q_YAZoRRmRCKCWH6CjGJSGk4Ll8gg4pn1yEztDveT0aPbje6xa7bqXNgPsGO58MQTvv_A3WMdoYO-sH_PpicfIGDvGqj8NN0PWoB4s7WzsDdrtHvcMa3466dQNsf1och7HeTFjtMRDwKvRg7jo7oSARpPANFs7Yp-hxo9ton-3ex-j6w3xx-jG5_Hx-cXpymZhcUJpoUomSF6YuSFZyyaioatqYguScZWUttcxZSS0lxjBdSW0rwaWtCCtYTY3g7Bi92nLhZ25HGwfVuWhs22pv-zEqIQSTXEgQvnggXPZjgLqiyiCblYRmIHq-E40V1KFWwXU6bNS-aBC83Al0hK6aoL1x8S9dycs8F6B7v9WZ0McYbKPMXYu9n-6jVZSoaQLUUk0XraYJUFOEupsAtQaAfAC4z_i3dZf9y7V2898-9Wl-dj0tAZBsAS4Odn0P0OGHEgUruPp2da6uJP2--JqfqS_sD7cx1sg
CitedBy_id crossref_primary_10_1111_j_1365_2923_2008_03124_x
crossref_primary_10_1186_s12909_017_1016_y
crossref_primary_10_1002_jdd_12871
crossref_primary_10_1111_j_1365_2929_2006_02525_x
crossref_primary_10_1177_0310057X1304100509
crossref_primary_10_1186_s12909_018_1262_7
crossref_primary_10_1136_bmjopen_2020_040290
crossref_primary_10_7899_JCE_14_14
crossref_primary_10_1111_medu_12081
crossref_primary_10_1080_01421590500237721
crossref_primary_10_14324_LRE_21_1_40
crossref_primary_10_1186_1472_6920_10_46
crossref_primary_10_1007_s00787_008_0700_1
crossref_primary_10_1111_j_1365_2929_2004_02018_x
crossref_primary_10_47102_annals_acadmedsg_V36N9p719
crossref_primary_10_1111_j_1365_2923_2008_03111_x
crossref_primary_10_3138_jvme_0514_057R1
crossref_primary_10_1186_s12909_018_1446_1
crossref_primary_10_1111_j_1365_2923_2008_03235_x
crossref_primary_10_1111_ajd_12376
crossref_primary_10_1111_medu_13775
crossref_primary_10_3109_0142159X_2013_803061
crossref_primary_10_1177_0310057X1103900105
crossref_primary_10_1186_1472_6920_13_123
crossref_primary_10_1111_medu_12273
crossref_primary_10_1186_s12909_023_04695_2
crossref_primary_10_1007_s10459_021_10071_w
crossref_primary_10_1097_ACM_0000000000000394
Cites_doi 10.1007/978-94-010-0462-6_26
10.1007/BF00596229
10.1046/j.1525-1497.2000.06099.x
10.1046/j.1365-2044.2002.27092.x
10.7326/0003-4819-117-9-757
10.1093/bja/75.6.805
10.1080/0142159021000061431
10.1111/j.1365-2923.1983.tb00657.x
10.1080/01421590050110786
10.1046/j.1399-6576.2003.00255.x
10.1046/j.1365-2923.2002.01099.x
10.1046/j.1365-2923.1998.00231.x
10.1034/j.1399-6576.2002.460910.x
10.1046/j.1365-2923.1999.00285.x
10.1097/00001888-199307000-00003
10.1080/01421590310001605642
10.1097/00001888-200209000-00020
10.1097/00001888-200012000-00009
10.1111/j.1365-2923.1988.tb00798.x
10.1046/j.1365-2923.2002.01314.x
10.1097/00001888-199009000-00045
10.1097/00001888-199910000-00056
10.1097/00001888-200107000-00023
10.1007/BF02598008
10.1046/j.1525-1497.1998.00097.x
10.1109/TSMC.1983.6313160
10.1046/j.1365-2923.2000.00755.x
10.1007/978-94-010-0462-6_29
ContentType Journal Article
Copyright 2004 INIST-CNRS
Copyright Blackwell Scientific Publications Ltd. Jul 2004
Copyright_xml – notice: 2004 INIST-CNRS
– notice: Copyright Blackwell Scientific Publications Ltd. Jul 2004
DBID BSCLL
AAYXX
CITATION
IQODW
CGR
CUY
CVF
ECM
EIF
NPM
K9.
7X8
DOI 10.1111/j.1365-2929.2004.01841.x
DatabaseName Istex
CrossRef
Pascal-Francis
Medline
MEDLINE
MEDLINE (Ovid)
MEDLINE
MEDLINE
PubMed
ProQuest Health & Medical Complete (Alumni)
MEDLINE - Academic
DatabaseTitle CrossRef
MEDLINE
Medline Complete
MEDLINE with Full Text
PubMed
MEDLINE (Ovid)
ProQuest Health & Medical Complete (Alumni)
MEDLINE - Academic
DatabaseTitleList
MEDLINE - Academic
MEDLINE
Database_xml – sequence: 1
  dbid: NPM
  name: PubMed
  url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed
  sourceTypes: Index Database
– sequence: 2
  dbid: EIF
  name: MEDLINE
  url: https://proxy.k.utb.cz/login?url=https://www.webofscience.com/wos/medline/basic-search
  sourceTypes: Index Database
DeliveryMethod fulltext_linktorsrc
Discipline Medicine
Education
EISSN 1365-2923
EndPage 777
ExternalDocumentID 665953851
15200401
15959446
10_1111_j_1365_2929_2004_01841_x
MEDU1841
ark_67375_WNG_N81XTR4D_Q
Genre article
Research Support, Non-U.S. Gov't
Multicenter Study
Journal Article
General Information
GeographicLocations Denmark
GeographicLocations_xml – name: Denmark
GroupedDBID ---
-W8
.3N
.55
.GA
.GJ
.GO
.Y3
04C
05W
0R~
10A
1OB
1OC
29M
31~
33P
36B
3O-
3SF
4.4
50Y
50Z
51W
51X
52M
52N
52O
52P
52R
52S
52T
52U
52V
52W
52X
53G
5GY
5HH
5LA
5RE
5VS
66C
6PF
702
7PT
8-0
8-1
8-3
8-4
8-5
8UM
930
A01
A03
AAESR
AAEVG
AAHHS
AAHSB
AANLZ
AAONW
AASGY
AAWTL
AAXRX
AAZKR
ABCQN
ABCUV
ABDBF
ABEML
ABIVO
ABJNI
ABLJU
ABPVW
ABQWH
ABXGK
ACAHQ
ACBWZ
ACCFJ
ACCZN
ACFBH
ACGFS
ACGOF
ACMXC
ACPOU
ACSCC
ACXBN
ACXQS
ADBBV
ADBTR
ADEOM
ADIZJ
ADKYN
ADMGS
ADOJX
ADOZA
ADXAS
ADZMN
AEEZP
AEIGN
AEIMD
AENEX
AEQDE
AEUQT
AEUYR
AFBPY
AFEBI
AFFNX
AFFPM
AFGKR
AFPWT
AFZJQ
AHBTC
AHEFC
AHMBA
AIACR
AITYG
AIURR
AIWBW
AJBDE
ALAGY
ALMA_UNASSIGNED_HOLDINGS
ALUQN
AMBMR
AMYDB
ATUGU
AZBYB
AZFZN
AZVAB
BAFTC
BDRZF
BFHJK
BHBCM
BMSDO
BMXJE
BROTX
BRXPI
BSCLL
BY8
C45
CAG
COF
CS3
D-6
D-7
D-E
D-F
DCZOG
DPXWK
DR2
DRFUL
DRMAN
DRSTM
DU5
DUUFO
EAD
EAP
EAS
EBC
EBD
EBS
ECF
ECT
ECV
EDJ
EIHBH
EJD
EMB
EMK
EMOBN
ENB
ENC
ENX
EPS
EPT
ESX
EX3
F00
F01
F04
F5P
FEDTE
FUBAC
G-S
G.N
GODZA
H.X
HF~
HGLYW
HVGLF
HZI
HZ~
IHE
IX1
J0M
K48
KBYEO
L7B
LATKE
LC2
LC3
LEEKS
LH4
LITHE
LOXES
LP6
LP7
LUTES
LW6
LYRES
MEWTI
MK4
MRFUL
MRMAN
MRSTM
MSFUL
MSMAN
MSSTM
MXFUL
MXMAN
MXSTM
N04
N05
N9A
NF~
O66
O9-
OHT
OIG
OVD
P2W
P2X
P2Z
P4B
P4D
PALCI
PQQKQ
Q.N
Q11
QB0
Q~Q
R.K
RJQFR
ROL
RX1
SAMSI
SUPJJ
SV3
TEORI
TUS
UB1
W8V
W99
WBKPD
WH7
WHWMO
WIH
WIJ
WIK
WOHZO
WOW
WQ9
WQJ
WRC
WVDHM
WXI
WXSBR
X7M
XG1
YFH
ZGI
ZXP
ZZTAW
~IA
~WT
AAHQN
AAIPD
AAMNL
AANHP
AAYCA
ACRPL
ACUHS
ACYXJ
ADNMO
AFWVQ
ALVPJ
AAYXX
AEYWJ
AGHNM
AGQPQ
AGYGG
CITATION
ABSRN
ACSMX
ACXME
IQODW
CGR
CUY
CVF
ECM
EIF
NPM
AAMMB
AEFGJ
AGXDD
AIDQK
AIDYY
K9.
7X8
ID FETCH-LOGICAL-c4611-a0b6957cd702958316bd1fc7045329d8a84391e10cc3ab8aeb658eb0373d1c653
IEDL.DBID DR2
ISSN 0308-0110
IngestDate Thu Jul 10 22:05:50 EDT 2025
Mon Jul 14 09:37:39 EDT 2025
Wed Feb 19 01:42:02 EST 2025
Wed Jun 26 17:57:42 EDT 2024
Tue Jul 01 00:27:53 EDT 2025
Thu Apr 24 23:08:12 EDT 2025
Wed Jan 22 16:29:28 EST 2025
Wed Oct 30 09:58:01 EDT 2024
IsPeerReviewed true
IsScholarly true
Issue 7
Keywords Medicine
Evaluation
Curriculum
Graduate
Programme attitude
Evaluation Criterion
Language English
License http://doi.wiley.com/10.1002/tdm_license_1.1
CC BY 4.0
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c4611-a0b6957cd702958316bd1fc7045329d8a84391e10cc3ab8aeb658eb0373d1c653
Notes istex:93FE06BDDA2ED4887090E9A8A4DC76A276745F9A
ark:/67375/WNG-N81XTR4D-Q
ArticleID:MEDU1841
SourceType-Scholarly Journals-1
ObjectType-General Information-1
content type line 14
ObjectType-Article-1
ObjectType-Feature-2
content type line 23
PMID 15200401
PQID 202939012
PQPubID 35751
PageCount 11
ParticipantIDs proquest_miscellaneous_66638568
proquest_journals_202939012
pubmed_primary_15200401
pascalfrancis_primary_15959446
crossref_citationtrail_10_1111_j_1365_2929_2004_01841_x
crossref_primary_10_1111_j_1365_2929_2004_01841_x
wiley_primary_10_1111_j_1365_2929_2004_01841_x_MEDU1841
istex_primary_ark_67375_WNG_N81XTR4D_Q
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate July 2004
PublicationDateYYYYMMDD 2004-07-01
PublicationDate_xml – month: 07
  year: 2004
  text: July 2004
PublicationDecade 2000
PublicationPlace Oxford, UK
PublicationPlace_xml – name: Oxford, UK
– name: Oxford
– name: England
PublicationTitle Medical education
PublicationTitleAlternate Med Educ
PublicationYear 2004
Publisher Blackwell Science Ltd
Blackwell
Wiley Subscription Services, Inc
Publisher_xml – name: Blackwell Science Ltd
– name: Blackwell
– name: Wiley Subscription Services, Inc
References Finucane PM, Barron SR, Davies HA, Hadfield-Jones RS, Kaigas TM. Towards an acceptance of performance assessment. Med Educ 2002;36: 959-64.
Turnbull F, MacFadyen J, Van Barneveld C, Norman G. Clinical work sampling. A new approach to the problem of in-training evaluation. J Gen Intern Med 2000;15: 556-61.
Spike N, Alexander H, Elliott S, Hazlett C, Kilminster S, Prideaux D, Roberts T. In-training assessment - its potential in enhancing clinical teaching. Med Educ 2000;34: 858-61.
Baker JD, Cooke JE, Contoy JM, Bromley HR, Hollon MF, Alpert CC. Beyond career choice: the role of learning style analysis in residency training. Med Educ 1988;22: 527-32.
Friedman Ben-David M. The role of assessment in expanding professional horizons. Med Teach 2000;22: 472-7.
Miller GE. The assessment of clinical skills/competence/performance. Acad Med 1990;65 (Suppl):63-7.
Patel BS, Feerick A. Will competency assessment improve the training and skills of the trainee anaesthetist? Anaesthesia 2002;57: 710-31.
Newble DI, Jaeger K. The effect of assessments and examinations on the learning of medical students. Med Educ 1983;17: 165-71.
Hays R, Wellard R. In-training assessment in postgraduate training for general practice. Med Educ 1998;32: 507-13.
Noel GL, Herbers JE, Caplow MP, Cooper GS, Pangaro JN, Harvey J. How well do internal medicine faculty members evaluate the clinical skills of residents? Ann Intern Med 1992;117: 757-65.
Kestin IG. A statistical approach to measuring the competence of anaesthetic trainees at practical procedures. Br J Anaesth 1995;75: 805-9.
Rasmussen J. Skills, rules, knowledge, signals, signs and symbols and other distinctions in human performance models. IEEE Trans Systems Man Cybernetics 1983;123: 257-66.
Short JP. The importance of strong evaluation standards and procedures in training residents. Acad Med 1993;68: 522-5.
Prescott LE, Norcini JJ, McKinlay P, Rennie JS. Facing the challenges of competency-based assessment of postgraduate dental training: longitudinal evaluation of performance (LEP). Med Educ 2002;36: 92-7.
Durning SJ, Lannie JC, Markert RJ, Pangaro LN. Assessing the reliability and validity of the mini-clinical evaluation exercise for internal medicine residency training. Acad Med 2002;77: 900-4.
Kroboth FJ, Hanusa BH, Parker S, Coulehan JL, Kapoor WN, Brown FH, Karpf M, Levey GS. The interrater reliability and internal consistency of a clinical evaluation exercise. J Gen Intern Med 1992;7: 174-9.
Long DM. Competency-based residency training: the next advance in graduate medical education. Acad Med 2000;75: 1178-83.
Turnbull J, Gray J, MacFadyen J. Improving in-training evaluation programmes. J Gen Intern Med 1998;13: 317-23.
Van der Vleuten CPM. The assessment of professional competence: developments, research and practical implications. Adv Health Sci Educ 1996;1: 41-67.
Reisdorff EJ, Hayes OW, Carlson DJ, Walker GL. Assessing the new general competencies for resident education: a model from an emergency medicine programme. Acad Med 2001;76: 753-7.
Yukowsky R. Can resident evaluations demonstrate increases in residents' skills over time? Acad Med 1999;74 (Suppl):108-10.
McManus IC, Winder BC, Gordon D. UK doctors' attitudes to the General Medical Council's performance procedures, 1997-99. Med Educ 2001;35 (Suppl):60-9.
Ringsted C, Østergaard D, Scherpbier A. Embracing the new paradigm of assessment in residency training. An assessment programme for first year residency training in anaesthesiology. Med Teach 2003;25: 54-62.
Ringsted C, Østergaard D, Scherpbier A. Consultants' opinion on a new practice-based assessment programme for first year trainees in anaesthesiology. Acta Anaesthesiol Scand 2002;46: 1119-23.
Dolmans D, Schmidt A, Van Der Beck J, Beintema M, Gerver WJ. Does a student log provide a means to better structure clinical education? Med Educ 1999;33: 89-94.
1995; 75
1993; 68
2002; 36
2000; 22
2002; 57
2002; 77
1994
2002
1983; 17
1992; 7
1990; 65
1983; 123
2000; 15
2000; 34
2002; 46
2000; 75
2003; 25
1992; 117
2003; 47
1988; 22
1999; 33
1996; 1
1999; 74
1998; 32
2001; 35
1998; 13
2001; 76
Noel GL (b17_190) 1992; 117
Short JP (b2_175) 1993; 68
Turnbull J (b6_179) 2002
Petrusa ER (b27_200) 2002
Rasmussen J (b23_196) 1983; 123
b1_174
b24_197
b13_186
Patel BS (b20_193) 2002; 57
Durning SJ (b14_187) 2002; 77
b3_176
Kroboth FJ (b18_191) 1992; 7
b19_192
b29_202
b12_185
b16_189
Reisdorff EJ (b11_184) 2001; 76
Baker JD (b30_203) 1988; 22
Newble DI (b26_199) 1983; 17
b4_177
Van der Vleuten CPM (b9_182) 1996; 1
Yukowsky R (b15_188) 1999; 74
Long DM (b7_180) 2000; 75
McManus IC (b28_201) 2001; 35
Miller GE (b8_181) 1990; 65
Kestin IG (b22_195) 1995; 75
Feletti G (b5_178) 1994
b21_194
b25_198
b10_183
References_xml – reference: Long DM. Competency-based residency training: the next advance in graduate medical education. Acad Med 2000;75: 1178-83.
– reference: Spike N, Alexander H, Elliott S, Hazlett C, Kilminster S, Prideaux D, Roberts T. In-training assessment - its potential in enhancing clinical teaching. Med Educ 2000;34: 858-61.
– reference: Reisdorff EJ, Hayes OW, Carlson DJ, Walker GL. Assessing the new general competencies for resident education: a model from an emergency medicine programme. Acad Med 2001;76: 753-7.
– reference: Turnbull F, MacFadyen J, Van Barneveld C, Norman G. Clinical work sampling. A new approach to the problem of in-training evaluation. J Gen Intern Med 2000;15: 556-61.
– reference: Dolmans D, Schmidt A, Van Der Beck J, Beintema M, Gerver WJ. Does a student log provide a means to better structure clinical education? Med Educ 1999;33: 89-94.
– reference: Miller GE. The assessment of clinical skills/competence/performance. Acad Med 1990;65 (Suppl):63-7.
– reference: Noel GL, Herbers JE, Caplow MP, Cooper GS, Pangaro JN, Harvey J. How well do internal medicine faculty members evaluate the clinical skills of residents? Ann Intern Med 1992;117: 757-65.
– reference: Kroboth FJ, Hanusa BH, Parker S, Coulehan JL, Kapoor WN, Brown FH, Karpf M, Levey GS. The interrater reliability and internal consistency of a clinical evaluation exercise. J Gen Intern Med 1992;7: 174-9.
– reference: Durning SJ, Lannie JC, Markert RJ, Pangaro LN. Assessing the reliability and validity of the mini-clinical evaluation exercise for internal medicine residency training. Acad Med 2002;77: 900-4.
– reference: Patel BS, Feerick A. Will competency assessment improve the training and skills of the trainee anaesthetist? Anaesthesia 2002;57: 710-31.
– reference: Newble DI, Jaeger K. The effect of assessments and examinations on the learning of medical students. Med Educ 1983;17: 165-71.
– reference: Kestin IG. A statistical approach to measuring the competence of anaesthetic trainees at practical procedures. Br J Anaesth 1995;75: 805-9.
– reference: Ringsted C, Østergaard D, Scherpbier A. Embracing the new paradigm of assessment in residency training. An assessment programme for first year residency training in anaesthesiology. Med Teach 2003;25: 54-62.
– reference: Hays R, Wellard R. In-training assessment in postgraduate training for general practice. Med Educ 1998;32: 507-13.
– reference: Friedman Ben-David M. The role of assessment in expanding professional horizons. Med Teach 2000;22: 472-7.
– reference: Short JP. The importance of strong evaluation standards and procedures in training residents. Acad Med 1993;68: 522-5.
– reference: Rasmussen J. Skills, rules, knowledge, signals, signs and symbols and other distinctions in human performance models. IEEE Trans Systems Man Cybernetics 1983;123: 257-66.
– reference: Prescott LE, Norcini JJ, McKinlay P, Rennie JS. Facing the challenges of competency-based assessment of postgraduate dental training: longitudinal evaluation of performance (LEP). Med Educ 2002;36: 92-7.
– reference: McManus IC, Winder BC, Gordon D. UK doctors' attitudes to the General Medical Council's performance procedures, 1997-99. Med Educ 2001;35 (Suppl):60-9.
– reference: Van der Vleuten CPM. The assessment of professional competence: developments, research and practical implications. Adv Health Sci Educ 1996;1: 41-67.
– reference: Finucane PM, Barron SR, Davies HA, Hadfield-Jones RS, Kaigas TM. Towards an acceptance of performance assessment. Med Educ 2002;36: 959-64.
– reference: Turnbull J, Gray J, MacFadyen J. Improving in-training evaluation programmes. J Gen Intern Med 1998;13: 317-23.
– reference: Baker JD, Cooke JE, Contoy JM, Bromley HR, Hollon MF, Alpert CC. Beyond career choice: the role of learning style analysis in residency training. Med Educ 1988;22: 527-32.
– reference: Ringsted C, Østergaard D, Scherpbier A. Consultants' opinion on a new practice-based assessment programme for first year trainees in anaesthesiology. Acta Anaesthesiol Scand 2002;46: 1119-23.
– reference: Yukowsky R. Can resident evaluations demonstrate increases in residents' skills over time? Acad Med 1999;74 (Suppl):108-10.
– start-page: 793
  year: 2002;
  end-page: 810
– volume: 36
  start-page: 92
  year: 2002
  end-page: 7
  article-title: Facing the challenges of competency‐based assessment of postgraduate dental training: longitudinal evaluation of performance (LEP)
  publication-title: Med Educ
– volume: 22
  start-page: 527
  year: 1988
  end-page: 32
  article-title: Beyond career choice: the role of learning style analysis in residency training
  publication-title: Med Educ
– volume: 36
  start-page: 959
  year: 2002
  end-page: 64
  article-title: Towards an acceptance of performance assessment
  publication-title: Med Educ
– volume: 65
  start-page: 63
  issue: Suppl
  year: 1990
  end-page: 7
  article-title: The assessment of clinical skills/competence/performance
  publication-title: Acad Med
– volume: 25
  start-page: 54
  year: 2003
  end-page: 62
  article-title: Embracing the new paradigm of assessment in residency training. An assessment programme for first year residency training in anaesthesiology
  publication-title: Med Teach
– volume: 75
  start-page: 805
  year: 1995
  end-page: 9
  article-title: A statistical approach to measuring the competence of anaesthetic trainees at practical procedures
  publication-title: Br J Anaesth
– volume: 74
  start-page: 108
  issue: Suppl
  year: 1999
  end-page: 10
  article-title: Can resident evaluations demonstrate increases in residents' skills over time?
  publication-title: Acad Med
– volume: 46
  start-page: 1119
  year: 2002
  end-page: 23
  article-title: Consultants' opinion on a new practice‐based assessment programme for first year trainees in anaesthesiology
  publication-title: Acta Anaesthesiol Scand
– volume: 57
  start-page: 710
  year: 2002
  end-page: 31
  article-title: Will competency assessment improve the training and skills of the trainee anaesthetist?
  publication-title: Anaesthesia
– volume: 75
  start-page: 1178
  year: 2000
  end-page: 83
  article-title: Competency‐based residency training: the next advance in graduate medical education
  publication-title: Acad Med
– volume: 13
  start-page: 317
  year: 1998
  end-page: 23
  article-title: Improving in‐training evaluation programmes
  publication-title: J Gen Intern Med
– volume: 76
  start-page: 753
  year: 2001
  end-page: 7
  article-title: Assessing the new general competencies for resident education: a model from an emergency medicine programme
  publication-title: Acad Med
– volume: 32
  start-page: 507
  year: 1998
  end-page: 13
  article-title: In‐training assessment in postgraduate training for general practice
  publication-title: Med Educ
– volume: 22
  start-page: 472
  year: 2000
  end-page: 7
  article-title: The role of assessment in expanding professional horizons
  publication-title: Med Teach
– volume: 117
  start-page: 757
  year: 1992
  end-page: 65
  article-title: How well do internal medicine faculty members evaluate the clinical skills of residents?
  publication-title: Ann Intern Med
– volume: 47
  start-page: 1196
  year: 2003
  end-page: 1203
– volume: 15
  start-page: 556
  year: 2000
  end-page: 61
  article-title: Clinical work sampling. A new approach to the problem of in‐training evaluation
  publication-title: J Gen Intern Med
– volume: 35
  start-page: 60
  issue: Suppl
  year: 2001
  end-page: 9
  article-title: UK doctors' attitudes to the General Medical Council's performance procedures, 1997–99
  publication-title: Med Educ
– volume: 33
  start-page: 89
  year: 1999
  end-page: 94
  article-title: Does a student log provide a means to better structure clinical education?
  publication-title: Med Educ
– volume: 7
  start-page: 174
  year: 1992
  end-page: 9
  article-title: The interrater reliability and internal consistency of a clinical evaluation exercise
  publication-title: J Gen Intern Med
– volume: 68
  start-page: 522
  year: 1993
  end-page: 5
  article-title: The importance of strong evaluation standards and procedures in training residents
  publication-title: Acad Med
– start-page: 673
  year: 2002;
  end-page: 709
– volume: 123
  start-page: 257
  year: 1983
  end-page: 66
  article-title: Skills, rules, knowledge, signals, signs and symbols and other distinctions in human performance models
  publication-title: IEEE Trans Systems Man Cybernetics
– volume: 34
  start-page: 858
  year: 2000
  end-page: 61
  article-title: In‐training assessment – its potential in enhancing clinical teaching
  publication-title: Med Educ
– volume: 77
  start-page: 900
  year: 2002
  end-page: 4
  article-title: Assessing the reliability and validity of the mini‐clinical evaluation exercise for internal medicine residency training
  publication-title: Acad Med
– volume: 25
  start-page: 654
  year: 2003
  end-page: 8
– volume: 17
  start-page: 165
  year: 1983
  end-page: 71
  article-title: The effect of assessments and examinations on the learning of medical students
  publication-title: Med Educ
– start-page: 151
  year: 1994;
  end-page: 66
– volume: 1
  start-page: 41
  year: 1996
  end-page: 67
  article-title: The assessment of professional competence: developments, research and practical implications
  publication-title: Adv Health Sci Educ
– start-page: 673
  volume-title: International Handbook of Research in Medical Education.
  year: 2002
  ident: b27_200
  doi: 10.1007/978-94-010-0462-6_26
– volume: 1
  start-page: 41
  year: 1996
  ident: b9_182
  publication-title: Adv Health Sci Educ
  doi: 10.1007/BF00596229
– ident: b19_192
  doi: 10.1046/j.1525-1497.2000.06099.x
– volume: 57
  start-page: 710
  year: 2002
  ident: b20_193
  publication-title: Anaesthesia
  doi: 10.1046/j.1365-2044.2002.27092.x
– volume: 117
  start-page: 757
  year: 1992
  ident: b17_190
  publication-title: Ann Intern Med
  doi: 10.7326/0003-4819-117-9-757
– volume: 75
  start-page: 805
  year: 1995
  ident: b22_195
  publication-title: Br J Anaesth
  doi: 10.1093/bja/75.6.805
– ident: b10_183
  doi: 10.1080/0142159021000061431
– volume: 17
  start-page: 165
  year: 1983
  ident: b26_199
  publication-title: Med Educ
  doi: 10.1111/j.1365-2923.1983.tb00657.x
– start-page: 151
  volume-title: The Certification and Recertification of Doctors: Issues in the Assessment of Clinical Competence.
  year: 1994
  ident: b5_178
– ident: b3_176
  doi: 10.1080/01421590050110786
– ident: b25_198
  doi: 10.1046/j.1399-6576.2003.00255.x
– ident: b12_185
  doi: 10.1046/j.1365-2923.2002.01099.x
– ident: b13_186
  doi: 10.1046/j.1365-2923.1998.00231.x
– ident: b21_194
  doi: 10.1034/j.1399-6576.2002.460910.x
– ident: b29_202
  doi: 10.1046/j.1365-2923.1999.00285.x
– volume: 68
  start-page: 522
  year: 1993
  ident: b2_175
  publication-title: Acad Med
  doi: 10.1097/00001888-199307000-00003
– ident: b24_197
  doi: 10.1080/01421590310001605642
– volume: 77
  start-page: 900
  year: 2002
  ident: b14_187
  publication-title: Acad Med
  doi: 10.1097/00001888-200209000-00020
– volume: 75
  start-page: 1178
  year: 2000
  ident: b7_180
  publication-title: Acad Med
  doi: 10.1097/00001888-200012000-00009
– volume: 22
  start-page: 527
  year: 1988
  ident: b30_203
  publication-title: Med Educ
  doi: 10.1111/j.1365-2923.1988.tb00798.x
– ident: b16_189
  doi: 10.1046/j.1365-2923.2002.01314.x
– volume: 35
  start-page: 60
  year: 2001
  ident: b28_201
  publication-title: Med Educ
– volume: 65
  start-page: 63
  year: 1990
  ident: b8_181
  publication-title: Acad Med
  doi: 10.1097/00001888-199009000-00045
– volume: 74
  start-page: 108
  year: 1999
  ident: b15_188
  publication-title: Acad Med
  doi: 10.1097/00001888-199910000-00056
– volume: 76
  start-page: 753
  year: 2001
  ident: b11_184
  publication-title: Acad Med
  doi: 10.1097/00001888-200107000-00023
– volume: 7
  start-page: 174
  year: 1992
  ident: b18_191
  publication-title: J Gen Intern Med
  doi: 10.1007/BF02598008
– ident: b4_177
  doi: 10.1046/j.1525-1497.1998.00097.x
– volume: 123
  start-page: 257
  year: 1983
  ident: b23_196
  publication-title: IEEE Trans Systems Man Cybernetics
  doi: 10.1109/TSMC.1983.6313160
– ident: b1_174
  doi: 10.1046/j.1365-2923.2000.00755.x
– start-page: 793
  volume-title: International Handbook of Research in Medical Education.
  year: 2002
  ident: b6_179
  doi: 10.1007/978-94-010-0462-6_29
SSID ssj0007548
Score 1.8867509
Snippet Objectives  To investigate the experiences and opinions of programme directors, clinical supervisors and trainees on an in‐training assessment (ITA) programme...
To investigate the experiences and opinions of programme directors, clinical supervisors and trainees on an in-training assessment (ITA) programme on a broad...
OBJECTIVESTo investigate the experiences and opinions of programme directors, clinical supervisors and trainees on an in-training assessment (ITA) programme on...
SourceID proquest
pubmed
pascalfrancis
crossref
wiley
istex
SourceType Aggregation Database
Index Database
Enrichment Source
Publisher
StartPage 767
SubjectTerms Anesthesiology - education
Attitude of Health Personnel
Clinical Competence - standards
Curriculum
Curriculum subjects: programmes and methods
Denmark
education
Education, Medical, Graduate - methods
educational measurement
Educational Measurement - standards
Educational sciences
Evaluation Studies as Topic
Humans
Inservice Training - standards
medical
Medical and paramedical education
Program Evaluation
students
Teaching methods
undergraduate/methods
Title Educational impact of in-training assessment (ITA) in postgraduate medical education: a qualitative study of an ITA programme in actual practice
URI https://api.istex.fr/ark:/67375/WNG-N81XTR4D-Q/fulltext.pdf
https://onlinelibrary.wiley.com/doi/abs/10.1111%2Fj.1365-2929.2004.01841.x
https://www.ncbi.nlm.nih.gov/pubmed/15200401
https://www.proquest.com/docview/202939012
https://www.proquest.com/docview/66638568
Volume 38
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1Lb9QwELZQkRAXHuUVCsUHhOCQVRzn4XCr2JaCtCtR7Yq9WbbjILQ0W212pYoTPwHxE_klzNhJ2qAeKsQtijWTZHZsf7Oe-YaQl7lONbc2C3NhozCxloWi0nmokB6MGVXYCgPFyTQ7nicfF-mizX_CWhjPD9H_4YYzw63XOMGVboaT3GVowf7uwrxRBMEKGyGehAGk0R-fXDBJ5alrpIXsLCFuecOknisVDXaqm2j0c8ycVA0Yr_JdL66CpUOU67apo7tk2X2gz05ZjrYbPTLf_-J-_D8WuEfutGiWHnj3u09u2HoXG0G3SSO75NakPbt_QH71t0HCF2fSVUW_1r9__OwaVVDVE4XS1x9mB29gmJ6tms2XtSq3AIvpqT9YorZT9pYq6itDHYU5dXy5qFjVFDTQNgHt1KIq5cplaFca9pDMjw5n747DtiNEaJKMsVBFOivS3JR5FBep4CzTJatMDriUx0UplMBCYssiY7jSQlkNAMvqiOe8ZCZL-SOyU69q-4TAaxYiZkmVGOQjskbwUvAKPDcrYhtnPCB59-tL09KlozG-yUthE5hfovmxmWcinfnleUBYL3nmKUOuIfPKOVgvoNZLTLnLU_l5-l5OBVvMTpKx_BSQ_YEHXjwhLdICYvuA7HUuKdvlqIFHAaoD5BcH5EU_CusIHg6p2q62jYQwlos0EwF57P34kmZ804iBRZw3Xvuj5ORwPMfLp_8suUdu-1QpzI9-RnY26619Dihwo_fd_P4DdsBMow
linkProvider Wiley-Blackwell
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1Lb9QwELZQKwEXHuUVCq0PCMEhqzjOw-FWsS1b6K5EtSv2ZtmOg1DbbLUPqeLET0D8RH4JM3aSdlEPFeIWJZpJMhnb38Qz3xDyKtep5tZmYS5sFCbWslBUOg8V0oMxowpbYaA4HGWDSfJxmk6bdkBYC-P5Ibofbjgy3HyNAxx_SK-PcpeiBQu8i_N6EUQrrAeAcjMB3IGRWP_4kksqT10rLeRnCXHRW0_ruVbT2lq1iWa_wNxJtQDzVb7vxXXAdB3nuoXq4D45bV_R56ec9FZL3TPf_2J__E82eEDuNYCW7nkPfEhu2XoLe0E3eSNb5Paw2b5_RH51p0HC12fSWUW_1b9__Gx7VVDVcYXSN4fjvbdwmZ7PFsuvc1WuABnTM7-3RG2r7B1V1BeHOhZz6ihzUbGqKWigTQ7amUVVylXM0LY67DGZHOyP3w_CpilEaJKMsVBFOivS3JR5FBep4CzTJatMDtCUx0UplMBaYssiY7jSQlkNGMvqiOe8ZCZL-ROyUc9q-4zAYxYiZkmVGKQkskbwUvAKnDcrYhtnPCB5-_mlaRjT0Rin8krkBOaXaH7s55lIZ355ERDWSZ571pAbyLx2HtYJqPkJZt3lqfwy-iBHgk3Hx0lffg7IzpoLXt4hLdICwvuAbLc-KZsZaQG3AmAH4C8OyG53FaYS3B9StZ2tFhIiWS7STATkqXfkK5rxSSMGFnHueOOXksP9_gQPn_-z5C65MxgPj-TR4ejTNrnrM6cwXfoF2VjOV_YlgMKl3nGD_Q9CA1DC
linkToPdf http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1LbxMxELZQK1VceJRHl0LrA0Jw2Gi93oeXW0UaWiARVInIzbK9XoRCN1EeUsWJn4D4ifwSZryPdlEPFeIWZeXZ3cnY_ib-5htCnqc61tzaxE-FDfzIWuaLQqe-QnkwZlRmC0wUh6PkZBK9m8bTmv-EtTCVPkT7hxvODLde4wRf5EV3kjuGFuzvLs3rBZCssB7gye0oAWCBAOnsUkoqjV0nLZRn8XHP67J6rrXU2aq20esXSJ1UK_BeUbW9uA6XdmGu26cGd8msecOKnjLrbda6Z77_Jf74f1xwj9yp4Sw9quLvPrlly13sBF2zRnbJzrA-vH9AfrVfw4iqOpPOC_q1_P3jZ9OpgqpWKZS-PB0fvYLLdDFfrb8sVb4BXEzPq5Mlahtjr6miVWmo0zCnTjAXDauSggVaM9DOLZpSrl6GNrVhD8lkcDx-c-LXLSF8EyWM-SrQSRanJk-DMIsFZ4nOWWFSAKY8zHKhBFYSWxYYw5UWympAWFYHPOU5M0nMH5Gtcl7aPQKPmYmQRUVkUJDIGsFzwQsI3SQLbZhwj6TNry9NrZeOzvgmr-RN4H6J7sdunpF07pcXHmHtyEWlGXKDMS9cgLUD1HKGnLs0lp9Hb-VIsOn4LOrLTx456ETg5R3iLM4guffIfhOSsl6PVnArgHUA_UKPHLZXYSHB0yFV2vlmJSGP5SJOhEceV3F8xTI-acDAIy4ab_xScnjcn-DHJ_888pDsfOwP5IfT0ft9cruiTSFX-inZWi839hkgwrU-cFP9D_miT3E
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Educational+impact+of+in%E2%80%90training+assessment+%28ITA%29+in+postgraduate+medical+education%3A+a+qualitative+study+of+an+ITA+programme+in+actual+practice&rft.jtitle=Medical+education&rft.au=Ringsted%2C+C&rft.au=Henriksen%2C+A+H&rft.au=Skaarup%2C+A+M&rft.au=Van+der+Vleuten%2C+C+P+M&rft.date=2004-07-01&rft.pub=Blackwell+Science+Ltd&rft.issn=0308-0110&rft.eissn=1365-2923&rft.volume=38&rft.issue=7&rft.spage=767&rft.epage=777&rft_id=info:doi/10.1111%2Fj.1365-2929.2004.01841.x&rft.externalDBID=10.1111%252Fj.1365-2929.2004.01841.x&rft.externalDocID=MEDU1841
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0308-0110&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0308-0110&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0308-0110&client=summon