Access the full text.
Sign up today, get DeepDyve free for 14 days.
B. Hodges, J. Mcilroy (2003)
Analytic global OSCE ratings are sensitive to level of trainingMedical Education, 37
C. Vleuten, D. Swanson (1990)
Assessment of clinical skills with standardized patients: State of the artTeaching and Learning in Medicine, 2
C. Vleuten (2004)
Changing education, changing assessment, changing research?Medical Education, 38
Alberto Lima, C. Barrero, S. Baratta, Yanina Costa, Guillermo Bortman, Justo Carabajales, D. Conde, A. Galli, Graciela Degrange, C. Vleuten (2007)
Validity, reliability, feasibility and satisfaction of the Mini-Clinical Evaluation Exercise (Mini-CEX) for cardiology residency trainingMedical Teacher, 29
G. Noel, J. Herbers, M. Caplow, Glinda Cooper, L. Pangaro, Joan Harvey (1992)
How well do internal medicine faculty members evaluate the clinical skills of residents?Annals of internal medicine, 117 9
D. Swanson, G. Norman, R. Linn (1995)
Performance-Based Assessment: Lessons From the Health ProfessionsEducational Researcher, 24
Reed Williams, Debra Klamen, W. McGaghie (2003)
SPECIAL ARTICLE: Cognitive, Social and Environmental Sources of Bias in Clinical Performance RatingsTeaching and Learning in Medicine, 15
R. Harden, F. Gleeson (1979)
Assessment of clinical competence using an objective structured clinical examination (OSCE).Medical education, 13 1
GL Noel, JE Herbers, MP Caplow, GS Cooper (1992)
How well do internal faculty members evaluate the clinical skills of residents?Annals of Internal Medicine, 117
T. Wilkinson, Peter Campbell, S. Judd (2008)
Reliability of the long caseMedical Education, 42
M. Hasnain, K. Connell, S. Downing, A. Olthoff, R. Yudkowsky (2004)
Toward Meaningful Evaluation of Clinical Competence: The Role of Direct Observation in Clerkship RatingsAcademic Medicine, 79
G. Regehr, H. Macrae, R. Reznick, D. Szalay (1998)
Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE‐format examinationAcademic Medicine, 73
RG Williams, DA Klamen, WC Mc Gaghie (2003)
Cognitive, social and environmental sources of bias in clinical performance ratingsTeaching and Learning in Medicine, 15
C. Vleuten, Geoffrey Norman, E. Graaff (1991)
Pitfalls in the pursuit of objectivity: issues of reliabilityMedical Education, 25
Rose Hatala, Geoffrey Norman (1999)
In-training evaluation during an internal medicine clerkship.Academic medicine : journal of the Association of American Medical Colleges, 74 10 Suppl
J Turnbull, J MacFadyen, C Barneveld, G Norman (2000)
Clinical work sampling: A new approach to the problem of in-training evaluationJournal of General Internal Medicine, 15
C. Vleuten, Lambert Schuwirth (2005)
Assessing professional competence: from methods to programmesMedical Education, 39
K. Ericsson (2004)
Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains.Academic medicine : journal of the Association of American Medical Colleges, 79 10 Suppl
C. Vleuten (1996)
The assessment of professional competence: Developments, research and practical implicationsAdvances in Health Sciences Education, 1
V. Wass, Roger Jones, C. Vleuten (2001)
Standardized or real patients to test clinical competence? The long case revisitedMedical Education, 35
J. Lloyd, D. Langsley, H. Williams (1986)
Evaluating the Skills of Medical SpecialistsPlastic and Reconstructive Surgery, 78
Dr. Turnbull, J. MacFadyen, C. Barneveld, G. Norman (2007)
Clinical work samplingJournal of General Internal Medicine, 15
Darcy Reed, E. Price, D. Windish, S. Wright, A. Gozu, Edbert Hsu, M. Beach, D. Kern, E. Bass (2005)
Challenges in Systematic Reviews of Educational Intervention StudiesAnnals of Internal Medicine, 142
Dineke Tigelaar, C. Vleuten (2014)
Assessment of Professional Competence
M. Richards, J. Paukert, S. Downing, G. Bordage (2007)
Reliability and usefulness of clinical encounter cards for a third-year surgical clerkship.The Journal of surgical research, 140 1
M. Tatsuoka, F. Lord, M. Novick, A. Birnbaum (1971)
Statistical Theories of Mental Test Scores.Journal of the American Statistical Association, 66
J. Kogan, E. Holmboe, K. Hauer (2009)
Tools for direct observation and assessment of clinical skills of medical trainees: a systematic review.JAMA, 302 12
J. Norcini, L. Blank, F. Duffy, Gregory Fortna (2003)
The Mini-CEX: A Method for Assessing Clinical SkillsAnnals of Internal Medicine, 138
M. Kane (1982)
A Sampling Model for ValidityApplied Psychological Measurement, 6
D. Torre, D. Simpson, D. Elnicki, J. Sebastian, E. Holmboe (2007)
Feasibility, Reliability and User Satisfaction With a PDA-Based Mini-CEX to Evaluate the Clinical Skills of Third-Year Medical StudentsTeaching and Learning in Medicine, 19
We report a prospective study of clinical observed performance evaluation (COPE) for 197 medical students in the pre-qualification year of clinical education. Psychometric quality was the main endpoint. Students were assessed in groups of 5 in 40-min patient encounters, with each student the focus of evaluation for 8 min. Each student had a series of assessments in a 25-week teaching programme. Over time, several clinicians from a pool of 16 surgical consultants and registrars evaluated each student by direct observation. A structured rating form was used for assessment data. Variance component analysis (VCA), internal consistency and inter-rater agreement were used to estimate reliability. The predictive and convergent validity of COPE in relation to summative OSCE, long case, and overall final examination was estimated. Median number of COPE assessments per student was 7. Generalisability of a mean score over 7 COPE assessments was 0.66, equal to that of an 8 × 7.5 min station final OSCE. Internal consistency was 0.88–0.97 and inter-rater agreement 0.82. Significant correlations were observed with OSCE performance (R = 0.55 disattenuated) and long case (R = 0.47 disattenuated). Convergent validity was 0.81 by VCA. Overall final examination performance was linearly related to mean COPE score with standard error 3.7%. COPE permitted efficient serial assessment of a large cohort of final year students in a real world setting. Its psychometric quality compared well with conventional assessments and with other direct observation instruments as reported in the literature. Effect on learning, and translation to clinical care, are directions for future research.
Advances in Health Sciences Education – Springer Journals
Published: Jun 24, 2010
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.