Access the full text.
Sign up today, get DeepDyve free for 14 days.
V. Shute (2007)
Focus on Formative FeedbackReview of Educational Research, 78
A. Mørcke, T. Dornan, B. Eika (2013)
Outcome (competency) based education: an exploration of its origins, theoretical basis, and empirical evidenceAdvances in Health Sciences Education, 18
H. Marsh, L. Roche (1997)
Making students' evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility.American Psychologist, 52
D. Rohrer, H. Pashler (2010)
Recent Research on Human Learning Challenges Conventional Instructional StrategiesEducational Researcher, 39
G. Regehr, K. Eva, S. Ginsburg, Y. Halwani, Ravidner Sidhu (2011)
13 Assessment in Postgraduate Medical Education : Trends and Issues in Assessment in the Workplace
D. Mutabdzic, M. Mylopoulos, M. Murnaghan, Priyanka Patel, N. Zilbert, Natashia Seemann, G. Regehr, C. Moulton (2015)
Coaching Surgeons: Is Culture Limiting Our Ability to Improve?Annals of surgery, 262 2
G. Bordage, A. Meguerditchian, R. Tamblyn (2013)
Practice Indicators of Suboptimal Care and Avoidable Adverse Events: A Content Analysis of a National Qualifying ExaminationAcademic Medicine, 88
P. Teunissen, M. Westerman (2011)
Opportunity or threat: the ambiguity of the consequences of transitions in medical educationMedical Education, 45
R. Hawkins, Mira Irons, Catherine Welcher, M. Pouwels, E. Holmboe, E. Reisdorff, Joshua Cohen, S. Dentzer, D. Nichols, C. Lien, T. Horn, R. Noone, R. Lipner, K. Eva, J. Norcini, L. Nora, Jeffrey Gold, Jeffrey Gold (2016)
The ABMS MOC Part III Examination: Value, Concerns, and Alternative FormatsAcademic Medicine, 91
E. Holmboe, J. Sherbino, D. Long, S. Swing, J. Frank (2010)
The role of assessment in competency-based medical educationMedical Teacher, 32
G. Regehr (1994)
Chickens and children do not an expert makeAcademic Medicine, 69
J. Colliver (2002)
Educational Theory and Medical Education Practice: A Cautionary Note for Medical School FacultyAcademic Medicine, 77
J. Norcini, Brownell Anderson, V. Bollela, V. Burch, M. Costa, R. Duvivier, R. Galbraith, R. Hays, A. Kent, Vanessa Perrott, T. Roberts (2011)
Criteria for good assessment: Consensus statement and recommendations from the Ottawa 2010 ConferenceMedical Teacher, 33
G. Norman, J. Norcini, G. Bordage (2014)
Competency-based education: milestones or millstones?Journal of graduate medical education, 6 1
R. Galbraith, S. Clyman, D. Melnick (2011)
Conceptual Perspectives: Emerging Changes in the Assessment Paradigm
C. Vleuten (1996)
The assessment of professional competence: Developments, research and practical implications.Advances in health sciences education : theory and practice, 1 1
R. Hatala, S. Marr, C. Cuncic, C. Bacchus (2011)
Modification of an OSCE format to enhance patient continuity in a high-stakes assessment of clinical performanceBMC Medical Education, 11
N. Choudhry, R. Fletcher, S. Soumerai (2005)
Systematic Review: The Relationship between Clinical Experience and Quality of Health CareAnnals of Internal Medicine, 142
S. Jarvis-Selinger, D. Pratt, G. Regehr (2012)
Competency is not enough: integrating identity formation into the medical education discourse.Academic medicine : journal of the Association of American Medical Colleges, 87 9
J. Kogan, E. Holmboe, K. Hauer (2009)
Tools for direct observation and assessment of clinical skills of medical trainees: a systematic review.JAMA, 302 12
Mark Gierl, H. Lai, S. Turner (2012)
Using automatic item generation to create multiple‐choice test itemsMedical Education, 46
Elizabeth Bernabeo, Sarah Hood, W. Iobst, E. Holmboe, K. Caverzagie (2013)
Optimizing the implementation of practice improvement modules in training: lessons from educators.Journal of graduate medical education, 5 1
Jeffrey Karpicke, H. Roediger (2008)
The Critical Importance of Retrieval for LearningScience, 319
D. Cook (2014)
When I say… validityMedical Education, 48
C. Watling, E. Driessen, C. Vleuten, L. Lingard (2014)
Learning culture and feedback: an international study of medical athletes and musiciansMedical Education, 48
G. Cizek (2012)
Defining and distinguishing validity: interpretations of score meaning and justifications of test use.Psychological methods, 17 1
E. Custers (2010)
Long-term retention of basic science knowledge: a review studyAdvances in Health Sciences Education, 15
S. Razack, B. Hodges, Y. Steinert, M. Maguire (2015)
Seeking inclusion in an exclusive process: discourses of medical school student selectionMedical Education, 49
R. Ellaway, M. Pusic, R. Galbraith, T. Cameron (2014)
Developing the role of big data and analytics in health professional educationMedical Teacher, 36
G. Norman, K. Dore, L. Grierson (2012)
The minimal relationship between simulation fidelity and transfer of learningMedical Education, 46
G. Cadieux, R. Tamblyn, D. Dauphinée, M. Libman (2007)
Predictors of inappropriate antibiotic prescribing among primary care physiciansCanadian Medical Association Journal, 177
R. Butler (1987)
Task-involving and ego-involving properties of evaluation: Effects of different feedback conditions on motivational perceptions, interest, and performance.Journal of Educational Psychology, 79
K. Mann, J. Gordon, A. MacLeod (2009)
Reflection and reflective practice in health professions education: a systematic reviewAdvances in Health Sciences Education, 14
(2013)
What physicians reason about during clinical encounters: Time to be more explicit
RA Bjork (1994)
Metacognition: Knowing about knowing
(2012)
Content and conceptual frameworks of preceptor feedback in response to residents’ educational needs
K. Eva, J. Cunnington (2006)
The difficulty with experience: Does practice increase susceptibility to premature closure?Journal of Continuing Education in the Health Professions, 26
E. Farmer, G. Page (2005)
A practical guide to assessing clinical decision‐making skills using the key features approachMedical Education, 39
J. Frank, L. Snell, O. Cate, E. Holmboe, C. Carraccio, S. Swing, Peter Harris, N. Glasgow, C. Campbell, D. Dath, R. Harden, W. Iobst, D. Long, Rani Mungroo, Denyse Richardson, J. Sherbino, I. Silver, Sarah Taber, M. Talbot, K. Harris (2010)
Competency-based medical education: theory to practiceMedical Teacher, 32
Becky Ure (2002)
[To err is human: building a safer health system].Annales francaises d'anesthesie et de reanimation, 21 6
(2012)
Scylla or Charbydis? Can we navigate between objectification and judgment in assessment
M. Bogo, C. Regehr, C. Logie, Ellen Katz, M. Mylopoulos, G. Regehr (2011)
ADAPTING OBJECTIVE STRUCTURED CLINICAL EXAMINATIONS TO ASSESS SOCIAL WORK STUDENTS' PERFORMANCE AND REFLECTIONSJournal of Social Work Education, 47
(2010)
The Future of Medical Education in Canada (FMEC): A collective vision for MD education
S. Ginsburg, G. Regehr, L. Lingard (2004)
Basing the Evaluation of Professionalism on Observable Behaviors: A Cautionary TaleAcademic Medicine, 79
M. Mylopoulos, M. Scardamalia (2008)
Doctors’ perspectives on their innovations in daily practice: implications for knowledge building in health careMedical Education, 42
H. Macrae, R. Cohen, G. Regehr, R. Reznick, M. Burnstein (1997)
A new assessment tool: the patient assessment and management examination.Surgery, 122 2
Hilary Neve, S. Hanks (2016)
When I say … capabilityMedical Education, 50
R. Hays, S. Gay (2011)
Reflection or ‘pre‐reflection’: what are we actually measuring in reflective practice?Medical Education, 45
(2012)
Blinded by ‘insight’: Self-assessment and its role in performance improvement
K. Mann, C. Vleuten, K. Eva, H. Armson, Benjamin Chesluk, T. Dornan, E. Holmboe, J. Lockyer, E. Loney, J. Sargeant (2011)
Tensions in Informed Self-Assessment: How the Desire for Feedback and Reticence to Collect and Use It Can ConflictAcademic Medicine, 86
J. Kogan, E. Holmboe (2013)
Realizing the Promise and Importance of Performance-Based AssessmentTeaching and Learning in Medicine, 25
G. Norman, A. Neville, Jennifer Blake, B. Mueller (2010)
Assessment steers learning down the right road: Impact of progress testing on licensing examination performanceMedical Teacher, 32
Bernard Engel, Rudolf Moos (1967)
The generality of specificity.Archives of general psychiatry, 16 5
R. Bjork (1994)
Memory and metamemory considerations in the training of human beings.
K. Eva, Juan Muñoz, M. Hanson, Allyn Walsh, J. Wakefield (2010)
Which Factors, Personal or External, Most Influence Students' Generation of Learning Goals?Academic Medicine, 85
Tara Kennedy, G. Regehr, G. Baker, L. Lingard (2009)
‘It’s a cultural expectation…’ The pressure on medical trainees to work independently in clinical practiceMedical Education, 43
M. Guadagnoli, Marie‐Paule Morin, A. Dubrowski (2012)
The application of the challenge point framework in medical educationMedical Education, 46
R. Galbraith, R. Hawkins, E. Holmboe (2008)
Making self-assessment more effective.The Journal of continuing education in the health professions, 28 1
J. Sargeant, K. Eva, H. Armson, Benjamin Chesluk, T. Dornan, E. Holmboe, J. Lockyer, E. Loney, K. Mann, C. Vleuten (2011)
Features of assessment learners use to make informed self‐assessments of clinical performanceMedical Education, 45
Charles Kromann, C. Bohnstedt, M. Jensen, Charlotte Ringsted (2010)
The testing effect on skills learning might last 6 monthsAdvances in Health Sciences Education, 15
M. Mylopoulos, G. Regehr (2011)
Putting the expert together againMedical Education, 45
R. Tamblyn, M. Abrahamowicz, D. Dauphinée, E. Wenghofer, A. Jacques, D. Klass, S. Smee, D. Blackmore, N. Winslade, N. Girard, R. Berger, Ilona Bartman, D. Buckeridge, J. Hanley (2007)
Physician scores on a national clinical skills examination as predictors of complaints to medical regulatory authorities.JAMA, 298 9
JR Kogan, L Conforti, E Bernabeo, W Iobst, ES Holmboe (2011)
Opening the black box of postgraduate trainee assessment in the clinical setting via observation: A conceptual modelMedical Education, 45
(2013)
Medical Education Assessment Advisory Committee report to the Medical Council of Canada on Current Issues in Health Professional and Health Professional Trainee Assessment
MT Kane (1992)
An argument-based approach to validationPsychological Bulletin, 112
K. Ericsson (2004)
Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains.Academic medicine : journal of the Association of American Medical Colleges, 79 10 Suppl
S. Ginsburg, K. Eva, G. Regehr (2013)
Do In-Training Evaluation Reports Deserve Their Bad Reputations? A Study of the Reliability and Predictive Ability of ITER Scores and Narrative CommentsAcademic Medicine, 88
Douglas Larsen, A. Butler, H. III (2008)
Test‐enhanced learning in medical educationMedical Education, 42
under review). Recommendations to the American Board of Internal Medicine (ABIM): A vision for certification in internal medicine
G. Page, G. Bordage (1995)
The Medical Council of Canada's key features project: a more valid written examination of clinical decision‐making skillsAcademic Medicine, 70
D. Newble, Kerry Jaeger (1983)
The effect of assessments and examinations on the learning of medical studentsMedical Education, 17
G Bordage, AN Meguerditchian, R Tamblyn (2013)
Avoidable adverse events: A content analysis of a national qualifying examinationAcademic Medicine, 88
B. Hodges, L. Lingard, M. Anderson (2014)
The Question of Competence: Reconsidering Medical Education in the Twenty-First Century
K. Newell, Y. Liu, G. Mayer-Kress (2001)
Time scales in motor learning and development.Psychological review, 108 1
KW Eva (2003)
On the generality of specificityMedical Education, 37
Nate Kornell, Lisa Son (2009)
Learners’ choices and beliefs about self-testingMemory, 17
R. Cruess, Sylvia Cruess (2014)
Updating the Hippocratic Oath to include medicine's social contractMedical Education, 48
E. Wenghofer, D. Klass, M. Abrahamowicz, D. Dauphinée, A. Jacques, S. Smee, D. Blackmore, N. Winslade, K. Reidel, Ilona Bartman, R. Tamblyn (2009)
Doctor scores on national qualifying examinations predict quality of care in future practiceMedical Education, 43
S Messick (1989)
Educational measurement
L. Sawley (1984)
I sayJournal of Information Science, 9
RM Galbraith, S Clyman, DE Melnick (2011)
Extraordinary learning in the workplace
D. Boud, E. Molloy (2013)
Feedback in Higher and Professional Education : Understanding it and doing it well
B. Hodges (2003)
OSCE! Variations on a theme by HardenMedical Education, 37
(2016)
Trends in national licensing examinations
A. Gingerich, J. Kogan, P. Yeates, M. Govaerts, E. Holmboe (2014)
Seeing the ‘black box’ differently: assessor cognition from three research perspectivesMedical Education, 48
Reed Williams, D. Klamen, S. Markwell, A. Cianciolo, J. Colliver, S. Verhulst (2014)
Variations in Senior Medical Student Diagnostic Justification AbilityAcademic Medicine, 89
M. Kane (1990)
The Argument-Based Approach to ValidationSchool Psychology Review, 42
Christopher Harrison, K. Könings, L. Schuwirth, V. Wass, C. Vleuten (2015)
Barriers to the uptake and use of feedback in the context of summative assessmentAdvances in Health Sciences Education, 20
(2005)
Assessing professional competence : from methods to programmes
J. James (2013)
A New, Evidence-based Estimate of Patient Harms Associated with Hospital CareJournal of Patient Safety, 9
K. Eva (2002)
The Aging Physician: Changes in Cognitive Processing and Their Impact on Medical PracticeAcademic Medicine, 77
(2011)
Assessment strategies within the revised maintenance of certification program , draft recommendations
D. Cook, R. Brydges, S. Ginsburg, R. Hatala (2015)
A contemporary approach to validity arguments: a practical guide to Kane's frameworkMedical Education, 49
J. Norcini (2005)
Current perspectives in assessment: the assessment of performance at workMedical Education, 39
E. Cano (2013)
Feedback in Higher and Professional Education: Understanding it and doing it well [Reseña]
Mark Gierl, H. Lai (2013)
Evaluating the quality of medical multiple‐choice items created with automated processesMedical Education, 47
S. Downing (2003)
Validity: on the meaningful interpretation of assessment dataMedical Education, 37
Debra Pugh, S. Hamstra, Timothy Wood, S. Humphrey-Murto, C. Touchie, R. Yudkowsky, G. Bordage (2014)
A procedural skills OSCE: assessing technical and non-technical skills of internal medicine residentsAdvances in Health Sciences Education, 20
J. Tartwijk, E. Driessen (2009)
Portfolios for assessment and learning: AMEE Guide no. 45Medical Teacher, 31
Wendi Arant-Kaspar (2016)
Opening the Black BoxColl. Res. Libr., 77
A. Kluger, Dina Dijk (2010)
Feedback, the various tasks of the doctor, and the feedforward alternativeMedical Education, 44
S. Ginsburg, J. Mcilroy, O. Oulanova, K. Eva, G. Regehr (2010)
Toward Authentic Clinical Evaluation: Pitfalls in the Pursuit of CompetencyAcademic Medicine, 85
R. Bogumil (1985)
The reflective practitioner: How professionals think in actionProceedings of the IEEE, 73
J. Norcini, V. Burch (2007)
Workplace-based assessment as an educational tool: AMEE Guide No. 31Medical Teacher, 29
K. Eva, G. Regehr (2013)
Effective feedback for maintenance of competence: from data delivery to trusting dialoguesCanadian Medical Association Journal, 185
J. Norcini, L. Blank, F. Duffy, Gregory Fortna (2003)
The Mini-CEX: A Method for Assessing Clinical SkillsAnnals of Internal Medicine, 138
K. Eva (2009)
Diagnostic error in medical education: where wrongs can make rightsAdvances in Health Sciences Education, 14
D. Klass (2007)
A performance-based conception of competence is changing the regulation of physicians' professional behavior.Academic medicine : journal of the Association of American Medical Colleges, 82 6
Despite multifaceted attempts to “protect the public,” including the implementation of various assessment practices designed to identify individuals at all stages of training and practice who underperform, profound deficiencies in quality and safety continue to plague the healthcare system. The purpose of this reflections paper is to cast a critical lens on current assessment practices and to offer insights into ways in which they might be adapted to ensure alignment with modern conceptions of health professional education for the ultimate goal of improved healthcare. Three dominant themes will be addressed: (1) The need to redress unintended consequences of competency-based assessment; (2) The potential to design assessment systems that facilitate performance improvement; and (3) The importance of ensuring authentic linkage between assessment and practice. Several principles cut across each of these themes and represent the foundational goals we would put forward as signposts for decision making about the continued evolution of assessment practices in the health professions: (1) Increasing opportunities to promote learning rather than simply measuring performance; (2) Enabling integration across stages of training and practice; and (3) Reinforcing point-in-time assessments with continuous professional development in a way that enhances shared responsibility and accountability between practitioners, educational programs, and testing organizations. Many of the ideas generated represent suggestions for strategies to pilot test, for infrastructure to build, and for harmonization across groups to be enabled. These include novel strategies for OSCE station development, formative (diagnostic) assessment protocols tailored to shed light on the practices of individual clinicians, the use of continuous workplace-based assessment, and broadening the focus of high-stakes decision making beyond determining who passes and who fails. We conclude with reflections on systemic (i.e., cultural) barriers that may need to be overcome to move towards a more integrated, efficient, and effective system of assessment.
Advances in Health Sciences Education – Springer Journals
Published: Nov 21, 2015
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.