Access the full text.
Sign up today, get DeepDyve free for 14 days.
Y. Stenkin (2004)
Two ApproachesHistorical Methods: A Journal of Quantitative and Interdisciplinary History, 37
Gary Klein (1993)
A recognition-primed decision (RPD) model of rapid decision making.
K. Ross, J. Shafer, Gary Klein (2006)
The Cambridge Handbook of Expertise and Expert Performance: Professional Judgments and “Naturalistic Decision Making”
KA Ericsson (1993)
10.7551/mitpress/5657.001.0001
P. Feltovich, M. Prietula, K. Ericsson (2006)
Studies of Expertise from Psychological Perspectives
P. Levy, Jane Williams (2004)
The Social Context of Performance Appraisal: A Review and Framework for the FutureJournal of Management, 30
(2006)
Two approaches to the study of experts’ characteristicsThe Cambridge handbook of expertise and expert performance
Paul Wimmers, H. Schmidt, P. Verkoeijen, M. Wiel (2005)
Inducing expertise effects in clinical case recallMedical Education, 39
(1989)
The development of medical expertise; a cognitive-psychological approach. Doctoral dissertation
W. Clancey, E. Shortliffe (1984)
Readings in medical artificial intelligence: the first decade
S. Coderre, Henry Mandin, P. Harasym, Gordon Fick (2003)
Diagnostic reasoning strategies and diagnostic successMedical Education, 37
J. Danks, K. Ericsson, Herbert Simon (1984)
Protocol Analysis: Verbal Reports as Data
K. Ericsson (2004)
Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains.Academic medicine : journal of the Association of American Medical Colleges, 79 10 Suppl
G. Norman, K. Eva, L. Brooks, S. Hamstra (2006)
The Cambridge Handbook of Expertise and Expert Performance: Expertise in Medicine and Surgery
K. Ericsson, A. Lehmann (1996)
Expert and exceptional performance: evidence of maximal adaptation to task constraints.Annual review of psychology, 47
Cynthia Silber, T. Nasca, David Paskin, G. Eiger, M. Robeson, J. Veloski (2004)
Do Global Rating Forms Enable Program Directors to Assess the ACGME Competencies?Academic Medicine, 79
J Gray (1996)
Global rating scales in residency educationAcademic Medicine, 71
(Boshuizen, H. P. A. (1989). The development of medical expertise; a cognitive-psychological approach. Doctoral dissertation. Maastricht: Rijksuniversiteit Limburg.)
Boshuizen, H. P. A. (1989). The development of medical expertise; a cognitive-psychological approach. Doctoral dissertation. Maastricht: Rijksuniversiteit Limburg.Boshuizen, H. P. A. (1989). The development of medical expertise; a cognitive-psychological approach. Doctoral dissertation. Maastricht: Rijksuniversiteit Limburg., Boshuizen, H. P. A. (1989). The development of medical expertise; a cognitive-psychological approach. Doctoral dissertation. Maastricht: Rijksuniversiteit Limburg.
Pie Hobus, H. Schmidt, H. Boshuizen, V. Patel (1987)
Contextual factors in the activation of first diagnostic hypotheses: expert‐novice differencesMedical Education, 21
(2006)
Expertise in medicine and surgeryThe Cambridge handbook of expertise and expert performance
C. VanBarneveld (2005)
The dependability of medical students' performance ratings as documented on in-training evaluations.Academic Medicine, 80
LD Gruppen (2002)
10.1007/978-94-010-0462-6_8
A. Denisi (1996)
A cognitive approach to performance appraisal : a program of research
E. Hawe (2003)
'It's Pretty Difficult to Fail': The reluctance of lecturers to award a failing gradeAssessment & Evaluation in Higher Education, 28
M. Chi (1997)
Quantifying Qualitative Analyses of Verbal Data: A Practical GuideThe Journal of the Learning Sciences, 6
J. Arts, W. Gijselaers, H. Boshuizen (2006)
Understanding managerial problem-solving, knowledge use and information processing: Investigating stages from school to the workplaceContemporary Educational Psychology, 31
Neal Mero, S. Motowidlo, A. Anna (2003)
Effects of Accountability on Rating Behavior and Rater AccuracyJournal of Applied Social Psychology, 33
(1983)
Individual differences in the solving of social science problems
M. Chi, P. Feltovich, R. Glaser (1981)
Categorization and Representation of Physics Problems by Experts and NovicesCogn. Sci., 5
H. Sacks (1985)
Readings in Medical Artificial Intelligence: The First DecadeJAMA, 253
(2006)
Professional judgments and “naturalistic decision making”The Cambridge handbook of expertise and expert performance
H. Schmidt, H. Boshuizen (1993)
On the origin of intermediate effects in clinical case recallMemory & Cognition, 21
Reed Williams, G. Dunnington (2004)
Prognostic value of resident clinical performance ratings.Journal of the American College of Surgeons, 199 4
Donna Sabers, Katherine Cushing, D. Berliner (1991)
Differences Among Teachers in a Task Characterized by Simultaneity, Multidimensional, and Immediacy, 28
Reed Williams, Debra Klamen, W. McGaghie (2003)
SPECIAL ARTICLE: Cognitive, Social and Environmental Sources of Bias in Clinical Performance RatingsTeaching and Learning in Medicine, 15
K. Ericsson, N. Charness, P. Feltovich, R. Hoffman (2006)
The Cambridge handbook of expertise and expert performance
C. Kreiter, K. Ferguson (2001)
Examining the Generalizability of Ratings across Clerkships Using a Clinical Evaluation FormEvaluation & the Health Professions, 24
P. Feltovich, P. Johnson, J. Moller (1984)
LCS: The role and development of medivcal knowledge in diagnostic expertise
Judith Kerrins, Katherine Cushing (2000)
Taking a Second Look: Expert and Novice Differences when Observing the Same Classroom Teaching Segment a Second TimeJournal of Personnel Evaluation in Education, 14
C. Vleuten (2005)
Assessing professional competence : from methods to programmes
GR Norman (1989)
10.1037/0278-7393.15.6.1166Journal of Experimental Psychology. Learning, Memory, and Cognition, 15
J. Kim (2009)
Clinical Reasoning:Neurology, 73
M. Wiel, H. Boshuizen, H. Schmidt (2000)
Knowledge restructuring in expertise development: Evidence from pathophysiological representations of clinical cases by students and physiciansEuropean Journal of Cognitive Psychology, 12
R. Cardy, H. Bernardin, J. Abbott, M. Senderak, Karen Taylor (1987)
The effects of individual performance schemata and dimension familiarization on rating accuracyJournal of occupational psychology, 60
J. Norcini (2005)
Current perspectives in assessment: the assessment of performance at workMedical Education, 39
A. Field, J. Miles (2000)
Discovering Statistics Using SPSS
K. Murphy, J. Cleveland (1995)
Understanding Performance Appraisal: Social, Organizational, and Goal-Based Perspectives
J. Cunnington, L. Southgate (2002)
Relicensure, Recertification and Practice-Based Assessment
G. Norman, C. Vleuten, D. Newble, D. Dolmans, K. Mann, A. Rothman, L. Curry (2002)
International handbook of research in medical education
Gary Klein (1993)
Decision Making in Action: Models and Methods
Gary Klein (2008)
Naturalistic Decision MakingHuman Factors: The Journal of Human Factors and Ergonomic Society, 50
K. Ericsson (2006)
The Influence of Experience and Deliberate Practice on the Development of Superior Expert Performance
M. Chi, N. Leeuw, M. Chiu, Christian LaVancher (1994)
Eliciting Self-Explanations Improves UnderstandingCogn. Sci., 18
J. Feldman (1981)
Beyond Attribution Theory: Cognitive Processes in Performance AppraisalJournal of Applied Psychology, 66
G. Norman, L. Brooks, S. Allen (1989)
Recall by expert medical practitioners and novices as a record of processing attention.Journal of experimental psychology. Learning, memory, and cognition, 15 6
R. Dillon, R. Schmeck (1983)
Individual differences in cognition
K. Murphy, W. Balzer (1986)
Systematic distortions in memory-based behavior ratings and performance evaluations: Consequences for rating accuracy.Journal of Applied Psychology, 71
Filip Lievens (2001)
Assessor training strategies and their effects on accuracy, interrater reliability, and discriminant validity.The Journal of applied psychology, 86 2
K. Eva (2005)
What every teacher needs to know about clinical reasoningMedical Education, 39
J. Walsh (1995)
Managerial and Organizational Cognition: Notes from a Trip Down Memory LaneOrganization Science, 6
CPM Vleuten Van der (2005)
10.1111/j.1365-2929.2005.02094.xMedical Education, 39
Traditional psychometric approaches towards assessment tend to focus exclusively on quantitative properties of assessment outcomes. This may limit more meaningful educational approaches towards workplace-based assessment (WBA). Cognition-based models of WBA argue that assessment outcomes are determined by cognitive processes by raters which are very similar to reasoning, judgment and decision making in professional domains such as medicine. The present study explores cognitive processes that underlie judgment and decision making by raters when observing performance in the clinical workplace. It specifically focuses on how differences in rating experience influence information processing by raters. Verbal protocol analysis was used to investigate how experienced and non-experienced raters select and use observational data to arrive at judgments and decisions about trainees’ performance in the clinical workplace. Differences between experienced and non-experienced raters were assessed with respect to time spent on information analysis and representation of trainee performance; performance scores; and information processing––using qualitative-based quantitative analysis of verbal data. Results showed expert-novice differences in time needed for representation of trainee performance, depending on complexity of the rating task. Experts paid more attention to situation-specific cues in the assessment context and they generated (significantly) more interpretations and fewer literal descriptions of observed behaviors. There were no significant differences in rating scores. Overall, our findings seemed to be consistent with other findings on expertise research, supporting theories underlying cognition-based models of assessment in the clinical workplace. Implications for WBA are discussed.
Advances in Health Sciences Education – Springer Journals
Published: Sep 30, 2010
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.