Access the full text.
Sign up today, get DeepDyve free for 14 days.
T. Haladyna, S. Downing, Michael Rodriguez (2002)
A Review of Multiple-Choice Item-Writing Guidelines for Classroom AssessmentApplied Measurement in Education, 15
S. Downing (2002)
Construct‐irrelevant Variance and Flawed Test Questions: Do Multiple‐choice Item‐writing Principles Make Any Difference?Academic Medicine, 77
J. Norcini, D. Swanson, L. Grosso, J. Shea, G. Webster (1984)
A Comparison of Knowledge, Synthesis, and Clinical JudgmentEvaluation & the Health Professions, 7
N. Gronlund (1997)
Assessment of student achievement
R. Godfrey (1995)
Undergraduate examinations—a continuing tyrannyThe Lancet, 345
T.M. Haladyna, S.M. Downing, M.C. Rodriguez (2002)
A review of multiple-choice item writing guidelinesApplied Meas Education, 15
R. Renger, L. Meadows (1994)
Testing for predictive validity in health care education research: a critical reviewAcademic Medicine, 69
S. Case, D. Swanson, D. Becker (1996)
Verbosity, window dressing, and red herrings: do they make a better test item?Academic Medicine, 71
S.M. Case, D.B. Swanson (1998)
Constructing Written Test Questions for the Basic and Clinical Sciences
K. Duffield, J. Spencer (2002)
A survey of medical students’ views about the purposes and fairness of assessmentMedical Education, 36
N. Frederiksen (1984)
The real test bias: Influences of testing on teaching and learning.American Psychologist, 39
R. Józefowicz, B. Koeppen, S. Case, R. Galbraith, D. Swanson, R. Glew (2002)
The Quality of In‐house Medical School ExaminationsAcademic Medicine, 77
C. Vleuten, Geoffrey Norman, E. Graaff (1991)
Pitfalls in the pursuit of objectivity: issues of reliabilityMedical Education, 25
D.B. Swanson, S.M. Case (1992)
Approaches to the Assessment of Critical Competence: Part 1
Purpose:In conjunction with curricular changes, a process to develop integrated examinations was implemented. Pre-established guidelines were provided favoring vignettes, clinically relevant material, and application of knowledge rather than simple recall. Questions were read aloud in a committee including all course directors, and a reviewer with National Board of Medical Examiners (NBME) item writing and review experience. This study examines the effectiveness of this process to improve the quality of in-house examinations. Methods:Five hundred and twenty items were randomly selected from two academic years for initial comparison; 270 from 2000 to 2001, and 250 from 2001 to 2002. The first set of items represented the style, content and format when courses and tests were departmentally/discipline based, assembled by course directors, and administered separately. The latter group represented similar characteristics when courses and tests were organ-system-based, committee-reviewed and administered in an integrated examination. Items were randomized, blinded for year of origin, and rated by three NBME staff members with extensive item review experience. A five-point rating scale was used: one indicated a technically flawed item assessing recall of an isolated fact; five indicated a technically unflawed item assessing application of knowledge. To assess continued improvement, a follow-up set of 250 items from the 2002 to 2003 academic year was submitted to the same three reviewers who were not informed of the purpose or origin of this set of test items Results:The mean rating for items from 2000 to 2001 was 2.51 ± 1.27; analogous values for 2001–2002 were 3.16 ± 1.33, (t = 5.83; p < 0.0001), and in 2002–2003; 3.59 ± 1.15 (t = 10.11; p<0.0001). Conclusion:Pre-established guidelines and an interdisciplinary review process resulted in improved item quality for in-house examinations.
Advances in Health Sciences Education – Springer Journals
Published: Dec 10, 2004
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.