Access the full text.
Sign up today, get DeepDyve free for 14 days.
Paul Wimmers, Ming Lee (2015)
Identifying longitudinal growth trajectories of learning domains in problem-based learning: a latent growth curve modeling approach using SEMAdvances in Health Sciences Education, 20
A. Walker, Heather Leary (2009)
A Problem Based Learning Meta Analysis: Differences across Problem Types, Implementation Types, Disciplines, and Assessment Levels.Interdisciplinary Journal of Problem-based Learning, 3
S. Sim, N. Azila, L. Lian, C. Tan, N. Tan (2006)
A simple instrument for the assessment of student performance in problem-based learning tutorials.Annals of the Academy of Medicine, Singapore, 35 9
G. Boulton‐Lewis (2008)
Teaching for quality learning at university
R. Shavelson, M. Ruiz-Primo, E. Wiley (1999)
Note On Sources of Sampling Variability in Science Performance AssessmentsJournal of Educational Measurement, 36
L. Distlehorst, Elizabeth Dawson, R. Robbs, H. Barrows (2005)
Problem-Based Learning Outcomes: The Glass Half-FullAcademic Medicine, 80
R Myers (1990)
Classical and modern regression with applications
T. Hak, P. Maguire (2000)
Group Process: The Black Box of Studies on Problem‐based LearningAcademic Medicine, 75
H. Barrows (1986)
A taxonomy of problem‐based learning methodsMedical Education, 20
D Gijbels, P Bossche, S Loyens (2012)
International guide to student achievement
J. Colliver (2000)
Effectiveness of Problem‐based Learning Curricula: Research and TheoryAcademic Medicine, 75
L. Berkson (1993)
Problem‐based learning: have the expectations been met?Academic Medicine, 68
D. Vernon, R. Blake (1993)
Does problem‐based learning work? A meta‐analysis of evaluative researchAcademic Medicine, 68
(2004)
Formative and summative assessment of the problem-based learning tutorial session using a criterion-referenced system
RJ Marzano, D Pickering, J McTighe (1993)
Assessing student outcomes
J Strobel, A Barneveld (2009)
When is PBL more effective? A meta-synthesis of meta-analyses comparing PBL to conventional classroomsInterdisciplinary Journal of Problem Based Learning, 3
J. Nijhuis, M. Segers, W. Gijselaers (2008)
The extent of variability in learning strategies and students' perceptions of the learning environmentLearning and Instruction, 18
(1983)
Manual for GENOVA: A generalized analysis of variance system
Reed Williams, Debra Klamen, W. McGaghie (2003)
SPECIAL ARTICLE: Cognitive, Social and Environmental Sources of Bias in Clinical Performance RatingsTeaching and Learning in Medicine, 15
C. Painvin, V. Neuféld, G. Norman, I. Walker, G. Whelan (1979)
The "triple jump" exercise--a structured measure of problem solving and self directed learning.Annual Conference on Research in Medical Education. Conference on Research in Medical Education, 18
R Williams, D Klamen, W McGaghie (2003)
Cognitive, social and environmental sources of bias in clinical performance ratingsTeaching and Learning in Medicine, 15
Geoffrey Norman, Henk Schmidt (2000)
Effectiveness of problem‐based learning curricula: theory, practice and paper dartsMedical Education, 34
G. Norman, H. Schmidt (1992)
The psychological basis of problem‐based learning: a review of the evidenceAcademic Medicine, 67
S. Kinkade (2005)
A Snapshot of the Status of Problem-Based Learning in U. S. Medical Schools, 2003–04Academic Medicine, 80
O. Cate, R. Kusurkar, Geoffrey Williams (2011)
How self-determination theory can assist our understanding of the teaching and learning processes in medical education. AMEE Guide No. 59Medical Teacher, 33
D. Eignor (2013)
The standards for educational and psychological testing.
R. Hébert, G. Bravo (1996)
Development and validation of an evaluation instrument for medical students in tutorialsAcademic Medicine, 71
R. John (1986)
Linear Statistical Models: An Applied Approach
D. Allen, R. Donham, S. Bernhardt (2011)
Problem‐based learningNew Directions for Teaching and Learning, 2011
D. Dolmans, D. Gijbels (2013)
Research on problem‐based learning: future challengesMedical Education, 47
H. Schmidt, J. Rotgans, Elaine Yew (2011)
The process of problem‐based learning: what works and whyMedical Education, 45
Johannes Strobel, Angela Barneveld
Interdisciplinary Journal of Problem-based Learning Volume 3 Issue 1 Special Issue on the Efficacy of Problem-based Learning When Is Pbl More Effective? a Meta-synthesis of Meta-analyses Comparing Pbl to Conventional Classrooms
(2006)
Reliability coefficients and generalizability theory
(1990)
Classical and modern regression with applications (2nd ed.)
DA Kilroy (2004)
Problem based learningEmergency Medicine Journal, 21
Marlies Baeten, E. Kyndt, K. Struyven, F. Dochy (2010)
Using student-centred learning environments to stimulate deep approaches to learning: Factors encouraging or discouraging their effectivenessEducational Research Review, 5
Richard Shavelson, Noreen Webb (1991)
Generalizability Theory: A Primer
C. Levine (2006)
Quantitative Applications in the Social Sciences
E. Ziegel, Bruce Bowerman, Richard O'Connell (1992)
Linear Statistical Models: An Applied Approach.Biometrics, 48
M. Albanese, Susan Mitchell (1993)
Problem‐based Learning: A Review of Literature on Its Outcomes and Implementation IssuesAcademic Medicine, 68
W. Tavares, K. Eva (2013)
Exploring the impact of mental workload on rater-based assessmentsAdvances in Health Sciences Education, 18
R. Shavelson, G. Baxter, Xiaohong Gao (1993)
Sampling Variability of Performance Assessments.Journal of Educational Measurement, 30
(2002)
Trends in research on the tutor in PBL: Conclusions and implications for educational practice and research
P. Lachenbruch (1989)
Statistical Power Analysis for the Behavioral Sciences (2nd ed.)Journal of the American Statistical Association, 84
(1993)
Assessing student outcomes. Alexandria, VA: Association for Supervision and Curriculum Development
J. Koenig, S. Sireci, A. Wiley (1998)
Evaluating the Predictive Validity of MCAT Scores across Diverse Applicant GroupsAcademic Medicine, 73
D. Gijbels, F. Dochy, P. Bossche, M. Segers (2005)
Effects of Problem-Based Learning: A Meta-Analysis From the Angle of AssessmentReview of Educational Research, 75
Rosamaría Valle, Lleana Petra, Adrian Martínez‐Gonzáez, J. Rojas-Ramírez, Sara Morales-López, Beatriz Piña‐Garza (1999)
Assessment of student performance in problem‐based learning tutorial sessionsMedical Education, 33
Although problem-based learning (PBL) has been widely used in medical schools, few studies have attended to the assessment of PBL processes using validated instruments. This study examined reliability and validity for an instrument assessing PBL performance in four domains: Problem Solving, Use of Information, Group Process, and Professionalism. Two cohorts of medical students (N = 310) participated in the study, with 2 years of PBL evaluation data extracted from archive rated by a total of 158 faculty raters. Analyses based on generalizability theory were conducted for reliability examination. Validity was examined through following the Standards for Educational and Psychological Testing to evaluate content validity, response processes, construct validity, predictive validity, and the relationship to the variable of training. For construct validity, correlations of PBL scores with six other outcome measures were examined, including Medical College Admission Test, United States Medical Licensing Examination (USMLE) Step 1, National Board of Medical Examiners (NBME) Comprehensive Basic Science Examination, NBME Comprehensive Clinical Science Examination, Clinical Performance Examination, and USMLE Step 2 Clinical Knowledge. Predictive validity was examined by using PBL scores to predict five medical school outcomes. The highest percentage of PBL total score variance was associated with students (60 %), indicating students in the study differed in their PBL performance. The generalizability and dependability coefficients were moderately high (Ep2 = .68, ϕ = .60), showing the instrument is reliable for ranking students and identifying competent PBL performers. The patterns of correlations between PBL domain scores and the outcome measures partially support construct validity. PBL performance ratings as a whole significantly (p < .01) predicted all the major medical school achievements. The second year PBL scores were significantly higher than those of the first year, indicating a training effect. Psychometric findings provided support for reliability and many aspects of validity of PBL performance assessment using the instrument.
Advances in Health Sciences Education – Springer Journals
Published: Aug 26, 2015
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.