Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

The Impact of Cheating on Score Comparability via Pool‐Based IRT Pre‐equating

The Impact of Cheating on Score Comparability via Pool‐Based IRT Pre‐equating For any testing programs that administer multiple forms across multiple years, maintaining score comparability via equating is essential. With continuous testing and high‐stakes results, especially with less secure online administrations, testing programs must consider the potential for cheating on their exams. This study used empirical and simulated data to examine the impact of item exposure and prior knowledge on the estimation of item difficulty and test taker's ability via pool‐based IRT preequating. Raw‐to‐theta transformations were derived from two groups of test takers with and without possible prior knowledge of exposed items, and these were compared to a criterion raw to theta transformation. Results indicated that item exposure has a large impact on item difficulty, not only altering the difficulty of exposed items, but also altering the difficulty of unexposed items. Item exposure makes test takers with prior knowledge appear more able. Further, theta estimation bias for test takers without prior knowledge increases when more test takers with possible prior knowledge are in the calibration population. Score inflation occurs for test takers with and without prior knowledge, especially for those with lower abilities. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Journal of Educational Measurement Wiley

The Impact of Cheating on Score Comparability via Pool‐Based IRT Pre‐equating

Loading next page...
 
/lp/wiley/the-impact-of-cheating-on-score-comparability-via-pool-based-irt-pre-3MLI5NmnOy

References (6)

Publisher
Wiley
Copyright
© 2022 by the National Council on Measurement in Education.
ISSN
0022-0655
eISSN
1745-3984
DOI
10.1111/jedm.12321
Publisher site
See Article on Publisher Site

Abstract

For any testing programs that administer multiple forms across multiple years, maintaining score comparability via equating is essential. With continuous testing and high‐stakes results, especially with less secure online administrations, testing programs must consider the potential for cheating on their exams. This study used empirical and simulated data to examine the impact of item exposure and prior knowledge on the estimation of item difficulty and test taker's ability via pool‐based IRT preequating. Raw‐to‐theta transformations were derived from two groups of test takers with and without possible prior knowledge of exposed items, and these were compared to a criterion raw to theta transformation. Results indicated that item exposure has a large impact on item difficulty, not only altering the difficulty of exposed items, but also altering the difficulty of unexposed items. Item exposure makes test takers with prior knowledge appear more able. Further, theta estimation bias for test takers without prior knowledge increases when more test takers with possible prior knowledge are in the calibration population. Score inflation occurs for test takers with and without prior knowledge, especially for those with lower abilities.

Journal

Journal of Educational MeasurementWiley

Published: Jun 1, 2022

There are no references for this article.