Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Using Error/Tolerance Analysis to Design an Empirical Practice Analysis

Using Error/Tolerance Analysis to Design an Empirical Practice Analysis Practice analyses, in which professional practitioners describe their work, provide essential content-related validity evidence for licensure and certification tests by providing an empirical base for the test plan. This paper examines the precision of the category weights generated by practice analyses employing activity inventories. The standard errors in estimates of category weights are compared to the tolerance for error in these weights. The tolerance for error specifies how large errors can be before they interfere with the intended use of the measurement procedure. As an example, data from a practice-analysis study is used to assign weights to nine categories in a test plan. Estimates of standard errors are derived from G studies with activity statements nested within categories and crossed with respondents and occasions. The tolerance for error is specified in terms of the level of precision typically found in test plans. The results are used to determine the minimum number of activities needed for each category to satisfy the tolerance requirement. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Advances in Health Sciences Education Springer Journals

Using Error/Tolerance Analysis to Design an Empirical Practice Analysis

Advances in Health Sciences Education , Volume 5 (3) – Oct 1, 2004

Loading next page...
 
/lp/springer-journals/using-error-tolerance-analysis-to-design-an-empirical-practice-yf35Ne0GLp

References (16)

Publisher
Springer Journals
Copyright
Copyright © 2000 by Kluwer Academic Publishers
Subject
Education; Medical Education
ISSN
1382-4996
eISSN
1573-1677
DOI
10.1023/A:1009821413152
Publisher site
See Article on Publisher Site

Abstract

Practice analyses, in which professional practitioners describe their work, provide essential content-related validity evidence for licensure and certification tests by providing an empirical base for the test plan. This paper examines the precision of the category weights generated by practice analyses employing activity inventories. The standard errors in estimates of category weights are compared to the tolerance for error in these weights. The tolerance for error specifies how large errors can be before they interfere with the intended use of the measurement procedure. As an example, data from a practice-analysis study is used to assign weights to nine categories in a test plan. Estimates of standard errors are derived from G studies with activity statements nested within categories and crossed with respondents and occasions. The tolerance for error is specified in terms of the level of precision typically found in test plans. The results are used to determine the minimum number of activities needed for each category to satisfy the tolerance requirement.

Journal

Advances in Health Sciences EducationSpringer Journals

Published: Oct 1, 2004

There are no references for this article.