Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Generalizability Theory and Experimental Design: Incongruity Between Analysis and Inference:

Generalizability Theory and Experimental Design: Incongruity Between Analysis and Inference: The inferences drawn from many statistical analyses are not congruent with the analyses performed. The analysis commonly employed when cognitive or affective measures serve as the dependent variable yields an inference that is rigorously generalizable only to the specific set of scales or items that were employed, and not to the intended universe of items of which the set used is viewed as a representative sample. The arguments in this paper show that if the items are incorporated into the design as levels of a random facet via generalizability theory, the inferential question in the desired universe of inference can be examined statistically. An estimate of the reliability (generalizability) of the outcome variable also accrues from the proposed analysis; consequently the statistical and measurement fidelity questions are unified in a single analysis. Advantages of nesting items within subjects are proposed. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png American Educational Research Journal SAGE

Generalizability Theory and Experimental Design: Incongruity Between Analysis and Inference:

Hopkins, Kenneth D
American Educational Research Journal , Volume 21 (3): 10 – Jun 24, 2016
Download PDF
10 pages

Loading next page...
 
/lp/sage/generalizability-theory-and-experimental-design-incongruity-between-owi2r4vHrI

References (19)

Publisher
SAGE
Copyright
Copyright © 2019 by American Educational Research Association
ISSN
0002-8312
eISSN
1935-1011
DOI
10.3102/00028312021003703
Publisher site
See Article on Publisher Site

Abstract

The inferences drawn from many statistical analyses are not congruent with the analyses performed. The analysis commonly employed when cognitive or affective measures serve as the dependent variable yields an inference that is rigorously generalizable only to the specific set of scales or items that were employed, and not to the intended universe of items of which the set used is viewed as a representative sample. The arguments in this paper show that if the items are incorporated into the design as levels of a random facet via generalizability theory, the inferential question in the desired universe of inference can be examined statistically. An estimate of the reliability (generalizability) of the outcome variable also accrues from the proposed analysis; consequently the statistical and measurement fidelity questions are unified in a single analysis. Advantages of nesting items within subjects are proposed.

Journal

American Educational Research Journal – SAGE

Published: Jun 24, 2016

There are no references for this article.