Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Inconvenient Samples: Modeling Biases Related to Parental Consent by Coupling Observational and Experimental Results

Inconvenient Samples: Modeling Biases Related to Parental Consent by Coupling Observational and... In studies involving human subjects, voluntary participation may lead to sampling bias, thus limiting the generalizability of findings. This effect may be especially pronounced in developmental studies, where parents serve as both the primary environmental input and decision maker of whether their child participates in a study. We present a novel empirical and modeling approach to estimate how parental consent may bias measurements of children’s behavior. Specifically, we coupled naturalistic observations of parent–child interactions in public spaces with a behavioral test with children, and used modeling methods to impute the behavior of children who did not participate. Results showed that parents’ tendency to use questions to teach was associated with both children’s behavior in the test and parents’ tendency to participate. Exploiting these associations with a model-based multiple imputation and a propensity score–matching procedure, we estimated that the means of the participating and not-participating groups could differ as much as 0.23 standard deviations for the test measurements, and standard deviations themselves are likely underestimated. These results suggest that ignoring factors associated with consent may lead to systematic biases when generalizing beyond lab samples, and the proposed general approach provides a way to estimate these biases in future research. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Open Mind MIT Press

Inconvenient Samples: Modeling Biases Related to Parental Consent by Coupling Observational and Experimental Results

Open Mind , Volume 4: 12 – Mar 6, 2020

Loading next page...
 
/lp/mit-press/inconvenient-samples-modeling-biases-related-to-parental-consent-by-VkDvwxLKiC

References (52)

Publisher
MIT Press
Copyright
Copyright © MIT Press
eISSN
2470-2986
DOI
10.1162/opmi_a_00031
Publisher site
See Article on Publisher Site

Abstract

In studies involving human subjects, voluntary participation may lead to sampling bias, thus limiting the generalizability of findings. This effect may be especially pronounced in developmental studies, where parents serve as both the primary environmental input and decision maker of whether their child participates in a study. We present a novel empirical and modeling approach to estimate how parental consent may bias measurements of children’s behavior. Specifically, we coupled naturalistic observations of parent–child interactions in public spaces with a behavioral test with children, and used modeling methods to impute the behavior of children who did not participate. Results showed that parents’ tendency to use questions to teach was associated with both children’s behavior in the test and parents’ tendency to participate. Exploiting these associations with a model-based multiple imputation and a propensity score–matching procedure, we estimated that the means of the participating and not-participating groups could differ as much as 0.23 standard deviations for the test measurements, and standard deviations themselves are likely underestimated. These results suggest that ignoring factors associated with consent may lead to systematic biases when generalizing beyond lab samples, and the proposed general approach provides a way to estimate these biases in future research.

Journal

Open MindMIT Press

Published: Mar 6, 2020

There are no references for this article.