Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

The questionnaire method in systems research: an overview of sample sizes, response rates and statistical approaches utilized in studies

The questionnaire method in systems research: an overview of sample sizes, response rates and... The purpose of this study is to identify typical sample sizes and response rates in questionnaire research studies within the discipline of information systems, as well as the top statistical analyses utilized for questionnaire data in these studies.Design/methodology/approachA total of 842 articles published between the years of 2000 and 2019 were identified that met the criteria of using a questionnaire as the research method. These articles were analyzed based on the sample size, response rate (if applicable) and statistical analysis methods used.FindingsThe typical questionnaire study received between 136 (first quartile) and 374 (third quartile) respondents, with a median number of 217. Typical response rate ranged between 16.5% and 50.0%, with a median of 27.8%. it was found that articles published in journals included in the Social Science Citation Index had significantly larger numbers of respondents than those not included in the index, though no difference was found for response rate. Studies that utilized more advanced statistical methods (regression analysis, structural equation modeling) were found to have significantly larger sample sizes than those that utilized only descriptive statistics or t-tests. Structural equation modeling, including the partial least squares approach, was used in the largest number of studies.Originality/valueThis study is the first to broadly examine the typical sample size, response rates and methods of statistical analysis used in information systems questionnaire studies. The findings of this study may be useful for systems researchers in developing appropriate procedures for questionnaire-based research. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png VINE Journal of Information and Knowledge Management Systems Emerald Publishing

The questionnaire method in systems research: an overview of sample sizes, response rates and statistical approaches utilized in studies

Download PDF
10 pages

Loading next page...
 
/lp/emerald-publishing/the-questionnaire-method-in-systems-research-an-overview-of-sample-K5bqF6hCla
Publisher
Emerald Publishing
Copyright
© Emerald Publishing Limited
ISSN
2059-5891
eISSN
2059-5891
DOI
10.1108/vjikms-08-2020-0156
Publisher site
See Article on Publisher Site

Abstract

The purpose of this study is to identify typical sample sizes and response rates in questionnaire research studies within the discipline of information systems, as well as the top statistical analyses utilized for questionnaire data in these studies.Design/methodology/approachA total of 842 articles published between the years of 2000 and 2019 were identified that met the criteria of using a questionnaire as the research method. These articles were analyzed based on the sample size, response rate (if applicable) and statistical analysis methods used.FindingsThe typical questionnaire study received between 136 (first quartile) and 374 (third quartile) respondents, with a median number of 217. Typical response rate ranged between 16.5% and 50.0%, with a median of 27.8%. it was found that articles published in journals included in the Social Science Citation Index had significantly larger numbers of respondents than those not included in the index, though no difference was found for response rate. Studies that utilized more advanced statistical methods (regression analysis, structural equation modeling) were found to have significantly larger sample sizes than those that utilized only descriptive statistics or t-tests. Structural equation modeling, including the partial least squares approach, was used in the largest number of studies.Originality/valueThis study is the first to broadly examine the typical sample size, response rates and methods of statistical analysis used in information systems questionnaire studies. The findings of this study may be useful for systems researchers in developing appropriate procedures for questionnaire-based research.

Journal

VINE Journal of Information and Knowledge Management Systems – Emerald Publishing

Published: Jan 2, 2023

Keywords: Surveys; Quantitative research; Questionnaires; Research; Information systems; Sample size

References

  • Sample size determination and statistical power analysis in PLS using R
    Aguirre-Urreta, M.; Ronkko, M.
  • The case research strategy in studies of information systems
    Benbasat, I.; Goldstein, D.K.; Mead, M.
  • Sample size considerations for multiple comparison procedures in ANOVA
    Brooks, G.P.; Johanson, G.A.
  • Why executives don’t respond to your survey
    Falconer, D.J.; Hodgett, R.A.
  • Integrating case study and survey research methods
    Gable, G.G.
  • Does PLS have advantages for small sample size or non-normal data?
    Goodhue, D.L.; Lewis, W.; Thompson, R.
  • Analyzing methodological rigor of MIS survey research from 1980-1989
    Grover, V.; Lee, C.C.; Durand, D.
  • Partial least squares structural equation modeling: an emerging tool for business research
    Hair, J.F.; Sarstedt, M.; Hopkins, L.; Kuppelwieser, V.
  • External validity in information systems survey research
    King, W.R.; He, J.
  • Sample sizes when using multiple linear regression for prediction
    Knofczynski, G.T.; Mundfrom, D.
  • Minimum sample size estimation in PLS-SEM
    Kock, N.; Hadaya, P.
  • Survey research methodology in management information systems: an assessment
    Pinsonneault, A.; Kraemer, K.
  • How big is big enough?’ Sample size and goodness of fit in structural equation models with latent variables
    Tanaka, J.S.
  • Lower bounds on sample size in structural equation modeling
    Westland, J.C.