Access the full text.
Sign up today, get an introductory month for just $19.
S. Dennis, M. Lee, A. Kinnell (2007)
Bayesian Analysis of Recognition Memory: The Case of the List-Length Effect
Jacob Cohen (1994)
The earth is round (p < .05)American Psychologist, 49
Ruud Wetzels, J. Raaijmakers, E. Jakab, E. Wagenmakers (2009)
How to quantify support for and against the null hypothesis: A flexible WinBUGS implementation of a default Bayesian t testPsychonomic Bulletin & Review, 16
J. Berger, Mohan Delampady (1987)
Testing Precise HypothesesStatistical Science, 2
J. Kruschke (2010)
What to believe: Bayesian methods for data analysisTrends in Cognitive Sciences, 14
Feng Liang, Rui Paulo, Germán Molina, M. Clyde, J. Berger (2008)
Mixtures of g Priors for Bayesian Variable SelectionJournal of the American Statistical Association, 103
J. Hilbe (2009)
Data Analysis Using Regression and Multilevel/Hierarchical ModelsJournal of Statistical Software, 30
Jeffrey Rouder, Jun Lu (2005)
An introduction to Bayesian hierarchical models with an application in the theory of signal detectionPsychonomic Bulletin & Review, 12
Robert Kass, A. Raftery (1995)
Bayes factors
L. Wasserman (2004)
All of Statistics: A Concise Course in Statistical Inference
Peter Killeen (2005)
An Alternative to Null-Hypothesis Significance TestsPsychological Science, 16
I., Douglas Wo, Wrginia (2006)
Weight of Evidence : A Brief Survey
(1987)
Bayesian Statistics, a Review
Statistical Evidence in Experimental Psychology: An Empirical Comparison Using 855 t Tests that indicates the evidence to be only anecdotal or "worth no more than a bare mention
E. Wagenmakers (2007)
A practical solution to the pervasive problems ofp valuesPsychonomic Bulletin & Review, 14
M. Lee (2011)
How cognitive modeling can benefit from hierarchical Bayesian models.Journal of Mathematical Psychology, 55
Kate DeCleene, Jennifer Fogo (2012)
Publication Manual of the American Psychological AssociationOccupational Therapy In Health Care, 26
P. Killeen (2006)
Beyond statistical inference: a decision theory for science.Psychonomic bulletin & review, 13 4
G. Loftus (1996)
Psychology Will Be a Much Better Science When We Change the Way We Analyze DataCurrent Directions in Psychological Science, 5
J. Weiss, D. Weiss (2008)
Bayesian Statistical Inference for Psychological Research
R. Frick (1996)
The appropriate use of null hypothesis testing.Psychological Methods, 1
G. Howard, S. Maxwell, Kevin Fleming (2000)
The proof of the pudding: an illustration of the relative strengths of null hypothesis, meta-analysis, and Bayesian analysis.Psychological methods, 5 3
R. Rosenthal, D. Rubin (1982)
A Simple, General Purpose Display of Magnitude of Experimental EffectJournal of Educational Psychology, 74
Z. Diénès (2008)
Understanding Psychology as a Science: An Introduction to Scientific and Statistical Inference
D. Hinkley (1987)
Testing a Point Null Hypothesis: The Irreconcilability of P Values and Evidence: CommentJournal of the American Statistical Association, 82
Joseph Lebacqz (1967)
SUBJECTIVE AND OBJECTIVEThe Heythrop Journal, 8
Wolf Vanpaemel (2011)
Constructing informative model priors using hierarchical methodsJournal of Mathematical Psychology, 55
A. Kolmogorov, Nathan Morrison, A. Bharucha-Reid
Theory of ProbabilityNature, 124
C. Gallistel, See Rouder
The Importance of Proving the Null
Z. Dienes (2011)
Bayesian Versus Orthodox Statistics: Which Side Are You On?Perspectives on Psychological Science, 6
G. Gigerenzer (1993)
The superego, the ego, and the id in statistical reasoning
(2003)
Psychological Review, 112, 662–668
Jeffrey Rouder, P. Speckman, Dongchu Sun, R. Morey, G. Iverson (2009)
Bayesian t tests for accepting and rejecting the null hypothesisPsychonomic Bulletin & Review, 16
G. Cumming (2008)
Replication and p Intervals: p Values Predict the Future Only Vaguely, but Confidence Intervals Do Much BetterPerspectives on Psychological Science, 3
L. Wasserman (2004)
All of StatisticsTechnometrics, 46
John Ioannidis (2005)
Why Most Published Research Findings Are FalsePLoS Medicine, 2
T. Mussweiler (2006)
Doing Is for Thinking!Psychological Science, 17
David Lunn, Andrew Thomas, N. Best, D. Spiegelhalter (2000)
WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibilityStatistics and Computing, 10
(1998)
We need statistical thinking, not statistical rituals
R. Rosenthal (1990)
How are we doing in soft psychologyAmerican Psychologist, 45
E. Wagenmakers, P. Grünwald (2006)
A Bayesian Perspective on Hypothesis TestingPsychological Science, 17
J. Kerkering (2003)
Subjective and Objective Bayesian Statistics: Principles, Models, and ApplicationsTechnometrics, 45
M. Pitt, I. Myung, Shaobo Zhang (2002)
Toward a method of selecting among computational models of cognition.Psychological review, 109 3
F. Schmidt (1996)
Statistical Significance Testing and Cumulative Knowledge in Psychology: Implications for Training of ResearchersPsychological Methods, 1
B. Thompson (2002)
What Future Quantitative Social Science Research Could Look Like: Confidence Intervals for Effect SizesEducational Researcher, 31
I. Good (1983)
Good Thinking: The Foundations of Probability and Its Applications
E. Erdfelder (2010)
Experimental psychology: a note on statistical analysis.Experimental psychology, 57 1
R. Hagen (1997)
In praise of the null hypothesis statistical test.American Psychologist, 52
(1988)
The likelihood principle (2nd ed.)
J. Berger, T. Sellke (1987)
Testing a Point Null Hypothesis: The Irreconcilability of P Values and EvidenceJournal of the American Statistical Association, 82
J. Kruschke (2010)
Bayesian data analysis.Wiley interdisciplinary reviews. Cognitive science, 1 5
R. Nickerson (2000)
Null hypothesis significance testing: a review of an old and continuing controversy.Psychological methods, 5 2
D. Bem (2011)
Feeling the future: experimental evidence for anomalous retroactive influences on cognition and affect.Journal of personality and social psychology, 100 3
M. Gönen, W. Johnson, Yonggang Lu, P. Westfall (2005)
The Bayesian Two-Sample t TestThe American Statistician, 59
P. Dixon (2003)
The p-value fallacy and how to avoid it.Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale, 57 3
Ruud Wetzels, M. Lee, E. Wagenmakers (2010)
Bayesian inference using WBDev: A tutorial for social scientistsBehavior Research Methods, 42
M. Lee, E. Wagenmakers (2005)
Bayesian statistical inference in psychology: comment on Trafimow (2003).Psychological review, 112 3
J. Cortina, W. Dunlap (1997)
On the Logic and Purpose of Significance TestingPsychological Methods, 2
F. Richard, C. Bond, J. Stokes-Zoota (2003)
One Hundred Years of Social Psychology Quantitatively DescribedReview of General Psychology, 7
Leland Wilkinson (1999)
Statistical Methods in Psychology Journals: Guidelines and ExplanationsAmerican Psychologist, 54
E. Wagenmakers, Ruud Wetzels, D. Borsboom, H.L.J. Maas (2011)
Why Psychologists Must Change the Way They Analyze Their Data: the Case of Psi: Comment on Bem (2011)
(2000)
A special issue on model selection
G. Keren, Charles Lewis (1993)
A Handbook for data analysis in the behavioral sciences : methodological issues
(2010)
Doing Bayesian data analysis: A tutorial introduction with R and BUGS
M. Lee (2008)
Three case studies in the Bayesian analysis of cognitive modelsPsychonomic Bulletin & Review, 15
James Scott, J. Berger (2006)
An exploration of aspects of Bayesian multiple testingJournal of Statistical Planning and Inference, 136
E. Wagenmakers, T. Lodewyckx, Himanshu Kuriyal, R. Grasman (2010)
Bayesian hypothesis testing for psychologists: A tutorial on the Savage–Dickey methodCognitive Psychology, 60
Rui Yao (2011)
Publication Manual of the American Psychological AssociationFamily and Consumer Sciences Research Journal, 39
E. Jaynes, T. Grandy, Ray Smith, Tom Loredo, M. Tribus, J. Skilling, G. Bretthorst (2005)
Probability theory: the logic of scienceThe Mathematical Intelligencer, 27
J. Kruschke (2011)
Bayesian Assessment of Null Values Via Parameter Estimation and Model ComparisonPerspectives on Psychological Science, 6
T. DiCiccio, R. Kass, A. Raftery, L. Wasserman (1997)
Computing Bayes Factors by Combining Simulation and Asymptotic ApproximationsJournal of the American Statistical Association, 92
J. I (1936)
The Design of ExperimentsNature, 137
H. Wainer (1999)
One cheer for null hypothesis significance testing.Psychological Methods, 4
Statistical inference in psychology has traditionally relied heavily on p-value significance testing. This approach to drawing conclusions from data, however, has been widely criticized, and two types of remedies have been advocated. The first proposal is to supplement p values with complementary measures of evidence, such as effect sizes. The second is to replace inference with Bayesian measures of evidence, such as the Bayes factor. The authors provide a practical comparison of p values, effect sizes, and default Bayes factors as measures of statistical evidence, using 855 recently published t tests in psychology. The comparison yields two main results. First, although p values and default Bayes factors almost always agree about what hypothesis is better supported by the data, the measures often disagree about the strength of this support; for 70% of the data sets for which the p value falls between .01 and .05, the default Bayes factor indicates that the evidence is only anecdotal. Second, effect sizes can provide additional evidence to p values and default Bayes factors. The authors conclude that the Bayesian approach is comparatively prudent, preventing researchers from overestimating the evidence in favor of an effect.
Perspectives on Psychological Science – SAGE
Published: May 1, 2011
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get an introductory month for just $19.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.