Access the full text.
Sign up today, get DeepDyve free for 14 days.
Loading next page...
/lp/spie/multireader-multicase-reader-studies-with-binary-agreement-data-n003O0V6t1
References (32)
-
Cheryl Roe, C. Metz (1997)
Dorfman-Berbaum-Metz method for statistical analysis of multireader, multimodality receiver operating characteristic data: validation with computer simulation.Academic radiology, 4 4
-
S. Krishnamurthy, Kurt Mathews, S. McClure, Melissa Murray, M. Gilcrease, C. Albarracin, J. Spinosa, Bernard Chang, J. Ho, J. Holt, A. Cohen, D. Giri, K. Garg, R. Bassett, Kevin Liang (2013)
Multi-institutional comparison of whole slide digital imaging and optical microscopy for interpretation of hematoxylin-eosin-stained breast tissue sections.Archives of pathology & laboratory medicine, 137 12
-
S. Hillis (2007)
A comparison of denominator degrees of freedom methods for multiple observer ROC analysisStatistics in Medicine, 26
-
R. Wagner, S. Beiden, G. Campbell, C. Metz, W. Sacks (2002)
Assessment of medical imaging and computer-assist systems: lessons from recent experience.Academic radiology, 9 11
-
D. Dorfman, K. Berbaum, C. Metz (1992)
Receiver operating characteristic rating analysis. Generalization to the population of readers and patients with the jackknife method.Investigative radiology, 27 9
-
N. Velez, D. Jukic, J. Ho (2008)
Evaluation of 2 whole-slide imaging applications in dermatopathology.Human pathology, 39 9
-
C. Metz (1978)
Basic principles of ROC analysis.Seminars in nuclear medicine, 8 4
-
S. Beiden, Robert Wagner, Gregory Campbell (2000)
Components-of-variance models and multiple-bootstrap experiments: an alternative method for random-effects, receiver operating characteristic analysis.Academic radiology, 7 5
-
Cheryl Roe, Charles Metz (1997)
Variance-component modeling in the analysis of receiver operating characteristic index estimates.Academic radiology, 4 8
-
B. Gallas, S. Hillis (2014)
Generalized Roe and Metz receiver operating characteristic model: analytic link between simulated decision scores and empirical AUC variances and covariancesJournal of Medical Imaging, 1
-
B. Gallas, H. Chan, C. D'Orsi, L. Dodd, M. Giger, D. Gur, E. Krupinski, C. Metz, K. Myers, N. Obuchowski, B. Sahiner, A. Toledano, M. Zuley (2012)
Evaluating imaging and computer-aided detection and diagnosis devices at the FDA.Academic radiology, 19 4
-
J. Gilbertson, J. Ho, L. Anthony, D. Jukic, Y. Yagi, A. Parwani (2006)
Primary histologic diagnosis using automated whole slide imaging: a validation studyBMC Clinical Pathology, 6
-
Yulei Jiang, R. Nishikawa, R. Schmidt, Charles Metz, M. Giger, Kunio Doi (1999)
Improving breast cancer diagnosis with computer-aided diagnosis.Academic radiology, 6 1
-
R. Newcombe (1998)
Interval estimation for the difference between independent proportions: comparison of eleven methods.Statistics in medicine, 17 8
-
A. Renshaw, N. Cartagena, S. Granter, E. Gould (2003)
Agreement and error rates using blinded review to evaluate surgical pathology of biopsy material.American journal of clinical pathology, 119 6
-
B. Gallas, G. Pennello, K. Myers (2007)
Multireader multicase variance analysis for binary data.Journal of the Optical Society of America. A, Optics, image science, and vision, 24 12
-
N. Obuchowski, B. Gallas, S. Hillis (2012)
Multi-reader ROC studies with split-plot designs: a comparison of statistical methods.Academic radiology, 19 12
-
B. Gallas (2006)
One-shot estimate of MRMC variance: AUC.Academic radiology, 13 3
-
N. Obuchowski, H. Rockette (1995)
Hypothesis testing of diagnostic accuracy for multiple readers and multiple tests: An anova approach with dependent observationsCommunications in Statistics - Simulation and Computation, 24
-
B. Gallas, A. Bandos, F. Samuelson, R. Wagner (2009)
A Framework for Random-Effects ROC Analysis: Biases with the Bootstrap and Other Variance EstimatorsCommunications in Statistics - Theory and Methods, 38
-
S. Hillis (2014)
A marginal‐mean ANOVA approach for analyzing multireader multicase radiological imaging dataStatistics in Medicine, 33
-
J. Swets, R. Pickett (1982)
Evaluation of diagnostic systems : methods from signal detection theory -
S. Hillis, K. Berbaum, C. Metz (2008)
Recent developments in the Dorfman-Berbaum-Metz procedure for multireader ROC study analysis.Academic radiology, 15 5
-
R. Wagner, C. Metz, G. Campbell (2007)
Assessment of medical imaging systems and computer aids: a tutorial review.Academic radiology, 14 6
-
G. Gennaro, A. Toledano, C. Maggio, E. Baldan, E. Bezzon, M. Grassa, L. Pescarini, I. Polico, Alessandro Proietti, A. Toffoli, P. Muzzio (2010)
Digital breast tomosynthesis versus digital mammography: a clinical performance studyEuropean Radiology, 20
-
T. Bauer, L. Schoenfield, Renee Slaw, L. Yerian, Zhiyuan Sun, W. Henricks (2013)
Validation of whole slide imaging for primary diagnosis in surgical pathology.Archives of pathology & laboratory medicine, 137 4
-
Xiao Song, Xiao-Hua Zhou (2005)
A marginal model approach for analysis of multi-reader multi-test receiver operating characteristic (ROC) data.Biostatistics, 6 2
-
Weijie Chen, N. Petrick, B. Sahiner (2012)
Hypothesis testing in noninferiority and equivalence MRMC ROC studies.Academic radiology, 19 9
-
L. Emrich, M. Piedmonte (1991)
A Method for Generating High-Dimensional Multivariate Binary VariatesThe American Statistician, 45
-
S. Hillis, N. Obuchowski, K. Berbaum (2011)
Power estimation for multireader ROC methods an updated and unified approach.Academic radiology, 18 2
-
S. Hillis (2012)
Simulation of unequal-variance binormal multireader ROC decision data: an extension of the Roe and Metz simulation model.Academic radiology, 19 12
-
C. McCulloch, S. Searle (2001)
Generalized, Linear, and Mixed Models
- Publisher
- SPIE
- Copyright
- © 2014 Society of Photo-Optical Instrumentation Engineers (SPIE)
- Subject
- Special Section Papers; Paper
- ISSN
- 2329-4302
- eISSN
- 2329-4310
- DOI
- 10.1117/1.JMI.1.3.031011
- pmid
- 26158051
- Publisher site
- See Article on Publisher Site
Abstract
Abstract. We treat multireader multicase (MRMC) reader studies for which a reader’s diagnostic assessment is converted to binary agreement (1: agree with the truth state, 0: disagree with the truth state). We present a mathematical model for simulating binary MRMC data with a desired correlation structure across readers, cases, and two modalities, assuming the expected probability of agreement is equal for the two modalities ( P 1 = P 2 ). This model can be used to validate the coverage probabilities of 95% confidence intervals (of P 1 , P 2 , or P 1 − P 2 when P 1 − P 2 = 0 ), validate the type I error of a superiority hypothesis test, and size a noninferiority hypothesis test (which assumes P 1 = P 2 ). To illustrate the utility of our simulation model, we adapt the Obuchowski–Rockette–Hillis (ORH) method for the analysis of MRMC binary agreement data. Moreover, we use our simulation model to validate the ORH method for binary data and to illustrate sizing in a noninferiority setting. Our software package is publicly available on the Google code project hosting site for use in simulation, analysis, validation, and sizing of MRMC reader studies with binary agreement data.
Journal
Journal of Medical Imaging – SPIE
Published: Oct 1, 2014