Access the full text.
Sign up today, get DeepDyve free for 14 days.
Loading next page...
/lp/wiley/statistical-inference-in-massive-data-sets-cPrlu0O8fb
References (15)
-
E. Wegman, D. Marchette (2003)
On Some Techniques for Streaming Data: A Case Study of Internet Packet HeadersJournal of Computational and Graphical Statistics, 12
-
M. Chao, G. Lin (1993)
The asymptotic distributions of the remediansJournal of Statistical Planning and Inference, 37
-
Rong Chen, P. Brockwell, R. Davis (1992)
Time Series: Theory and Methods (2nd ed.).Journal of the American Statistical Association, 87
-
D. Hand, G. Blunt, Mark Kelly, N. Adams (2000)
Data Mining for Fun and ProfitStatistical Science, 15
-
M. Wand, M. Jones (1995)
Kernel Smoothing -
Bernard Silverman (1987)
Density Estimation for Statistics and Data Analysis -
C. Dwork, Adam Smith (2010)
Differential Privacy for Statistics: What we Know and What we Want to LearnJ. Priv. Confidentiality, 1
-
S. Sheather, M. Jones (1991)
A reliable data-based bandwidth selection method for kernel density estimationJournal of the royal statistical society series b-methodological, 53
-
H. Mahmoud (2000)
Sorting: A Distribution Theory -
W. Cleveland, Don Sun (2000)
Internet Traffic DataJournal of the American Statistical Association, 95
-
(1995)
Low-storage quantile estimation -
J. McDermott, D. Lin (2007)
Quantile contours and multivariate density estimation for massive datasets via sequential convex hull peelingIIE Transactions, 39
-
T. Ferguson (1996)
A Course in Large Sample Theory -
P. Chaudhuri, J. Marron (1999)
SiZer for Exploration of Structures in CurvesJournal of the American Statistical Association, 94
-
P. Rousseeuw, G. Bassett (1990)
The Remedian: A Robust Averaging Method for Large Data SetsJournal of the American Statistical Association, 85
- Publisher
- Wiley
- Copyright
- Copyright © 2013 John Wiley & Sons, Ltd.
- ISSN
- 1524-1904
- eISSN
- 1526-4025
- DOI
- 10.1002/asmb.1927
- Publisher site
- See Article on Publisher Site
Abstract
Analysis of massive data sets is challenging owing to limitations of computer primary memory. In this paper, we propose an approach to estimate population parameters from a massive data set. The proposed approach significantly reduces the required amount of primary memory, and the resulting estimate will be as efficient if the entire data set was analyzed simultaneously. Asymptotic properties of the resulting estimate are studied, and the asymptotic normality of the resulting estimator is established. The standard error formula for the resulting estimate is proposed and empirically tested; thus, statistical inference for parameters of interest can be performed. The effectiveness of the proposed approach is illustrated using simulation studies and an Internet traffic data example. Copyright © 2012 John Wiley & Sons, Ltd.
Journal
Applied Stochastic Models in Business and Industry – Wiley
Published: Sep 1, 2013