The approximation and the estimation of nonparametric functions by projections on an orthonormal basis of functions are useful in data analysis. This book presents series estimators defined by projections on bases of functions, they extend the estimators of densities to mixture models, deconvolution and inverse problems, to semi-parametric and nonparametric models for regressions, hazard functions and diffusions. They are estimated in the Hilbert spaces with respect to the distribution function of the regressors and their optimal rates of convergence are proved. Their mean square errors depend on the size of the basis which is consistently estimated by cross-validation. Wavelets estimators are defined and studied in the same models.The choice of the basis, with suitable parametrizations, and their estimation improve the existing methods and leads to applications to a wide class of models. The rates of convergence of the series estimators are the best among all nonparametric estimators with a great improvement in multidimensional models. Original methods are developed for the estimation in deconvolution and inverse problems. The asymptotic properties of test statistics based on the estimators are also established.

An applied treatment of the key methods and state-of-the-art tools for visualizing and understanding statistical data Smoothing of Multivariate Data provides an illustrative and hands-on approach to the multivariate aspects of density estimation, emphasizing the use of visualization tools. Rather than outlining the theoretical concepts of classification and regression, this book focuses on the procedures for estimating a multivariate distribution via smoothing. The author first provides an introduction to various visualization tools that can be used to construct representations of multivariate functions, sets, data, and scales of multivariate density estimates. Next, readers are presented with an extensive review of the basic mathematical tools that are needed to asymptotically analyze the behavior of multivariate density estimators, with coverage of density classes, lower bounds, empirical processes, and manipulation of density estimates. The book concludes with an extensive toolbox of multivariate density estimators, including anisotropic kernel estimators, minimization estimators, multivariate adaptive histograms, and wavelet estimators. A completely interactive experience is encouraged, as all examples and figurescan be easily replicated using the R software package, and every chapter concludes with numerous exercises that allow readers to test their understanding of the presented techniques. The R software is freely available on the book's related Web site along with "Code" sections for each chapter that provide short instructions for working in the R environment. Combining mathematical analysis with practical implementations, Smoothing of Multivariate Data is an excellent book for courses in multivariate analysis, data analysis, and nonparametric statistics at the upper-undergraduate and graduatelevels. It also serves as a valuable reference for practitioners and researchers in the fields of statistics, computer science, economics, and engineering.

This book gives a systematic, comprehensive, and unified account of modern nonparametric statistics of density estimation, nonparametric regression, filtering signals, and time series analysis. The companion software package, available over the Internet, brings all of the discussed topics into the realm of interactive research. Virtually every claim and development mentioned in the book is illustrated with graphs which are available for the reader to reproduce and modify, making the material fully transparent and allowing for complete interactivity.

ENCYCLOPEDIA OF STATISTICAL SCIENCES

This book provides a systematic in-depth analysis of nonparametric regression with random design. It covers almost all known estimates. The emphasis is on distribution-free properties of the estimates.

This book presents a systematic and unified approach for modern nonparametric treatment of missing and modified data via examples of density and hazard rate estimation, nonparametric regression, filtering signals, and time series analysis. All basic types of missing at random and not at random, biasing, truncation, censoring, and measurement errors are discussed, and their treatment is explained. Ten chapters of the book cover basic cases of direct data, biased data, nondestructive and destructive missing, survival data modified by truncation and censoring, missing survival data, stationary and nonstationary time series and processes, and ill-posed modifications. The coverage is suitable for self-study or a one-semester course for graduate students with a prerequisite of a standard course in introductory probability. Exercises of various levels of difficulty will be helpful for the instructor and self-study. The book is primarily about practically important small samples. It explains when consistent estimation is possible, and why in some cases missing data should be ignored and why others must be considered. If missing or data modification makes consistent estimation impossible, then the author explains what type of action is needed to restore the lost information. The book contains more than a hundred figures with simulated data that explain virtually every setting, claim, and development. The companion R software package allows the reader to verify, reproduce and modify every simulation and used estimators. This makes the material fully transparent and allows one to study it interactively. Sam Efromovich is the Endowed Professor of Mathematical Sciences and the Head of the Actuarial Program at the University of Texas at Dallas. He is well known for his work on the theory and application of nonparametric curve estimation and is the author of Nonparametric Curve Estimation: Methods, Theory, and Applications. Professor Sam Efromovich is a Fellow of the Institute of Mathematical Statistics and the American Statistical Association.

The author has attempted to present a book that provides a non-technical introduction into the area of non-parametric density and regression function estimation. The application of these methods is discussed in terms of the S computing environment. Smoothing in high dimensions faces the problem of data sparseness. A principal feature of smoothing, the averaging of data points in a prescribed neighborhood, is not really practicable in dimensions greater than three if we have just one hundred data points. Additive models provide a way out of this dilemma; but, for their interactiveness and recursiveness, they require highly effective algorithms. For this purpose, the method of WARPing (Weighted Averaging using Rounded Points) is described in great detail.

Advances in Imaging and Electron Physics merges two long-running serials-Advances in Electronics and Electron Physics and Advances in Optical and Electron Microscopy. This series features extended articles on the physics of electron devices (especially semiconductor devices), particle optics at high and low energies, microlithography, image science and digital image processing, electromagnetic wave propagation, electron microscopy, and the computing methods used in all these domains.

Designed for a one-semester advanced undergraduate or graduate statistical theory course, Statistical Theory: A Concise Introduction, Second Edition clearly explains the underlying ideas, mathematics, and principles of major statistical concepts, including parameter estimation, confidence intervals, hypothesis testing, asymptotic analysis, Bayesian inference, linear models, nonparametric statistics, and elements of decision theory. It introduces these topics on a clear intuitive level using illustrative examples in addition to the formal definitions, theorems, and proofs. Based on the authors’ lecture notes, the book is self-contained, which maintains a proper balance between the clarity and rigor of exposition. In a few cases, the authors present a "sketched" version of a proof, explaining its main ideas rather than giving detailed technical mathematical and probabilistic arguments. Features: Second edition has been updated with a new chapter on Nonparametric Estimation; a significant update to the chapter on Statistical Decision Theory; and other updates throughout No requirement for heavy calculus, and simple questions throughout the text help students check their understanding of the material Each chapter also includes a set of exercises that range in level of difficulty Self-contained, and can be used by the students to understand the theory Chapters and sections marked by asterisks contain more advanced topics and may be omitted Special chapters on linear models and nonparametric statistics show how the main theoretical concepts can be applied to well-known and frequently used statistical tools The primary audience for the book is students who want to understand the theoretical basis of mathematical statistics—either advanced undergraduate or graduate students. It will also be an excellent reference for researchers from statistics and other quantitative disciplines.

Provides unique synthesis of various modeling methodologies used to aid planning and operational decision making, for academic researchers and professionals.