Open Access
September, 1986 Asymptotic Behavior of the Empiric Distribution of M-Estimated Residuals from a Regression Model with Many Parameters
Stephen Portnoy
Ann. Statist. 14(3): 1152-1170 (September, 1986). DOI: 10.1214/aos/1176350056

Abstract

Consider a regression model $Y_i=x'_i\beta+R_i$, i=1,\cdots,n, where ${R_i}$ are i.i.d. with c.d.f., F; $x_i\inR^p$ and $\beta\inR^p$. Let $\hat{\beta}$ be a M-estimator defined using kernel, $\psi$; let $\hat{F}_n(x)$ denote the empiric distribution of the residuals, $Y_i-x'_i\hat{\beta}$ and let $\hat{F}^\ast_n$ be the empiric c.d.f. of the errors, ${R_i}$. Under suitable smoothness conditions on $\psi$, F, and the density F' = f and conditions requiring essentially that ${x_i}$ behave like a random sample from some distribution in $R_p$, it is show that, for fixed x, $\sqrt n (\hat{F}_n(x) - \hat{F}^\ast_n(x)-H_n(x))-\frac{P}{\sqrt{n}} g(x) \rightarrow_p 0$, where $g(x) = af(x)\psi(x) + bf'(x)$ and $H_n(x) = (1/nd)f(x)\sum^n_{i=1}\psi(R_i)$ if the design has a constant term [and $H_n(x)$ vanishes otherwise]. A tightness result shows that if $p/\sqrt n\rigtharrow c$ $\sqrt n(\hat{F}_n(x)-F(x))$ converges weakly to a Gaussian process with drift given by the bias term cg(x), and covariance function strongly affected by $H_n(x)$ and different from that for the usual Brownian bridge. In the course of the proof, an expansion for the fitted values, $x'_i\hat{\beta}$, is obtained, with error $O_p(p^{11/4}ln^2n/n^2)=o_p (1/\sqrt{n}) if p^2/n$ is bounded.

Citation

Download Citation

Stephen Portnoy. "Asymptotic Behavior of the Empiric Distribution of M-Estimated Residuals from a Regression Model with Many Parameters." Ann. Statist. 14 (3) 1152 - 1170, September, 1986. https://doi.org/10.1214/aos/1176350056

Information

Published: September, 1986
First available in Project Euclid: 12 April 2007

zbMATH: 0612.62072
MathSciNet: MR856812
Digital Object Identifier: 10.1214/aos/1176350056

Subjects:
Primary: 62G35
Secondary: 62E20 , 62J05

Keywords: asymptotics , empiric c.d.f. , M-estimators , regression , residuals

Rights: Copyright © 1986 Institute of Mathematical Statistics

Vol.14 • No. 3 • September, 1986
Back to Top