770Accesses
Abstract
In this paper, we investigate the consistency of the estimators of nonparametric regression model and multiple linear regression model based on extended negatively dependent errors. The complete convergence rates of the estimators of nonparametric regression model are presented. In addition, therth-mean consistency and complete consistency of the least squares estimator of the multiple linear regression model are obtained too. Finally, some examples and some simulations are illustrated.
This is a preview of subscription content,log in via an institution to check access.
Access this article
Subscribe and save
- Get 10 units per month
- Download Article/Chapter or eBook
- 1 Unit = 1 Article or 1 Chapter
- Cancel anytime
Buy Now
Price includes VAT (Japan)
Instant access to the full article PDF.








Similar content being viewed by others
Explore related subjects
Discover the latest articles and news from researchers in related subjects, suggested using machine learning.References
Adler A, Rosalsky A (1987) Some general strong laws for weighted sums of stochastically dominated random variables. Stoch Anal Appl 5(1):1–16
Adler A, Rosalsky A, Taylor RL (1989) Strong laws of large numbers for weighted sums of random elements in normed linear spaces. Int J Math Math Sci 12(3):507–530
Anderson TW (2003) An introduction to multivariate statistical analysis, 3rd edn. John Wiley & Sons, New York
Baltagi BH, Krämer W (1994) Consistency, asymptotic unbiasedness and bounds on the bias of\(s^2\) in the linear regression model with error component disturbances. Stat Papers 35(1):323–328
Bulinski AV, Shaskin A (2007) Limit theorems for associated random fields and related systems. World Scientific, Singapore
Chen GJ, Lai TL, Wei CZ (1981) Convergence systems and strong consistency of least squares estimates in regression models. J Multivariate Anal 11(3):319–333
Chen XR (1981) Introduction to mathematical statistics. Science Press, Beijing (In Chinese)
Chen XR, Chen GJ, Wu QG, Zhao LC (2010) Theory of parametric estimation for linear model. Science Press, Beijing (In Chinese)
Chen ZY, Wang HB, Wang XJ (2016) The consistency for the estimator of nonparametric regression model based on martingale difference errors. Stat Papers 57(2):451–469
Erdös P (1949) On a Theorem of Hsu and Robbins. Ann Math Stat 20(2):286–291
Georgiev AA, Greblicki W (1986) Nonparametric function recovering from noisy observations. J Stat Plan Inference 13(1):1–14
Georgiev AA (1988) Consistent nonparametric multiple regression: the fixed design case. J Multivariate Anal 25(1):100–110
Hanson DL, Wright FT (1971) A bound on tail probabilities for quadratic forms in independent random variables. Ann Math Stat 42(3):1079–1083
Hu SH, Zhu CH, Chen YB (2002) Fixed-design regression for linear time series. Acta Math Sci Ser B Engl Ed 22(1):9–18
Hu SH, Pan GM, Gao QB (2003) Estimate problem of regression models with linear process errors. Appl Math J Chin Univ 18A(1):81–90
Hu TC, Chiang CY, Taylor RL (2009) On complete convergence for arrays of rowwise m-negatively associated random variables. Nonlinear Anal 71(12):e1075–e1081
Hu TC, Rosalsky A, Wang KL (2015) Complete convergence theorems for extended negatively dependent random variables. Sankhya 77A(1):1–29
Hsu PL, Robbins H (1947) Complete convergence and the law of large numbers. Proc Natl Acad Sci USA 33(2):25–31
Joag-Dev K, Proschan F (1983) Negative association of random variables with applications. Ann Stat 11(1):286–295
Ko B, Tang Q (2008) Sums of dependent nonnegative random variables with subexponential tails. J Appl Probab 45(1):85–94
Lehmann EL (1966) Some concepts of dependence. Ann Math Stat. 37(5):1137–1153
Liang HY, Jing BY (2005) Asymptotic properties for estimates of nonparametric regression models based on negatively associated sequences. J Multivariate Anal 95(2):227–245
Liu L (2009) Precise large deviations for dependent random variables with heavy tails. Stat Probab Lett 79(9):1290–1298
Liu L (2010) Necessary and sufficient conditions for moderate deviations of dependent random variables with heavy tails. Sci China Ser A 53(6):1421–434
Miao Y, Zhao FF, Wang K, Chen YP (2013) Asymptotic normality and strong consistency of LS estimators in the EV regression model with NA errors. Stat Pap 54(1):193–206
Müller HG (1987) Weak and universal consistency of moving weighted averages. Period Math Hung 18(3):241–250
Oliveira PE (2012) Asymptotics for associated random variables. Springer, Berlin
Prakasa Rao BLS (2012) Associated sequences, demimartingales and nonparametric inference. Birkhäuser, Springer, Basel
Roussas GG (1989) Consistent regression estimation with fixed design points under dependence conditions. Stat Probab Lett 8(1):41–50
Roussas GG, Tran LT, Ioannides DA (1992) Fixed design regression for time series: asymptotic normality. J Multivariate Anal 40(2):262–291
Shen AT (2011) Probability inequalities for END sequence and their applications. J Inequal Appl 1:1–12
Shen AT (2013). Bernstein-type inequality for widely dependent sequence and its application to nonparametric regression models. Abstr Appl Anal 2013, Article ID 862602, 9 pages
Song SH (1994) Consistency and asymptotic unbiasedness of S2 in the serially correlated error components regression model for panel data. Stat Pap 37(3):267–275
Sung SH (2011) On the exponential inequalities for negatively dependent random variables. J Math Anal Appl 381(2):538–545
Tran L, Roussas G, Yakowitz S, Van BT (1996) Fixed-design regression for linear time series. Ann Stat 24(3):975–991
Wang XJ, Ge MM, Hu SH, Wang XZ (2013a) The strong consistency of the estimator of fixed-design regression model under negatively dependent sequences. Abstr Appl Anal 2013, Article ID 521618, 7 pages
Wang XJ, Hu SH, Yang WZ, Ling NX (2010) Exponential inequalities and inverse moment for NOD sequence. Stat Probab Lett 80(5–6):452–461
Wang XJ, Hu TC, Volodin AI, Hu SH (2013b) Complete convergence for weighted sums and arrays of rowwise extended negatively dependent random variables. Commun Stat Theory Methods 42(13):2391–2401
Wang XJ, Si ZY (2015) Complete consistency of the estimator of nonparametric regression model under ND sequence. Stat Pap 56(3):585–596
Wang XJ, Wang SJ, Hu SH, Ling JM, Wei YF (2013c) On complete convergence for weighted sums of rowwise extended negatively dependent random variables. Stoch Int J Probab Stoch Process 85(6):1060–1072
Wang XJ, Xia FX, Ge MM, Hu SH, Yang WZ (2012) Complete consistency of the estimator of nonparametric regression models based on\(\tilde{\rho }\)-mixing sequences. Abstr Appl Anal 2012 Article ID 907286, 12 pages
Wang XJ, Xu C, Hu TC, Volodin A, Hu SH (2014) On complete convergence for widely orthant-dependent random variables and its applications in nonparametric regression models. TEST 23(3):607–629
Wang XJ, Zheng LL, Xu C, Hu SH (2015) Complete consistency for the estimator of nonparametric regression models based on extended negatively dependent errors. Statistics 49(2):396–407
Wright FT (1973) A bound on tail probabilities for quadratic forms in independent random variables whose distributions are not necessarily symmetric. Ann Probab 1(6):1068–1070
Wu QY (2010) Complete convergence for negatively dependent sequences of random variables. J Inequal Appl 2010, Article ID 507293, 10 pages
Wu QY (2011) Complete convergence for weighted sums of sequences of negatively dependent random variables. J Probab Stat 2011, Article ID 202015, 16 pages
Wu QY (2012) A complete convergence theorem for weighted sums of arrays of rowwise negatively dependent random variables. J Inequal Appl 2012:50
Wu QY, Chen PY (2014) A Berry-Esseen Type Bound in Kernel Density Estimation for Negatively Associated Censored Data. J Appl Math 2013 Article ID 541250, 9 pages
Yang WZ, Wang XJ, Wang XH, Hu SH (2012) The consistency for estimator of nonparametric regression model based on NOD errors. J Inequal Appl 2012, 2012:140, 13 pages
Acknowledgments
The authors are deeply grateful to Editor and anonymous referees for their careful reading and insightful comments, which helped in improving the earlier version of this paper. This work is supported by the National Natural Science Foundation of China (11426032, 11501004, 11501005), Natural Science Foundation of Anhui Province (1408085QA02, 1508085J06, 1608085QA02), Science Research Project of Anhui Colleges (KJ2014A020), Quality Engineering Project of Anhui Province (2015jyxm054) and Applied Teaching Model Curriculum of Anhui University (XJYYKC1401, ZLTS2015053).
Author information
Authors and Affiliations
School of Mathematical Science, Anhui University, Hefei, 230601, People’s Republic Of China
Wenzhi Yang, Haiyun Xu, Ling Chen & Shuhe Hu
- Wenzhi Yang
You can also search for this author inPubMed Google Scholar
- Haiyun Xu
You can also search for this author inPubMed Google Scholar
- Ling Chen
You can also search for this author inPubMed Google Scholar
- Shuhe Hu
You can also search for this author inPubMed Google Scholar
Corresponding author
Correspondence toShuhe Hu.
Appendix
Appendix
Lemma A
(cf. Wang et al. (2015), Lemma 2.2). Let\(\{Z_n,n\ge 1\}\) be a sequence of END random variables such that\(EZ_n=0\) and\(|Z_n|\le d_n\)a.s. for each\(n\ge 1\), where\(\{d_n,n\ge 1\}\) is a sequence of positive constants. Assume that\(t>0\) such that\(t\max \limits _{1\le i\le n}d_i\le 1\). Then for every\(\varepsilon >0\), there exists a constant\(M>0\) such that
Corollary A
Let\(\{Z_n,n\ge 1\}\) be a sequence of END random variables such that\(EZ_n=0\) and\(|Z_n|\le d_n\)a.s. for each\(n\ge 1\), where\(\{d_n,n\ge 1\}\) is a sequence of positive constants. Denote\(b_n=\max \limits _{1\le i\le n}d_i\) and\(\Delta _n^2=\sum _{i=1}^n EZ_i^2\) for each\(n\ge 1\). Then for every\(\varepsilon >0\), there exists a constant\(M>0\) such that
Proof
Taking\(t=\frac{\varepsilon }{2\Delta _n^2+b_n\varepsilon }\) in (11) of Lemma A, we immediately obtain (12).\(\square \)
Lemma B
(cf. Adler and Rosalsky (1987), Lemma 1, and Adler et al. (1989), Lemma 3). Let\(\{Z_n,n\ge 1\}\) be a sequence of random variables, which is stochastically dominated by a nonnegative random variableZ. Then, for any\(\alpha >0\) and\(b>0\), the following two statements hold:
where\(C_1\) and\(C_2\) are positive constants. Consequently, it has\(E|Z_n|^{\alpha }\le C_3EZ^{\alpha }\) for all\(n\ge 1\).
Proof of Theorem 2.1:
In view of the proof of (4.5) in Yang et al. (2012), by the local Lipschitz condition ofg(x) and the assumptions\((H_1)\)–\((H_3)\), one can obtain that
With\(x\in A\), to prove (6), we have to prove that
In view of Lemma 3.1 of Liu (2010), for the fixedx, we can see that\(\{W_{ni}^{+}(x)\varepsilon _i,1\le i\le n\}\) and\(\{W_{ni}^{-}(x)\varepsilon _i,1\le i\le n\}\) are also sequences of END random variables. Noting that\(W_{ni}(x)\varepsilon _i=W_{ni}^{+}(x)\varepsilon _i-W_{ni}^{-}(x)\varepsilon _i\), without loss of generality, we assume\(W_{ni}(x)\ge 0\) in the proof. For all\(n\ge 1\) and\(1\le i\le n\), let
Since\(E\varepsilon _{ni}=E\varepsilon _i=0\) for\(1\le i\le n\) and\(n\ge 1\), it can be argued that
Obviously,\(\{W_{ni}(x)(\varepsilon _{1,i}(n)-E\varepsilon _{1,i}(n))\}_{1\le i\le n}\) are END random variables with mean zero. From Lemma B,\((H_2)\) and\(EZ^{2r+2}<\infty \) (\(r\ge 1\)), it follows
Since that\((\varepsilon _{n1},\varepsilon _{n2},\ldots ,\varepsilon _{nn})\) has the same distribution as\((\varepsilon _{1},\varepsilon _{2},\ldots ,\varepsilon _{n})\) for eachn, we apply Corollary A and obtain that for a sufficiently large\(C>0\),
Meanwhile, by\((H_2)\), Lemma B and\(EZ^{2r+2}<\infty \), it yields
Consequently, by (15), (16), (17), (14) is completely proved. The desired result (6) follows from (13) and (14) immediately.\(\square \)
Proof of Corollary 2.1
It suffices to show that the conditions of Theorem2.1 are satisfied. For every\(x\in [0,1]\), we can argue by definition of\(R_i(x)\) and choice of\(x_{ni}\),\(k_n=\lceil n^{1/r}\rceil \) and (7) that
For\(r>3/2\), we have by taking\(l>1/(2r-3)\) that
Since thatg(x) satisfies the Lipschitz condition for\(x\in [0,1]\), it can be seen that the assumptions of\((H_1)\)–\((H_3)\) are satisfied. Consequently, Corollary2.1 follows from Theorem2.1 immediately.\(\square \)
Proof of Theorem 2.2:
Obviously, it has\((b_{ni}^{(j)})\varepsilon _i=\big (b_{ni}^{(j)}\big )^{+}\varepsilon _i-\big (b_{ni}^{(j)}\big )^{-}\varepsilon _i\). Furthermore,\(\left\{ (b_{ni}^{(j)})^{+}\varepsilon _i,1\le i\le n\right\} \) and\(\left\{ (b_{ni}^{(j)})^{-}\varepsilon _i,1\le i\le n\right\} \) are also END random variables. Without loss of generality, we assume\(b_{ni}^{(j)}\ge 0\) in this proof too. On the one hand, for\(r\ge 2\) and\(j\in \{1,2,\ldots p\}\), by\(EZ^r<\infty \), (5),\(b_n^{(j)}\rightarrow \infty \), Corollary 3.2 of Shen (2011) and Lemma B, we obtain that
where the third inequality uses the fact that\(\left( \sum _{i=1}^n a_i^\alpha \right) ^{1/\alpha }\ge \left( \sum _{i=1}^n a_i^\beta \right) ^{1/\beta }\) for any positive number sequence\(\{a_i,1\le i\le n\}\) and\(1\le \alpha \le \beta \). Therefore, (9) follows from (18).
On the other hand, by Markov’s inequality,\(\sum \nolimits _{n=1}^{\infty }(b_n^{(j)})^{-r/2}<\infty \) and (18), one obtains that for any\(\lambda >0\),
Thus, (10) is completely proved.\(\square \)
Rights and permissions
About this article
Cite this article
Yang, W., Xu, H., Chen, L.et al. Complete consistency of estimators for regression models based on extended negatively dependent errors.Stat Papers59, 449–465 (2018). https://doi.org/10.1007/s00362-016-0771-x
Received:
Revised:
Published:
Issue Date:
Share this article
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative