On Least Squares Estimation in a Simple Linear Regression Model with Periodically Correlated Errors: A Cautionary Note
DOI:
https://doi.org/10.17713/ajs.v41i3.175Abstract
In this research the simple linear regression (SLR) model with autocorrelated errors is considered. Traditionally, correlated errors are assumed to follow the autoregressive model of order one (AR(1)). Beside this model we will also study the SLR model with errors following the periodic autoregressive model of order one (PAR(1)). The later model is useful for modeling periodically autocorrelated errors. In particular, it is expected to beuseful when the data are seasonal. We investigate the properties of the least squares estimators of the parameters of the simple regression model when the errors are autocorrelated and for various models. In particular, the relative efficiency of those estimates are obtained and compared for the white noise, AR(1) and PAR(1) models. Also, the generalized least squares estimates for the SLR with PAR(1) errors are derived. The relative efficiency of the intercept and slope estimates based on both methods is investigated via Monte-Carlo simulation. An application on real data set is also provided.
It should be emphasized that once there are sufficient evidences that errors are autocorrelated then the type of this autocorrelation should be uncovered. Then estimates of model’s parameters should be obtained accordingly, using some method like the generalized least squares but not the ordinary least squares.
References
Albertson, K., Aylen, J., and Lim, K. B. (2002). The Power of the Durbin Watson test when the errors are PAR(1). Journal of Statistical Computation and Simulation, 72, 507-516.
Box, G., Jenkins, G., and Reinsel, G. (1994). Time Series Analysis, Forecasting and Control (3rd ed.). Engelwood Cliffs, NJ: Prentice-Hall.
Choudhury, A. H., Hubata, R., and Louis, R. (1999). Understanding time-series regression estimators. The American Statistician, 53, 342-348.
Cryer, J. D., and Chan, K. (2008). Time Series Analysis with Applications in R (2nd ed.). New York: Springer.
Franses, P., and Paap, R. (2004). Periodic Time Series Models. Oxford: Oxford University Press.
Grenander, U. (1954). On the estimation of regression coefficients in the case of autocorrelated disturbances. Annals of Mathematical Statistics, 25, 252-72.
Huitema, B. E., and McKean, J. W. (2007). An improved portmanteau test for autocorrelated error in interrupted time-series regression model. Behavior Research Methods, 39, 343-349.
Jeske, R., Bütefisch, T., and Song, S. H. (1996). The efficiency of the sample mean in a linear regression model when errors follow a first-order moving average process. Economics Letters, 52, 235-240.
Kutner, H., Nachtsheim, J., Neter, J., and Li,W. (2005). Applied Linear Statistical Models (5th ed.). Chicago:IL: McGraw-Hill/Irwin.
Lee, J., and Lund, R. (2004). Revisiting simple linear regression with autocorrelated errors. Biometrika, 91, 240-245.
McLeod, A. I. (1995). Diagnostic checking periodic autoregression models with application. The Journal of Time Series Analysis, 15, 221-233.
Mohammed, N., and Ibazizen, M. (2008). Bayesian estimation of the regression model with autocorrelated errors under Contamination. Communications in Statistics: Theory & Methods, 37, 2382-2389.
M¨uller, W. G., and Stehlík, M. (2009). Issues in the optimal design of computer simulation experiments. Applied Stochastic Models in Business and Industry, 250, 163-177.
Obeysekera, J. T. B., and Salas, J. D. (1986). Modeling of aggregated hydrologic time series. Journal of Hydrology, 86, 197-219.
Ohtani, K. (1990). On estimating and testing in a linear regression model with autocorrelated errors. Journal of Econometrics, 44, 333-346.
Rohatgi, V. K. (1984). Statistical Inference. New York: John Wiley and Sons.
Tiao, G., and Grupe, M. (1980). Hidden periodic autoregressive-moving average models in time series data. Biometrika, 67, 365-373.
Ula, T. A., and Smadi, A. A. (1997). Periodic stationarity conditions for periodic autoregressive moving average processes as eigen value problems. Water Resources Research, 33, 1929-1934.
Wei, W. (2006). Time Series Analysis, Univariate and Multivariate Methods (2nd ed.). Boston, MA: Pearson, Addison-Wesley.
Yue, F., and Koreisha, S. G. (2004). Forecasting with serially correlated regression models. Journal of Statistical Computation & Simulation, 74, 625-649.
Zinde-Walsh, V., and Galbraith, J. (1991). Estimators of a linear regression model with stationary ARMA(p, q) errors. Journal of Econometrics, 47, 333-357.
Downloads
Published
How to Cite
Issue
Section
License
The Austrian Journal of Statistics publish open access articles under the terms of the Creative Commons Attribution (CC BY) License.
The Creative Commons Attribution License (CC-BY) allows users to copy, distribute and transmit an article, adapt the article and make commercial use of the article. The CC BY license permits commercial and non-commercial re-use of an open access article, as long as the author is properly attributed.
Copyright on any research article published by the Austrian Journal of Statistics is retained by the author(s). Authors grant the Austrian Journal of Statistics a license to publish the article and identify itself as the original publisher. Authors also grant any third party the right to use the article freely as long as its original authors, citation details and publisher are identified.
Manuscripts should be unpublished and not be under consideration for publication elsewhere. By submitting an article, the author(s) certify that the article is their original work, that they have the right to submit the article for publication, and that they can grant the above license.