On Least Squares Estimation in a Simple Linear Regression Model with Periodically Correlated Errors: A Cautionary Note

Authors

  • Abdullah A. Smadi Yarmouk University, Irbid, Jordan
  • Nour H. Abu-Afouna Princess Noura University, Riyadh, Saudi Arabia

DOI:

https://doi.org/10.17713/ajs.v41i3.175

Abstract

In this research the simple linear regression (SLR) model with autocorrelated errors is considered. Traditionally, correlated errors are assumed to follow the autoregressive model of order one (AR(1)). Beside this model we will also study the SLR model with errors following the periodic autoregressive model of order one (PAR(1)). The later model is useful for modeling periodically autocorrelated errors. In particular, it is expected to be
useful when the data are seasonal. We investigate the properties of the least squares estimators of the parameters of the simple regression model when the errors are autocorrelated and for various models. In particular, the relative efficiency of those estimates are obtained and compared for the white noise, AR(1) and PAR(1) models. Also, the generalized least squares estimates for the SLR with PAR(1) errors are derived. The relative efficiency of the intercept and slope estimates based on both methods is investigated via Monte-Carlo simulation. An application on real data set is also provided.
It should be emphasized that once there are sufficient evidences that errors are autocorrelated then the type of this autocorrelation should be uncovered. Then estimates of model’s parameters should be obtained accordingly, using some method like the generalized least squares but not the ordinary least squares.

References

Albertson, K., Aylen, J., and Lim, K. B. (2002). The Power of the Durbin Watson test when the errors are PAR(1). Journal of Statistical Computation and Simulation, 72, 507-516.

Box, G., Jenkins, G., and Reinsel, G. (1994). Time Series Analysis, Forecasting and Control (3rd ed.). Engelwood Cliffs, NJ: Prentice-Hall.

Choudhury, A. H., Hubata, R., and Louis, R. (1999). Understanding time-series regression estimators. The American Statistician, 53, 342-348.

Cryer, J. D., and Chan, K. (2008). Time Series Analysis with Applications in R (2nd ed.). New York: Springer.

Franses, P., and Paap, R. (2004). Periodic Time Series Models. Oxford: Oxford University Press.

Grenander, U. (1954). On the estimation of regression coefficients in the case of autocorrelated disturbances. Annals of Mathematical Statistics, 25, 252-72.

Huitema, B. E., and McKean, J. W. (2007). An improved portmanteau test for autocorrelated error in interrupted time-series regression model. Behavior Research Methods, 39, 343-349.

Jeske, R., Bütefisch, T., and Song, S. H. (1996). The efficiency of the sample mean in a linear regression model when errors follow a first-order moving average process. Economics Letters, 52, 235-240.

Kutner, H., Nachtsheim, J., Neter, J., and Li,W. (2005). Applied Linear Statistical Models (5th ed.). Chicago:IL: McGraw-Hill/Irwin.

Lee, J., and Lund, R. (2004). Revisiting simple linear regression with autocorrelated errors. Biometrika, 91, 240-245.

McLeod, A. I. (1995). Diagnostic checking periodic autoregression models with application. The Journal of Time Series Analysis, 15, 221-233.

Mohammed, N., and Ibazizen, M. (2008). Bayesian estimation of the regression model with autocorrelated errors under Contamination. Communications in Statistics: Theory & Methods, 37, 2382-2389.

M¨uller, W. G., and Stehlík, M. (2009). Issues in the optimal design of computer simulation experiments. Applied Stochastic Models in Business and Industry, 250, 163-177.

Obeysekera, J. T. B., and Salas, J. D. (1986). Modeling of aggregated hydrologic time series. Journal of Hydrology, 86, 197-219.

Ohtani, K. (1990). On estimating and testing in a linear regression model with autocorrelated errors. Journal of Econometrics, 44, 333-346.

Rohatgi, V. K. (1984). Statistical Inference. New York: John Wiley and Sons.

Tiao, G., and Grupe, M. (1980). Hidden periodic autoregressive-moving average models in time series data. Biometrika, 67, 365-373.

Ula, T. A., and Smadi, A. A. (1997). Periodic stationarity conditions for periodic autoregressive moving average processes as eigen value problems. Water Resources Research, 33, 1929-1934.

Wei, W. (2006). Time Series Analysis, Univariate and Multivariate Methods (2nd ed.). Boston, MA: Pearson, Addison-Wesley.

Yue, F., and Koreisha, S. G. (2004). Forecasting with serially correlated regression models. Journal of Statistical Computation & Simulation, 74, 625-649.

Zinde-Walsh, V., and Galbraith, J. (1991). Estimators of a linear regression model with stationary ARMA(p, q) errors. Journal of Econometrics, 47, 333-357.

Published

2016-02-24

How to Cite

Smadi, A. A., & Abu-Afouna, N. H. (2016). On Least Squares Estimation in a Simple Linear Regression Model with Periodically Correlated Errors: A Cautionary Note. Austrian Journal of Statistics, 41(3), 211–226. https://doi.org/10.17713/ajs.v41i3.175

Issue

Section

Articles