Abstract
Using a low point estimate of autocorrelation to justify analyzing single-case data with the general linear model (GLM) is questioned. Monte Carlo methods are used to examine the degree to which bias in the estimate of autocorrelation depends on the complexity of the linear model used to describe the data. A method is then illustrated for determining the range of autocorrelation parameters that could reasonably have led to the observed autocorrelation. The argument for using a GLM analysis can be strengthened when the GLM analysis functions appropriately across the range of plausible autocorrelations. For situations in which the GLM analysis does not function appropriately across this range, a method is provided for adjusting the confidence intervals to ensure adequate coverage probabilities for specified levels of autocorrelation.
Article PDF
Similar content being viewed by others
References
Box, G. E. P., &Tio, G. C. (1975). Intervention analysis with applications to economic and environmental problems.Journal of the American Statistical Association,70, 70–79.
Bradley, J. C. (1978). Robustness?British Journal of Mathematical & Statistical Psychology,31, 144–152.
Busk, P. L., &Marascuilo, L. A. (1988). Autocorrelation in single-subject research: A counterargument to the myth of no autocorrelation.Behavioral Assessment,10, 229–242.
Center, B. A., Skiba, R. J., &Casey, A. (1986). A methodology for the quantitative synthesis of intra-subject design research.Journal of Special Education,19, 387–400.
Durbin, J., &Watson, G. S. (1951). Testing for serial correlation in least squares regression: II.Biometrika,38, 159–178.
Edgington, E. S. (1980). Validity of randomization tests for one-subject experiments.Journal of Educational Statistics,5, 235–251.
Ferron, J., &Sentovich, C. (2002). Statistical power of randomization tests used with multiple-baseline designs.Journal of Experimental Education,70, 165–178.
Gentile, J. R., Roden, A. H., &Klein, R. D. (1972). An analysis-of-variance model for the intrasubject replication design.Journal of Applied Behavior Analysis,5, 193–198.
Greenwood, K. M., &Matyas, T. A. (1990). Problems with the application of interrupted time series analysis for brief single-subject data.Behavioral Assessment,12, 355–370.
Hartmann, D. P. (1974). Forcing square pegs into round holes: Some comments on “an analysis-of-variance model for the intrasubject replication design.”Journal of Applied Behavior Analysis,7, 635–638.
Hogg, R. V. (1974). Adaptive robust procedures: A partial review and some suggestions for future applications and theory.Journal of the American Statistical Association,69, 909–923.
Huitema, B. E. (1985). Autocorrelation in applied behavior analysis: A myth.Behavioral Assessment,7, 107–118.
Huitema, B. E., &McKean, J. W. (1991). Autocorrelation estimation and inference with small samples.Psychological Bulletin,110, 291–304.
Huitema, B. E., &McKean, J. W. (1998). Irrelevant autocorrelation in least-squares intervention models.Psychological Methods,3, 104–116.
Huitema, B. E., &McKean, J. W. (2000a). Design specification issues in time-series intervention models.Educational & Psychological Measurement,60, 38–58.
Huitema, B. E., &McKean, J. W. (2000b). A simple and powerful test for autocorrelated errors in OLS intervention models.Psychological Reports,87, 3–20.
Huitema, B. E., McKean, J. W., &McKnight, S. (1999). Autocorrelation effects on least-squares intervention analysis of short time series.Educational & Psychological Measurement,59, 767–786.
Koehler, M. J., &Levin, J. R. (1998). Regulated randomization: A potentially sharper analytical tool for the multiple-baseline design.Psychological Methods,2, 206–217.
Kratochwill, T., Alden, K., Demuth, D., Dawson, D., Panicucci, C., Arntson, P., McMurray, N., Hempstead, J., &Levin, J. (1974). A further consideration in the application of an analysis-of-variance model for the intrasubject replication design.Journal of Applied Behavior Analysis,7, 629–633.
Kromrey, J. D., &Foster-Johnson, L. (1996). Determining the efficacy of intervention: The use of effect sizes for data analysis in single-subject research.Journal of Experimental Education,65, 73–93.
L’Esperance, W. L., &Taylor, D. (1975). The power of four tests of autocorrelation in the linear regression model.Journal of Econometrics,3, 1–21.
Marriott, F. H. C., &Pope, J. A. (1954). Bias in the estimation of autocorrelations.Biometrika,41, 390–402.
Matyas, T. A., &Greenwood, K. M. (1991). Problems in the estimation of autocorrelation in brief time series and some implications for behavioral data.Behavioral Assessment,13, 137–157.
Matyas, T. A., &Greenwood, K. M. (1997). Serial dependency in single-case time series. In R. D. Franklin, D. B. Allison, & B. S. Gorman (Eds.),Design and analysis of single-case research (pp. 215–243). Mahwah, NJ: Erlbaum.
McClannahan, L. E., McGee, G. G., MacDuff, G. S., &Krantz, P. J. (1990). Assessing and improving child care: A personal appearance index for children with autism.Journal of Applied Behavior Analysis,23, 469–482.
McKnight, S. D., McKean, J. W., &Huitema, B. E. (2000). A double bootstrap method to analyze linear models with autoregressive error terms.Psychological Methods,5, 87–101.
Neter, J., Wassermann, W., &Kutner, M. H. (1990).Applied linear statistical models: Regression, analysis of variance, and experimental designs (3rd ed.). Homewood, IL: Irwin.
Parsonson, B. S., &Baer, D. M. (1986). The graphic analysis of data. In A. Poling & R. W. Fuqua (Eds.),Research methods in applied behavior analysis: Issues and advances (pp. 157–186). New York: Plenum Press.
SAS Institute (1996).SAS, Version 6.12 [Computer program]. Carey, NC: Author.
Scheffé, H. (1959).The analysis of variance. New York: Wiley.
Shine, L. C., &Bower, S. M. (1971). A one-way analysis of variance for single-subject designs.Educational & Psychological Measurement,31, 105–113.
Suen, H. K., &Ary, D. (1987). Autocorrelation in applied behavior analysis: Myth or reality?Behavioral Assessment,9, 125–130.
Thoresen, C. E., &Elashoff, J. D. (1974). “An analysis-of-variance model for intrasubject replication design”: Some additional comments.Journal of Applied Behavior Analysis,7, 639–641.
Toothaker, L. E., Banz, M., Noble, C., Camp, J., &Davis, D. (1983).N = 1 designs: The failure of ANOVA-based tests.Journal of Educational Statistics,4, 289–309.
Zumbo, B. D. (2000, April).Adaptive inference. Paper presented at the meeting of the American Educational Research Association, New Orleans.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Ferron, J. Reconsidering the use of the general linear model with single-case data. Behavior Research Methods, Instruments, & Computers 34, 324–331 (2002). https://doi.org/10.3758/BF03195459
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03195459