Abstract
A Bayesian approach is developed to assess the factor analysis model. Joint Bayesian estimates of the factor scores and the structural parameters in the covariance structure are obtained simultaneously. The basic idea is to treat the latent factor scores as missing data and augment them with the observed data in generating a sequence of random observations from the posterior distributions by the Gibbs sampler. Then, the Bayesian estimates are taken as the sample means of these random observations. Expressions for implementing the algorithm are derived and some statistical properties of the estimates are presented. Some aspects of the algorithm are illustrated by a real example and the performance of the Bayesian procedure is studied using simulation.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Albert, J. H. and Chib, S. (1993). Bayesian analysis of Binary and polychotomous response data, J. Amer. Statist. Assoc., 88, 669–679.
Anderson, T. W. and Rubin, H. (1956). Statistical inference in factor analysis, Proc. Third Berkeley Symp. on Math. Statist. Prob., Vol. 5 110–150, University of California Press, Berkeley.
Bartholomew, D. J. (1981). Posterior analysis of the factor model, British J. Math. Statist. Psych., 34, 93–99.
Bentler, P. M. (1983). Some contributions to efficient statistics for structural models: Specification and estimation of moment structures, Psychometrika, 48, 493–517.
Broemeling, L. D. (1985). Bayesian Analysis of Linear Models, Marcel Dekker INC, New York.
Browne, M. W. (1974). Generalized least squares estimators in the analysis of covariance structures, South African Statist. J., 8, 1–24.
Dempster, A. P., Laird, N. M., and Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm (with discussion), J. Roy. Statist. Soc. Ser. B, 39, 1–38.
Fuller, W. A. (1987). Measurement Error Models, Wiley, New York.
Gelfand, A. E. and Smith, A. F. M. (1990). Sampling-based approaches to calculating marginal densities, J. Amer. Statist. Assoc., 85, 398–409.
Gelman, A. (1996). Inference and monitoring convergence, Markov Chain Monte Carlo in Practice (eds. W. R. Gilks, S. Richardson and D. J. Spiegelhalter), 131–144, Chapman & Hall, London.
Gelman, A., Meng, X.-L., and Stern, H. (1996). Posterior predictive assessment of model fitness via realized discrepancies, Statist. Sinica, 6, 733–759.
Geman, S. and Geman, D. (1984). Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images, IEEE Transactions on Pattern Analysis and Machine Intelligence, 6, 721–741.
Geyer, C. J. (1992). Practical Markov chain Monte Carlo (with discussion), Statist. Sci, 7, 473–511.
Gilks, W. R., Richardson, S. and Spiegelhalter, D. J. (1996). Introducing Markov chain Monte Carlo, Markov Chain Monte Carlo in Practice (eds. W. R. Gilks, S. Richardson and D. J. Spiegelhalter), 1–19, Chapman & Hall, London.
Hastings, W. K. (1970). Monte Carlo sampling methods using Markov Chains and their applications, Biometrika, 57, 97–109.
Jöreskog, K. G. (1978). Structural analysis of covariance and correlation matrices, Psychometrika, 43, 443–477.
Jöreskog, K. G. and Sörbom, D. (1994). LISREL VIII, A Guide to the Program and Applications, SPSS, Inc, Chicago, IL.
Lawley, D. N. and Maxwell, A. E. (1971). Factor Analysis as a Statistical Method, 2nd ed., American Elsevier, New York.
Lee, S. Y. (1980). Estimation of covariance structure models with parameters subject to functional restraints, Psychometrika, 45, 309–324.
Lee, S. Y. (1981). A Bayesian approach to confirmatory factor analysis, Psychometrika, 46, 153–160.
Lee, S. Y. and Jennrich, R. I. (1979). A study of algorithms for covariance structure analysis with specific comparisons using factor analysis, Psychometrika, 44, 99–113.
Lindley, D. V. and Smith, A. F. M. (1972). Bayes estimates for the linear model (with discussion), J. Roy. Statist. Soc. Ser. B, 34, 1–42.
Martin, J. L. and McDonald, R. P. (1975). Bayesian estimation in unrestricted factor analysis: A treatment for Heywood cases, Psychometrika, 40, 505–517.
Meng, X.-L. and van Dyk, D. (1997). The EM algorithm — an old folk-song sung to a fast new time, J. Roy. Statist. Soc. Ser. B, 59, 511–567.
Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H. and Teller, E. (1953). Equations of state calculations by fast computing machine, Journal of Chemical Physics, 21, 1087–1091.
Press, S. J. and Shigemasu, K. (1989). Bayesian inference in factor analysis, Contributions to probability and statistics: Essays in honor of Ingram Olkin (eds. L. J. Glesser, M. D. Perlman, S. J. Press, and A. R. Sampson), 271–287, Springer Verlag, New York.
Raiffa, H. and Schlaifer, L. R. (1961). Applied Statistical Decision Theory, 2nd ed., Graduate School of Business Administration, Harvard, Boston.
Rubin, D. B. (1984). Bayesian justifiable and relevant frequency calculations for the applied statistician, Ann. Statist., 12, 1151–1172.
Thurstone, L. L. (1944). A multiple group method of factoring the correlation matrix, Psychometrika, 10, 73–78.
Zeger, S. L. and Karim, M. R. (1991). Generalized linear models with random effects; A Gibbs sampling approach, J. Amer. Statist. Assoc., 86, 79–86.
Zellner, A. (1971). An Introduction to Bayesian Inference in Econometrics, Wiley, New York.
Author information
Authors and Affiliations
About this article
Cite this article
Lee, SY., Shi, JQ. Joint Bayesian Analysis of Factor Scores and Structural Parameters in the Factor Analysis Model. Annals of the Institute of Statistical Mathematics 52, 722–736 (2000). https://doi.org/10.1023/A:1017529427433
Issue Date:
DOI: https://doi.org/10.1023/A:1017529427433