Summary
This paper deals with the asymptotic theory of Bayes solutions in (i) Estimation (ii) Testing when hypothesis and alternative are separated at least by an indifference region, under the assumption that the observations are independent and indentically distributed. The estimation results which are partial generalizations of results of LeCam begin with a proof of the convergence of the normalized posterior density to the appropriate normal density in a strong sense. From this result we derive the asymptotic efficiency of Bayes estimates obtained from smooth loss functions and in particular of the posterior mean. The last two theorems of this section deal with asymptotic expansions for the posterior risk in such estimation problems. The section on testing contains a limit theorem for the n-th root of the posterior risk under weak conditions on the prior and the loss function. Finally we discuss generalizations and some open problems.
Article PDF
Similar content being viewed by others
References
Bahadur, R. R.: An optimal property of the likelihood ratio statistic. Proc. fifth Berkeley Sympos. math. Statist. Probability (1965).
-, and P. J. Bickel: An optimal property of Bayes' test statistics. To be submitted to Sankhyā (1966).
Bickel, P. J., and J. A. Yahav: Asymptotically pointwise optimal procedures in sequential analysis. Proc. fifth Berkeley Sympos. math. Statist. Probability (1965).
— —: Asymptotically optimal procedures in Bayes and minimax sequential estimation. Ann. math. Statistics 39, 442–456 (1968).
Cramèr, H.: Methods of Mathematical Statics. Princeton Univ. Press 1946.
Davis, R. C.: Asymptotic properties of Bayes estimate. Ann. math. Statistics 22, 8, 484 (Abstract) (1951).
Dieudonné, J.: Foundations of Modern Analysis. New York: Interscience 1961.
Dunford, N., and J. Schwartz: Linear Operators Part I. New York: Interscience 1957.
Farrell, R.: Weak limits of sequences of Bayes procedures in estimation theory. Proc. fifth Berkeley Sympos. math. Statist. Probability (1965).
Kiefer, J., and J. Wolfowitz: Consistency of the maximum likelihood estimator in the presence of infinitely many incidental parameters. Ann. math. Statistics 27, 887–906 (1956).
—, and J. Sacks: Asymptotically optimum sequential inference and design. Ann. math. Statistics 34, 705–750 (1963).
Le Cam, L.: On some asymptotic properties of maximum likelihood estimates and related Bayes estimates. Univ. California Publ. Statist. 1, 277–330 (1953).
- On the asymptotic theory of estimation and testing hypotheses. Proc. third Berkeley Symp. math. Statist. Probability, 129–157 (1955).
—: Les propriétés asymptotiques des solutions de Bayes. Publ. Inst. Statist. Univ. Paris 7, 18–35 (1958).
Rubin, H., and J. Sethuraman: Probabilities of moderate deviations. Sankhyā 27, 325–346 (1965).
Wald, A.: A note on the consistency of the maximum likelihood estimate. Ann. math. Statistics 20, 595–601 (1949).
Wolfowitz, J.: Method of maximum likelihood and the Wald theory of decision functions. Indagationes math. 15, 114–119 (1953).
Jeffreys, H.: Theory of probability, 3rd Ed. Oxford Univ. Press 1961.
Gomberg, D.: Doctoral dissertation. Univ. of California, Berkeley 1967.
Schwartz, L.: On Bayes procedures. Z. Wahrscheinlichkeitstheorie verw. Geb. 4, 10–26 (1965).
Elfving, G.: Robustness of Bayes decisions against choice of prior. Tech. Report 122, Stanford University 1966.
Bickel, P. J., and J. A. Yahav: On an asymptotically optimal rule in sequential estimation with quadratic loss. To appear in Ann. Math. Statistics, April 1969.
Author information
Authors and Affiliations
Additional information
Part of this research was done while P. J. Bickel was on leave at Imperial College, London. — This research was partially supported by National Science Foundation Grant GP-5059.
This research was partially supported by National Science Foundation Grant GP-5705. Part of this research was done while J. A. Yahav was visiting the department of Statistics at Stanford University.
Rights and permissions
About this article
Cite this article
Bickel, P.J., Yahav, J.A. Some contributions to the asymptotic theory of Bayes solutions. Z. Wahrscheinlichkeitstheorie verw Gebiete 11, 257–276 (1969). https://doi.org/10.1007/BF00531650
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF00531650