Skip to main content
Log in

On approximate confidence intervals for measures of concordance

  • Published:
Psychometrika Aims and scope Submit manuscript

Abstract

The use ofU-statistics based on rank correlation coefficients in estimating the strength of concordance among a group of rankers is examined for cases where the null hypothesis of random rankings is not tenable. The studentizedU-statistics is asymptotically distribution-free, and the Student-t approximation is used for small and moderate sized samples. An approximate confidence interval is constructed for the strength of concordance. Monte Carlo results indicate that the Student-t approximation can be improved by estimating the degrees of freedom.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Ehrenberg, A. S. C. (1952). On sampling from a population of rankers.Biometrika, 39, 82–87.

    Google Scholar 

  • Feigin, P. D. and Cohen, A. (1978). On a model for concordance between judges.Journal of the Royal Statistical Society, Series B, 40, 203–213.

    Google Scholar 

  • Friedman, M. (1937). The use of ranks to avoid the assumption of normality implicit in the analysis of variance.Journal of the American Statistical Association, 32, 675–701.

    Google Scholar 

  • Hinkley, D. V. (1977). Jackknife confidence limits using Studentt approximations.Biometrika, 64, 21–28.

    Google Scholar 

  • Hoeffding, W. (1948). A class of statistics with asymptotically normal distribution.Annals of Mathematical Statistics, 19, 293–325.

    Google Scholar 

  • Kendall, M. G. (1938). A new measure of rank correlation.Biometrika, 30, 81–93.

    Google Scholar 

  • Kendall, M. G. and Babington-Smith, B. (1939). The problem ofm rankings.Annals of Mathematical Statistics, 10, 275–287.

    Google Scholar 

  • Kraemer, H. C. (1976). The small sample nonnull properties of Kendall's coefficient of concordance for normal populations.Journal of the American Statistical Association, 71, 608–613.

    Google Scholar 

  • Kraemer, H. C. and Korner, A. F. (1976). Statistical alternatives in assessing reliability, consistency, and individual differences in quantitative measures: application to behavioral measures of neonates.Psychological Bulletin, 83, 914–921.

    Google Scholar 

  • Mallows, C. L. (1957). Non-null ranking models I.Biometrika, 44, 114–130.

    Google Scholar 

  • Quade, D. (1972).Average internal rank correlation. Technical Report, Mathematical Centre, University of Amsterdam.

  • Quade, D., Doerfler, D. L. and Flexner, A. L. (1977).Calculation of the variance in a test for concordance of two groups of judges. Technical Report, University of North Carolina, Chapel Hill.

    Google Scholar 

  • Sen, P. K. (1960). On some convergence properties ofU-statistics.Calcutta Statistical Association Bulletin, 10, 1–18.

    Google Scholar 

  • Spearman, C. (1904). The proof and measurement of association between two things.American Journal of Psychology, 15, 72–101.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Additional information

Research partially supported on ONR Contract N00014-82-K-0207.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Palachek, A.D., Schucany, W.R. On approximate confidence intervals for measures of concordance. Psychometrika 49, 133–141 (1984). https://doi.org/10.1007/BF02294211

Download citation

  • Received:

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02294211

Key words

Navigation