Skip to main content
Log in

Measuring the Reliability of Qualitative Text Analysis Data

  • Published:
Quality and Quantity Aims and scope Submit manuscript

Abstract

This paper reports a new tool for assessing thereliability of text interpretationsheretofore unavailable to qualitative research.It responds to a combination of twochallenges, the problem of assessing the reliabilityof multiple interpretations – asolution to this problem was anticipated earlier(Krippendorff, 1992) but not fullydeveloped – and the problem of identifying unitsof analysis within a continuum of textand similar representations (Krippendorff, 1995).The paper sketches the family ofα-coefficients, which this paper extends, andthen describes its new arrival.A computational example is included in the Appendix.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Brennan, R. L. (2001). An essay on the history and future of reliability from the perspective of replications. Journal of Educational Measurement 38(4): 295–317.

    Google Scholar 

  • Gerbner, G. (with M. Brouwer, C. Clark & K. Krippendorff) (1972). Violence in television drama: Trends and symbolic functions, Appendix B: Analytical procedures In: G. A. Comstock & E. A. Rubinstein (eds), Television and Social Behavior. Rockville, MD: National Institute of Mental Health, pp. 167–170.

    Google Scholar 

  • Krippendorff, K. (1970). Bivariate agreement coefficients for reliability data. Chapter 8. In: E. R. Borgatta & G. W. Bohrnstedt (eds), Sociological Methodology 1970, Vol. 2. San Francisco CA: Jossey Bass, Inc., pp. 139–150.

    Google Scholar 

  • Krippendorff, K. (1980). Reliability, Chapter 12. In: K. Krippendorff, Content Analysis; An Introduction to its Methodology. Beverly Hills, CA: Sage Publications, pp. 129–154.

    Google Scholar 

  • Krippendorff, K. (1987). Association, agreement and equity. Quality & Quantity 21: 109–123.

    Google Scholar 

  • Krippendorff, K. (1992). Recent Developments in Reliability Analysis. Paper presented to the International Communication Association (ICA) Conference in Miami, FL: May 25, 1992. Available as ED 352390 at ERIC Clearinghouse, Springfield, Virginia and through DIALOG, BRS, or SDC.

  • Krippendorff, K. (1995). On the reliability of unitizing continuous data. Chapter 2. In: P. V. Marsden (ed.), Sociological Methodology, Vol. 25. Cambridge, MA: Blackwell, pp. 47–76.

    Google Scholar 

  • Krippendorff, K. (2004). Reliability, Chapter 11. In: K. Krippendorff, Content Analysis; An Introduction to its Methodology, 2nd Edition. Thousand Oaks, CA: Sage Publications, pp. 211–256.

    Google Scholar 

  • Pearson, K. (1901). Mathematical contributions to the theory of evolution IX: On the principle of homotyposis and its relation to heredity, to variability of the individual, and to that of race. Part I: Homotyposis in the vegetable kingdom. Philosophical Transactions of the Royal Society (London) A 193: 358–479.

    Google Scholar 

  • Scott, W. A. (1955). Reliability of content analysis: The case of nominal scale coding. Public Opinion Quarterly 19: 321–325.

    Google Scholar 

  • Siegel, S. (1956). Nonparametric Statistics for the Behavioral Sciences. New York: McGraw-Hill.

    Google Scholar 

  • Tildesley, M. L. (1921). A first study of the Burmese skull. Biometrica 13: 176–267.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

krippendorff, K. Measuring the Reliability of Qualitative Text Analysis Data. Qual Quant 38, 787–800 (2004). https://doi.org/10.1007/s11135-004-8107-7

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11135-004-8107-7

Navigation