Skip to main content
SpringerLink
Log in

An evaluation of the effectiveness of a videotape programme on interobserver reliability in outcome assessment for osteoarthritis

  • Published:
InflammoPharmacology Aims and scope Submit manuscript

Abstract

Aims. A study was designed to assess the effects of a standardized instructional videotape on training senior medical students to acceptable levels of reliability in performing several commonly used observer dependent outcome measures in patients with osteoarthritis (OA).

Methods. During a single day, six third-year medical students independently examined six patients with OA in predetermined order using a Latin Square design, before and after viewing a standardized videotape demonstrating 13 examination techniques. Reliability coefficients were calculated based on variance components of the analysis of variance (ANOVA) table.

Results. Preslandardization reliability coefficients were <0.80 for seven measures. Coefficients for the performance of knee goniometry were uniformly iow. Following the intervention, all but four reliability coefficients were ≥ 0.93.

Conclusions. For many measures, high levels of interobserver agreement were noted prior to viewing the instructional videotape. This may represent the success of undergraduate clinical skills training programmes, or it may be the result of having reviewed an illustrated instructional text just prior to the initial patient examinations. The notable exception was knee goniometry. Despite apparent familiarity with the technique, prestandardization reliability coefficients were very low. However, following the intervention, all coefficients improved dramatically, two-thirds achieving very high levels. These data suggest that skills development in senior medical students is not uniform and that, while reliability is high for many, the assessment of knee range of movement can be improved by viewing an instructional videotape.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Bellamy, N., Anastassiades, T. P., Buchanan, W. W., Davis, P., Lee, P., McCain, G. A., Wells, G. A. and Campbell, J. (1991). Rheumatoid arthritis antirheumatic drug trials. I. Effects of standardization procedures on observer dependent outcome measures,J. Rheumatol. 18, 1893–1900.

    PubMed  CAS  Google Scholar 

  2. Muirden, K. D., Bendrups, A., Boyden, K., McColl, G., Moran, H., Stockman, A., Tellus, M. M., Travers, R. and Campbell, J. (1997). Rheumatoid arthritis antirheumatic drug trials: effects of a standardized instructional videotape on the reliability of observer-dependent outcome measures,Inflammopharmacology 5, 273–84.

    Article  PubMed  Google Scholar 

  3. Bellamy, N., Carelle, S., Ford, P. M., Kean, W. F., Je Riche, N. G. H., Lussier, A., Wells, G. A. and Campbell J. (1992). Osteoarthritis antirheumatic drug trials. 1. Effects of standardization procedures on observer dependent outcome measures,J Rheumatol. 19, 436–43.

    PubMed  CAS  Google Scholar 

  4. Bellamy, N., Bachmeier, C., Brooks, P., Browne, C. D., Cohen, M. L., Conaghan, P. G., Day, R. O., March, L. and Campbell, J. (1997). Osteoarthritis antirheumatic drugs trials: effects of a standardized instructional videotape on the reliability of observer-dependent outcome measures,Inflammopharmacology 5, 285–95.

    Article  PubMed  CAS  Google Scholar 

  5. Bellamy, N., Buchanan, W. W., Esdaile, J. M., Fam, A. G., Kean, W. F., Thompson, J. M., Wells, G. A. and Campbell, J. (1991). Ankylosing spondylitis antirheumatic drug trials. I. Effects of standardization procedures on observer dependent outcome measures,J Rheumatol. 18, 1701–8.

    PubMed  CAS  Google Scholar 

  6. Bellamy, N., Muirden, K. D., Boyden, K., McColl, G., Moran, H., Stockman, A., Tellus, M. M., Wicks, I. and Campbell, J. (1997). Ankylosing spondylitis antirheumatic drug trials: effects of a standardized instructional videotape on the reliability of observer-dependent outcome measures,Inflammopharmacology 5, 297–308.

    Article  PubMed  CAS  Google Scholar 

  7. Bellamy, N., Bell, M. J., Caretle, S., Fam, A. G., Haraoui, B. W., McCain, G. A., Reynolds, W. J., Wells, G. A. and Campbell, J. (1994). Estimation of observer reliability and sample size calculation parameters for outcome measures in fibromyalgia clinical trials,Inflammopharmacology 2, 345–60.

    Article  Google Scholar 

  8. Bellamy, N., Buchbinder, R., Hall, S., Lowthian, S., Patrick, M. R., Ryan, P. F. J., Stockman, A., Grant, G., Green, S. and Campbell, J. (1997). Fibromyalgia antirheumatic drug trials: effects of a standardized instructional videotape on the reliability of observer-dependent outcome measures,Inflammopharmacology 5, 261–72.

    Article  PubMed  CAS  Google Scholar 

  9. Bellamy, N., Anaslassiades, T. P., Buchanan, W. W., Davis, P., Lee, P., McCain, G. A., Wells, G. A. and Campbell, J. (1991). Rheumatoid arthritis antirheumatic drug trials. II. Tables for calculating sample size for clinical trials of antirheumatic drugs,J. Rheumatol,18, 1901–7.

    PubMed  CAS  Google Scholar 

  10. Bellamy, N., Carclle, S., Ford, P. M., Kean, W. F., le Riche, N. G. H., Lussier, A., Wells, G. A. and Campbell, J. (1992). Osteoarthritis antirheumatic drug (rials. II. Tables for calculating sample size for clinical trials,J. Rheumatol. 19, 444–50.

    PubMed  CAS  Google Scholar 

  11. Bellamy, N., Buchanan, W. W., Esdaile, J. M., Fam, A. G., Kean, W. F., Thompson, J. M., Wells, G. A. and Campbell, J. (1991). Ankylosing spondylitis antirheumatic drug trials. II. Tables for calculating sample size for clinical trials,J. Rheumatol. 18, 1709–15.

    PubMed  CAS  Google Scholar 

  12. Bellamy, N. and Buchanan, W. W. (1984). Outcome measurement in osteoarthritis clinical trials: the case for standardization,Clin. Rheumatol. 3, 293–303.

    Article  PubMed  CAS  Google Scholar 

  13. Allas of Standard Radiographs — The Epidemiology of Chronic Rheumatism. (1963), Vol. 2. F A. Davis, Philadelphia.

  14. Hochbcrg. M. C., Chang, R. W., Dwosh, I., Lindsey, S., Pincus, T. and Wolfe, F. (1992). The American College of Rheumatology 1991 revised criteria for the classification of global functional status in rheumatoid arthritis,Arthritis Rheum. 35, 498–502.

    Article  Google Scholar 

  15. Bellamy, N. (1993).Musculoskeletal Clinical Metrology, pp. 214–21. Dordrecht: Kluwer Academic Publishers.

    Google Scholar 

  16. Box, G. E. P., Hunter, W. G. and Hunter, J. S. (1978).Statistics for Experimenters. John Wiley, New York.

    Google Scholar 

  17. SAS Users Guide: Basics and statistics (1985), Version 5 edition. Cary: SAS Institute Inc.

  18. Klinkoff, A. V., Bellamy, N., Bombardier, C., Carette, S., Chalmers, A., Esdaile, J. M., Goldsmith, C., Tugwell, P., Smythe, H. A. and Buchanan, W. W. (1988). An experiment in reducing interobserver variability of the examination for joint tenderness,J. Rheumatol. 15, 492–4.

    Google Scholar 

  19. Pope, J. E., Baron, M., Bellamy, N., Campbell, J., Carette, S., Chalmers, I., Dales, P., Hanly, J., Kaminska, E. A., Lee, P., Sibley, J. and Stevens, A. (1995), Variability of skin scores and clinical measurements in scleroderma,J. Rheumatol. 22, 1271–6.

    PubMed  CAS  Google Scholar 

  20. Green, S., Buchbinder, R., Forbes, A. and Bellamy, N. (1997). A standardized protocol for measurement of range of movement of the shoulder using the plurimeter-V inclinometer and assessment of its inlrarater and inlerrater reliability,Arthritis Care Res. 11, 27–32.

    Google Scholar 

  21. Bellamy, N., Kaloni, S., Pope, J., Coulter, K. and Campbell, J. (1998). A survey of outcome measurement procedures used in routine rheumatology outpatient practice by Canadian rheumatologists,J. Rheumatol 25, 852–8.

    PubMed  CAS  Google Scholar 

  22. Bellamy, N., Muirden, K. D., Brooks, P., Barroclough, D., Tellus, M. M. and Campbell, J. (1997). A survey of outcome measurement procedures used in routine rheumatology outpatient practice by Australian rheumalologists,Scientific Program of the Australian Rheumatology Association 4Oth Annual Scientific Conference, Brisbane. May 25–28, p. 160.

  23. Bellamy, N., Anjema, C., Chhina, T., Dudek, N., Hurley, B., Landesman, B., Probyn, L., Hili, J. and Campbell, J. (1999). An evaluation of the effectiveness of a videotape programme on interobserver reliability in outcome assessment for fibromyalgia,Inflammopharmacology 7, 119–30.

    Article  Google Scholar 

  24. Bellamy, N., Anjema, C., Dhanao, D., Joglekar, A., Mills, G. C. R., Nesrallah, G., Smith, C., Ucar, C., Hill, J. and Campbell, J. (1999). An evaluation of the effectiveness of a videotape programme on inlerobserver reliability in outcome assessment for ankylosing spondylitis,Inflammopharmacology 7, 107–17.

    Article  Google Scholar 

  25. Bellamy, N., Anjema, C., Frankovic, T. S., Horowitz, N., Mills, G. C. R., Shulman, S., Smith, C., Hill, J. and Campbell, J. (1999). An evaluation of the effectiveness of a videotape programme on interobserver reliability in outcome assessment for rheumatoid arthritis,Inflammopharmacology 7, 131–41.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Medicine, The University of Queensland, Brisbane, Australia

    N. Bellamy

  2. Department of Medicine, The University of Western Ontario, London, Ontario, Canada

    C. Anjema, N. Alikhan, T. Chhina, D. Dhanoa, D. Edelist, Z. Esufali, F. Ismail, J. Hill & J. Campbell

Authors
  1. N. Bellamy
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. C. Anjema
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. N. Alikhan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. T. Chhina
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. D. Dhanoa
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. D. Edelist
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Z. Esufali
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. F. Ismail
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. J. Hill
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. J. Campbell
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Bellamy, N., Anjema, C., Alikhan, N. et al. An evaluation of the effectiveness of a videotape programme on interobserver reliability in outcome assessment for osteoarthritis. Inflammopharmacol 7, 143–154 (1999). https://doi.org/10.1007/BF02918386

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02918386

Key words

Search

Navigation