J Korean Med Sci. 2022 Aug 15;37(32):e249. English.
Published online Aug 04, 2022.
© 2022 The Korean Academy of Medical Sciences.
Original Article

Operational Definition Identifying Osteoporotic Vertebral Fractures in the Claims Database

Min Heui Yu,1,* Namki Hong,1,* Seunghyun Lee,2 Ha-Young Kim,3 Hye-Sun Park,4 Sang-Min Park,5 Young-Kyun Lee,5 Tae-Young Kim,6 Yong-Chan Ha,7, Yumie Rhee,1 and Kyung-Hoi Koo8
    • 1Department of Internal Medicine, Endocrine Research Institute, Severance Hospital, Yonsei University College of Medicine, Seoul, Korea.
    • 2Department of Internal Medicine, Yonsei Wonju College of Medicine, Wonju, Korea.
    • 3Department of Internal Medicine, Gangneung Asan Hospital, University of Ulsan College of Medicine, Gangneung, Korea.
    • 4Department of Internal Medicine, Gangnam Severance Hospital, Yonsei University College of Medicine, Seoul, Korea.
    • 5Department of Orthopaedic Surgery, Seoul National University College of Medicine and Seoul National University Bundang Hospital, Seongnam, Korea.
    • 6Department of Orthopaedic Surgery, School of Medicine, Konkuk University, Seoul, Korea.
    • 7Department of Orthopaedic Surgery, College of Medicine, Chung-Ang University, Seoul, Korea.
    • 8Department of Orthopaedic Surgery, Seoul National University Bundang Hospital and Kay Joint Center at Cheil Orthopaedic Hospital, Seoul, Korea.
Received June 15, 2022; Accepted July 07, 2022.

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (https://creativecommons.org/licenses/by-nc/4.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

We analyzed the International Classification of Diseases, 10th edition (ICD-10) diagnostic codes, procedure codes, and radiographic image codes for vertebral fracture (VF) used in the database of Health Insurance Review and Assessment Service (HIRA) of Korea to establish a validated operational definition for identifying patients with osteoporotic VF in claims data.

Methods

We developed three operational definitions for detecting VFs using 9 diagnostic codes, 5 procedure codes and 4 imaging codes. Medical records and radiographs of 2,819 patients, who had primary and subordinated codes of VF between January 2016 and December 2016 at two institutions, were reviewed to detect true vertebral fractures. We evaluated the sensitivity and positive predictive value (PPV) of the operational definition in detecting true osteoporotic VF and obtained the receiver operating characteristic (ROC) curve.

Results

Among the 2,819 patients who had primary or secondary diagnosis codes for VF, 995 patients satisfied at least one of the criteria for the operational definition of osteoporotic VF. Of these patients, 594 were judged as having true fractures based on medical records and radiographic examinations. The sensitivity and PPV were 62.5 (95% confidence interval [CI], 59.4–65.6) and 59.7(95% CI, 56.6–62.8) respectively. In the receiver operating characteristic analysis, area under the curve (AUC) was 0.706 (95% CI, 0.688–0.724).

Conclusion

Our findings demonstrate the validity of our operational definitions to identify VFs more accurately using claims data. This algorithm to identify VF is likely to be useful in future studies for diagnosing osteoporotic VF.

Graphical Abstract

Keywords
Claim Database; Vertebral Fracture; Operational Definition; Osteoporosis

INTRODUCTION

Vertebral fracture (VF) is the most common osteoporotic fracture, that occurs in 30–50% of people aged over 50 years.1, 2, 3, 4, 5 Patients with VF experience marked impairment in mobility and increased mortality; this impairs the patients’ quality-of-life and poses a serious socioeconomic burden on the healthcare system, especially among older adults.4, 6, 7, 8, 9, 10 VF can present with non-specific symptoms or be asymptomatic, thus making clinical detection difficult. The diagnosis of VFs requires spine imaging by lateral radiography. However, it may also be diagnosed by chance on an X-ray requested for other reasons.

Recently, large-scale medical databases have been used for big data research worldwide.5, 6, 11, 12, 13 Medical databases are powerful tools that support clinical and epidemiologic studies of disease burden and treatment outcomes.14, 15, 16, 17, 18, 19, 20, 21, 22 Specifically, a claims database can provide large-scale nationwide information for analysis while also preventing selection bias.14, 15, 17, 23, 24 When properly used, this information allows researchers to simulate predictive scenarios through the use of artificial intelligence such as machine learning and deep learning.25, 26 However, claims databases were established for financial reimbursement and not medical research; therefore, analysis using claims data may be limited due to potential lack of clinical information and possibility of coding errors.5, 20, 27, 28, 29, 30, 31, 32

The lack of details on individual cases, such as VF injury mechanism (i.e., trauma type, osteoporosis), radiographs, and bone mineral density results,20, 28, 29 poses significant limitations on conclusions that may be drawn through analysis using claims database. Among previous studies, osteoporotic VF has had varied definitions when using large-scale medical claim data; there is no standard operational definition for osteoporotic VFs.33, 34, 35 Therefore, researchers should develop algorithms to identify osteoporotic VF prior to the study to reliably validate their operational definitions.23, 36, 37 For this reason, establishing and validating the operational definition of osteoporotic VF is necessary, especially when conducting research using national health claim data.

Here, we analyzed the International Classification of Diseases, 10th edition (ICD-10) diagnostic codes, procedure codes, and radiographic image codes for VF used in the database of Health Insurance Review and Assessment Service (HIRA) of South Korea to establish a validated operational definition for identifying patients with osteoporotic VF in claims data.

METHODS

Development of operational definition to identify osteoporotic VFs

Claims data submitted by our hospital to the national health insurance service were used in this study. The dataset contains demographic data, including age and sex; physician information; and hospital-related comorbidities, as described by the diagnostic codes.

Three of the authors (SMP, a spine surgery specialist with 7 years of experience; YKL, a hip surgery and osteoporosis specialist with 13 years of experience; and TYK, a hip surgery and osteoporosis specialist with 16 years of experience) collaboratively developed three criteria using 9 diagnostic codes (M48.4, M48.5, M49.5, M80.8, S22.0, S22.1, S32.0, S32.7, T08.0), 5 procedure codes (N0471, N0472, N0473, N0474, N0630) and 4 imaging codes (G430, G440, G450, G460) of the ICD-10 code (Table 1).18, 33, 35 Meeting any one of the three criteria was indicative of a VF. If the patient had multiple claims for VF, only the first claim was included. We excluded patients with conditions that were considered high-impact traumas (multiple fractures).

Table 1
Codes for operational definition of osteoporotic vertebral fractures

Criterion 1 was a combination of 9 diagnostic codes and 5 procedure codes. The date of procedure coding was defined as the index date. A VF diagnostic code should have been coded within 1 month before the procedure codes.

Criterion 2 indicated an admission with 9 diagnostic codes as primary diagnosis. Date of the admission was defined as the index date.

Criterion 3 was a combination of 9 diagnostic codes as primary diagnosis and 4 imaging procedure codes irrespective of admission of the patient. The coding date of imaging was defined as the index date. The diagnosis of VF should have been coded as primary diagnosis within 1 month before or after the coding of imaging procedure.

Evaluation of the criterion-related validity

Two evaluators (NH, an endocrinology specialist with 6 years of experience and SL, an endocrinology specialist with 3 years of experience) independently reviewed the medical records and radiographs of 2,819 patients who had at least one of the diagnostic codes for VF as primary or secondary diagnosis at the outpatient clinic or at admission between 1 January 2016 and 31 December 2016 in our tertiary institutions. Patients were diagnosed with incident osteoporotic VF when 1) radiographs showed a decrease in vertebral height > 25% according to semiquantitative Genant method, 2) the patient had developed acute back pain within the most recent 3 months, and 3) patients had no history of major trauma or falls greater than 2-meter based on medical records.38 Any disparity in the diagnosis was resolved by adjudication of third reviewer (YR, an endocrinology specialist with 20 years of experience).

Statistical analysis

We evaluated the sensitivity and positive predictive value (PPV) of the operational definition in detecting true osteoporotic VF and obtained the receiver operating characteristic (ROC) curve. All analyses were performed using STATA v16.0 (Stata Corp., College Station, TX, USA).

Ethics statement

The Institutional Review Board (IRB) of our hospital approved this study (IRB number: 4-2021-1531). The requirement for informed consent was waived by the review board due to retrospective nature of the study design.

RESULTS

Demographic data

Among the 2,819 patients who had primary or secondary diagnosis codes for VF, 995 patients satisfied at least one of the criteria for the operational definition of osteoporotic VF. There was a female preponderance (651/955, 65.43%), and the mean patient age was 65.27 ± 16.71 years (Table 2). Of these patients, 594 were judged as having true fractures based on medical records and radiographic examinations; furthermore, individuals who satisfied operational definition for osteoporotic VF had higher prevalence of prior VF compared to those without.

Table 2
Patient demographics and clinical characteristics of the study population

Validity of the 3 operational definitions

Criteria 1 and 2 identified 5.05% and 1.01% of the patients with VF, respectively, while criterion 3 identified 53.20% of patients with VF (316/594) (Fig. 1).

Fig. 1
Proportion of criteria for vertebral fracture.

The sensitivity and PPV of the operational definition of incident VF were 62.5 (95% confidence interval [CI], 59.4–65.6) and 59.7 (95% CI, 56.6–62.8) respectively (Table 3). Area under the ROC curve for operational definition was 0.706 (95% CI, 0.688–0.724).

Table 3
Diagnostic performance of operational definitions for VF

DISCUSSION

This study demonstrated the diagnostic validity of three operational definitions of VFs that were developed to identify osteoporosis-related VFs from the HIRA claims database. The VF operational definitions were based on a combination of diagnosis, procedure and imaging codes from the medical records. And we demonstrated theses operational definitions based on medical records and radiographs. Our operational definition identified patients with osteoporosis-related VF with a high accuracy by combining diagnosis, procedure, and imaging codes.

In our country, the diagnosis code of claim data is assigned according to the importance of treatment or examination during the treatment period. A primary diagnosis is the condition that consumes the most medical resources, especially for newly diagnosed diseases. Secondary, or subordinated, diagnostic codes imply the use of fewer medical resources than those needed for primary diagnoses. For this reason, the order of diagnostic codes is often used as a criterion for developing operational definitions using claims data,39, 40 and classifying the codes as primary or secondary. Additionally, imaging and procedure codes were used along with diagnostic codes to increase the accuracy of the operational definitions.35 Here, we analyzed the operational definition developed using these codes.

To date, various operational definitions have been proposed for the identification of patients with osteoporotic fractures including VF, hip fracture and distal radius fracture.35, 40, 41 Unlike other osteoporotic fractures,40, 41 identification of patients with osteoporosis-related VFs in claims data is challenging because the claims database does not include data on injury mechanism or bone mineral density. Moreover, the patient’s condition often improves with simple conservative treatments, such as prescription pain relievers, precluding the need for specialty treatments such as vertebroplasty or fusion surgery. Moreover, multiple diagnostic codes assigned during follow-up evaluations after the VF are problematic in accurate diagnostic identification though medical records.

Most osteoporotic VFs are treated conservatively, and there is a wide variation in the therapeutic options used and treatment lengths followed by different physicians. Therefore, previous claims database studies, which mainly used diagnosis codes and/or procedure codes, reported inconsistent incidence rates of osteoporotic VFs.18, 28, 35 Thus, diagnostic, imaging, and procedural codes should be combined to enable accurate identification of cases of osteoporotic VF. Furthermore, prior medical history of VF leads to further inconsistency between the true VF rate and the rate of VFs detected by currently used operational definitions; in the currently available literature, most (99.9%) patients who did not have incident VF but had primary or subordinated codes of VF had a previous history of VF (Table 1). In a previous study, the PPV of incident VF using only the diagnostic code was relatively low by 46%; however, it slightly increased to 61% in this study owing to the inclusion of imaging codes.39

There were some limitations to this study. First, we sourced our data from a tertiary referral center, and a substantial number of the selected patients had comorbidities. If patient populations from other institutions were studied, the results could be inconsistent. Therefore, a multi-institutional study that combines a larger population data set from various databases should be conducted in the future to corroborate our results. Second, our operational definitions cannot be generalized to other countries that use different coding systems. Hence, although further validation is needed to translate our approach to other coding systems and study the populations of different countries, our results may serve as a foundation for such studies. Third, the PPV of our operational definition for VF was lower than those reported for hip fracture (59.1–77.4%)41 and wrist fracture (95.6–98.2%).40 Most patients with VF are treated conservatively and visit the outpatient clinic several times during the treatment course; this unique clinical feature may account for this difference.

Our findings demonstrate the validity of our operational definitions to identify VFs more accurately using claims data. This algorithm to identify VF is likely to be useful in future studies for diagnosing osteoporotic VF. Although the use of three operational definitions could misclassify incident VF, these results may be useful for future observational studies. Additional validation studies that can reduce the effect of confounding factors with improved algorithms and larger datasets should be conducted to corroborate and expand on our findings.

Notes

Funding:This research was supported by a grant of the Korea Health Technology R&D Project through the Korea Health Industry Development Institute, funded by the Ministry of Health & Welfare, Republic of Korea (grant number: HI18C0284).

Disclosure:The authors have no potential conflicts of interest to disclose.

Author Contributions:

  • Conceptualization: Kim HY, Park SM, Lee YK, Kim TY, Ha YC.

  • Data curation: Lee S, Park HS.

  • Formal analysis: Yu MH, Hong N, Rhee Y.

  • Funding acquisition: Lee YK, Koo KH.

  • Investigation: Yu MH, Hong N, Rhee Y.

  • Methodology: Kim HY, Park SM, Lee YK, Kim TY, Ha YC.

  • Software: Yu MH, Hong N.

  • Validation: Yu MH, Hong N, Rhee Y.

  • Visualization: Yu MH, Hong N, Rhee Y.

  • Writing – original draft: Yu MH, Hong N.

  • Writing – review & editing: Park SM, Lee YK.

References

    1. Ballane G, Cauley JA, Luckey MM, El-Hajj Fuleihan G. Worldwide prevalence and incidence of osteoporotic vertebral fractures. Osteoporos Int 2017;28(5):1531–1542.
    1. Cummings SR, Melton LJ. Epidemiology and outcomes of osteoporotic fractures. Lancet 2002;359(9319):1761–1767.
    1. Bouxsein ML, Genant HK. International Osteoporosis Foundation. The Breaking Spine. [Updated 2010]. [Accessed January 20, 2022].
    1. Tokeshi S, Eguchi Y, Suzuki M, Yamanaka H, Tamai H, Orita S, et al. Relationship between skeletal muscle mass, bone mineral density, and trabecular bone score in osteoporotic vertebral compression fractures. Asian Spine J 2021;15(3):365–372.
    1. Choi SH, Kim DY, Koo JW, Lee SG, Jeong SY, Kang CN. Incidence and management trends of osteoporotic vertebral compression fractures in South Korea: a nationwide population-based study. Asian Spine J 2020;14(2):220–228.
    1. Lee YK, Jang S, Jang S, Lee HJ, Park C, Ha YC, et al. Mortality after vertebral fracture in Korea: analysis of the national claim registry. Osteoporos Int 2012;23(7):1859–1865.
    1. Kang BJ, Lee YK, Lee KW, Won SH, Ha YC, Koo KH. Mortality after hip fractures in nonagenarians. J Bone Metab 2012;19(2):83–86.
    1. Lee YK, Lee YJ, Ha YC, Koo KH. Five-year relative survival of patients with osteoporotic hip fracture. J Clin Endocrinol Metab 2014;99(1):97–100.
    1. Jang HD, Kim EH, Lee JC, Choi SW, Kim K, Shin BJ. Current concepts in the management of osteoporotic vertebral fractures: a narrative review. Asian Spine J 2020;14(6):898–909.
    1. Umehara T, Inukai A, Kuwahara D, Kaneyashiki R, Kaneguchi A, Tsunematsu M, et al. Physical functions and comorbidity affecting collapse at 4 or more weeks after admission in patients with osteoporotic vertebral fractures: a prospective cohort study. Asian Spine J 2022;16(3):419–431.
    1. Lee YK, Kim KC, Ha YC, Koo KH. Utilization of hyaluronate and incidence of septic knee arthritis in adults: results from the Korean national claim registry. Clin Orthop Surg 2015;7(3):318–322.
    1. Lee S, Hwang JI, Kim Y, Yoon PW, Ahn J, Yoo JJ. Venous thromboembolism following hip and knee replacement arthroplasty in Korea: a nationwide study based on claims registry. J Korean Med Sci 2016;31(1):80–88.
    1. Lee YK, Ha YC, Park C, Koo KH. Trends of surgical treatment in femoral neck fracture: a nationwide study based on claim registry. J Arthroplasty 2013;28(10):1839–1841.
    1. Chung KC, Shauver MJ, Birkmeyer JD. Trends in the United States in the treatment of distal radial fractures in the elderly. J Bone Joint Surg Am 2009;91(8):1868–1873.
    1. DeNoble PH, Marshall AC, Barron OA, Catalano LW 3rd, Glickel SZ. Malpractice in distal radius fracture management: an analysis of closed claims. J Hand Surg Am 2014;39(8):1480–1488.
    1. Jung HS, Jang S, Chung HY, Park SY, Kim HY, Ha YC, et al. Incidence of subsequent osteoporotic fractures after distal radius fractures and mortality of the subsequent distal radius fractures: a retrospective analysis of claims data of the Korea National Health Insurance Service. Osteoporos Int 2021;32(2):293–299.
    1. Kakar S, Noureldin M, Van Houten HK, Mwangi R, Sangaralingham LR. Trends in the incidence and treatment of distal radius fractures in the United States in privately insured and Medicare advantage enrollees. Hand (N Y) 2022;17(2):331–338.
    1. Kim TY, Jang S, Park CM, Lee A, Lee YK, Kim HY, et al. Trends of incidence, mortality, and future projection of spinal fractures in Korea using nationwide claims data. J Korean Med Sci 2016;31(5):801–805.
    1. Ha YC, Kim TY, Lee A, Lee YK, Kim HY, Kim JH, et al. Current trends and future projections of hip fracture in South Korea using nationwide claims data. Osteoporos Int 2016;27(8):2603–2609.
    1. Lee YK, Ha YC, Park C, Yoo JJ, Shin CS, Koo KH. Bisphosphonate use and increased incidence of subtrochanteric fracture in South Korea: results from the national claim registry. Osteoporos Int 2013;24(2):707–711.
    1. Lee YK, Ha YC, Choi HJ, Jang S, Park C, Lim YT, et al. Bisphosphonate use and subsequent hip fracture in South Korea. Osteoporos Int 2013;24(11):2887–2892.
    1. Kim HY, Ha YC, Kim TY, Cho H, Lee YK, Baek JY, et al. Healthcare costs of osteoporotic fracture in Korea: information from the National Health Insurance claims database, 2008-2011. J Bone Metab 2017;24(2):125–133.
    1. Kim JA, Yoon S, Kim LY, Kim DS. Towards actualizing the value potential of Korea Health Insurance Review and Assessment (HIRA) data as a resource for health research: strengths, limitations, applications, and strategies for optimal use of HIRA data. J Korean Med Sci 2017;32(5):718–728.
    1. Shauver MJ, Yin H, Banerjee M, Chung KC. Current and future national costs to Medicare for the treatment of distal radius fracture in the elderly. J Hand Surg Am 2011;36(8):1282–1287.
    1. Engels A, Reber KC, Lindlbauer I, Rapp K, Büchele G, Klenk J, et al. Osteoporotic hip fracture prediction from risk factors available in administrative claims data - a machine learning approach. PLoS One 2020;15(5):e0232969
    1. Kong SH, Ahn D, Kim BR, Srinivasan K, Ram S, Kim H, et al. A novel fracture prediction model using machine learning in a community-based cohort. JBMR Plus 2020;4(3):e10337
    1. Katz JN, Barrett J, Liang MH, Bacon AM, Kaplan H, Kieval RI, et al. Sensitivity and positive predictive value of Medicare part B physician claims for rheumatologic diagnoses and procedures. Arthritis Rheum 1997;40(9):1594–1600.
    1. Park C, Ha YC, Jang S, Jang S, Yoon HK, Lee YK. The incidence and residual lifetime risk of osteoporosis-related fractures in Korea. J Bone Miner Metab 2011;29(6):744–751.
    1. Lee YK, Yoon BH, Nho JH, Kim KC, Ha YC, Koo KH. National trends of surgical treatment for intertrochanteric fractures in Korea. J Korean Med Sci 2013;28(9):1407–1408.
    1. Cheng CL, Kao YH, Lin SJ, Lee CH, Lai ML. Validation of the National Health Insurance Research Database with ischemic stroke cases in Taiwan. Pharmacoepidemiol Drug Saf 2011;20(3):236–242.
    1. Cheng CL, Lee CH, Chen PS, Li YH, Lin SJ, Yang YH. Validation of acute myocardial infarction cases in the national health insurance research database in Taiwan. J Epidemiol 2014;24(6):500–507.
    1. De Coster C, Quan H, Finlayson A, Gao M, Halfon P, Humphries KH, et al. Identifying priorities in methodological research using ICD-9-CM and ICD-10 administrative data: report from an international consortium. BMC Health Serv Res 2006;6(1):77.
    1. Yoo JH, Moon SH, Ha YC, Lee DY, Gong HS, Park SY, et al. Osteoporotic fracture: 2015 position statement of the Korean Society for Bone and Mineral Research. J Bone Metab 2015;22(4):175–181.
    1. Lee YK, Ha YC, Yoon BH, Koo KH. Incidence of second hip fracture and compliant use of bisphosphonate. Osteoporos Int 2013;24(7):2099–2104.
    1. Park SM, Ahn SH, Kim HY, Jang S, Ha YC, Lee YK, et al. Incidence and mortality of subsequent vertebral fractures: analysis of claims data of the Korea National Health Insurance Service from 2007 to 2016. Spine J 2020;20(2):225–233.
    1. Cho SK, Sung YK, Choi CB, Kwon JM, Lee EK, Bae SC. Development of an algorithm for identifying rheumatoid arthritis in the Korean National Health Insurance claims database. Rheumatol Int 2013;33(12):2985–2992.
    1. Shrestha S, Dave AJ, Losina E, Katz JN. Diagnostic accuracy of administrative data algorithms in the diagnosis of osteoarthritis: a systematic review. BMC Med Inform Decis Mak 2016;16(1):82.
    1. Genant HK, Wu CY, van Kuijk C, Nevitt MC. Vertebral fracture assessment using a semiquantitative technique. J Bone Miner Res 1993;8(9):1137–1148.
    1. Curtis JR, Mudano AS, Solomon DH, Xi J, Melton ME, Saag KG. Identification and validation of vertebral compression fractures using administrative claims data. Med Care 2009;47(1):69–72.
    1. Lee YK, Park C, Won S, Park JW, Koo KH, Ha YC, et al. Validation of an operational definition to identify distal radius fractures in a National Health Insurance Database. J Hand Surg Am 2021;46(11):1026.e1–1026.e7.
    1. Park C, Jang S, Jang S, Ha YC, Lee YK, Yoon HK, et al. Identification and validation of osteoporotic hip fracture using the National Health Insurance Database. J Korean Hip Soc 2010;22(4):305–311.

Metrics
Share
Figures

1 / 1

Tables

1 / 3

Funding Information
PERMALINK