Abstract
The objective of this study was to define the optimal algorithm to identify patients with dyslipidemia using electronic medical records (EMRs). EMRs of patients attending primary care clinics in St. John’s, Newfoundland and Labrador (NL), Canada during 2009–2010, were studied to determine the best algorithm for identification of dyslipidemia. Six algorithms containing three components, dyslipidemia ICD coding, lipid lowering medication use, and abnormal laboratory lipid levels, were tested against a gold standard, defined as the existence of any of the three criteria. Linear discriminate analysis, and bootstrapping were performed following sensitivity/specificity testing and receiver’s operating curve analysis. Two validating datasets, NL records of 2011–2014, and Canada-wide records of 2010–2012, were used to replicate the results. Relative to the gold standard, combining laboratory data together with lipid lowering medication consumption yielded the highest sensitivity (99.6%), NPV (98.1%), Kappa agreement (0.98), and area under the curve (AUC, 0.998). The linear discriminant analysis for this combination resulted in an error rate of 0.15 and an Eigenvalue of 1.99, and the bootstrapping led to AUC: 0.998, 95% confidence interval: 0.997–0.999, Kappa: 0.99. This algorithm in the first validating dataset yielded a sensitivity of 97%, Negative Predictive Value (NPV) = 83%, Kappa = 0.88, and AUC = 0.98. These figures for the second validating data set were 98%, 93%, 0.95, and 0.99, respectively. Combining laboratory data with lipid lowering medication consumption within the EMR is the best algorithm for detecting dyslipidemia. These results can generate standardized information systems for dyslipidemia and other chronic disease investigations using EMRs.
Similar content being viewed by others
References
Public health agency of Canada, Canadian institute for health information, Heart and stroke foundation of Canada, Statistics Canada, Tracking heart disease and stroke in Canada, 2009. Available from: http://www.phac-aspc.gc.ca/publicat/2009/cvd-avc/pdf/cvd-avs-2009-eng.pdf.
Filate, W.A., Johansen, H.L., Kennedy, C.C., and Tu, J.V., Regional variations in cardiovascular mortality in Canada. Can J Cardiol. 19(11):1241–1248, 2003.
Manuel, D.G., Leung, M., Nguyen, K., Tanuseputro, P., and Johansen, K., Burden of cardiovascular disease in Canada. Can J Cardiol. 19(9):997–1004, 2003.
Asghari, S., Aref-Eshghi, E., Hurley, O., Godwin, M., Duke, P., Williamson, T., et al., Does the prevalence of dyslipidemias differ between Newfoundland and the rest of Canada? Findings from the electronic medical Records of the Canadian Primary Care Sentinel Surveillance Network. Front Cardiovasc Med. 2:1, 2015.
Birtwhistle, R., Keshavjee, K., Lambert-Lanning, A., Godwin, M., Greiver, M., Manca, D., et al., Building a pan-Canadian primary care sentinel surveillance network: initial development and moving forward. J Am Board Fam Med. 22(4):412–422, 2009.
Crawford, A.G., Cote, C., Couto, J., Daskiran, M., Gunnarsson, C., Haas, K., et al., Prevalence of obesity, type II diabetes mellitus, hyperlipidemia, and hypertension in the United States: findings from the GE centricity electronic medical record database. Popul Health Manag. 13(3):151–161, 2010.
Young, W.B., and Ryu, H., Secondary data for policy studies: benefits and challenges. Policy Polit Nurs Pract. 1(4):302–307, 2000.
Ryan, S.A., and Thompson, C.B., The use of aggregate data for measuring practice improvement. Semin Nurse Manag. 10(2):90–94, 2002.
Mitiku, T.F., and Tu, K., Using data from electronic medical records: theory versus practice. Healthc Q. 11(4):23–25, 2008.
Protti, D., Comparison of information technology in general practice in 10 countries. Healthc Q. 10(2):107–116, 2007.
Chubak, J., Pocobelli, G., and Weiss, N.S., Tradeoffs between accuracy measures for electronic health care data algorithms. J Clin Epidemiol. 65(3):343–349, 2012.
Miller, D.R., Safford, M.M., and Pogach, L.M., Who has diabetes? Best estimates of diabetes prevalence in the department of veterans affairs based on computerized patient data. Diabetes Care. 27(Suppl 2):B10–B21, 2004.
Hota, B., Harting, B., Weinstein, R.A., Lyles, R.D., Bleasdale, S.C., Trick, W., et al., Electronic algorithmic prediction of central vascular catheter use. Infect Control Hosp Epidemiol. 31(1):4–11, 2010.
Park, M.Y., Yoon, D., Lee, K., Kang, S.Y., Park, I., Lee, S.H., et al., A novel algorithm for detection of adverse drug reaction signals using a hospital electronic medical record database. Pharmacoepidemiol Drug Saf. 20(6):598–607, 2011.
Tu, K., Manuel, D., Lam, K., Kavanagh, D., Mitiku, T.F., and Guo, H., Diabetics can be identified in an electronic medical record using laboratory tests and prescriptions. Journal of Clinical Epidemiology. 64(4):431–435, 2011.
McAdam-Marx, C., Ye, X., Sung, J.C., Brixner, D.I., and Kahler, K.H., Results of a retrospective, observational pilot study using electronic medical records to assess the prevalence and characteristics of patients with resistant hypertension in an ambulatory care setting. Clin Ther. 31(5):1116–1123, 2009.
Biskupiak, J.E., Kim, J., Phatak, H., and Wu, D., Prevalence of high-risk cardiovascular conditions and the status of hypertension management among hypertensive adults 65 years and older in the United States: analysis of a primary care electronic medical records database. J Clin Hypertens (Greenwich). 12(12):935–944, 2010.
Minard, J.P., Turcotte, S.E., and Lougheed, M.D., Asthma electronic medical records in primary care: an integrative review. J Asthma. 47(8):895–912, 2010.
Nishida, Y., Takahashi, Y., Nakayama, T., Soma, M., Kitamura, N., and Asai, S., Effect of candesartan monotherapy on lipid metabolism in patients with hypertension: a retrospective longitudinal survey using data from electronic medical records. Cardiovasc Diabetol. 9:38, 2010.
Pettersson, B., Ambegaonkar, B., Sazonov, V., Martinell, M., Stalhammar, J., and Wandell, P., Prevalence of lipid abnormalities before and after introduction of lipid modifying therapy among swedish patients with dyslipidemia (PRIMULA). BMC Public Health. 10:737, 2010.
Tu, K., Mitiku, T., Guo, H., Lee, D.S., and Tu, J.V., Myocardial infarction and the validation of physician billing and hospitalization data using electronic medical records. Chronic Dis Can. 30(4):141–146, 2010.
Zhang, Q., Rajagopalan, S., Mavros, P., Engel, S.S., Davies, M.J., Yin, D., et al., Differences in baseline characteristics between patients prescribed sitagliptin versus exenatide based on a US electronic medical record database. Advances in Therapy. 27(4):223–232, 2010.
Mnatsakanyan, Z.R., Mollura, D.J., Ticehurst, J.R., Hashemian, M.R., and Hung, L.M., Electronic medical record (EMR) utilization for public health surveillance. AMIA Annu Symp Proc. 2008:480–484, 2008.
Himes, B.E., Dai, Y., Kohane, I.S., Weiss, S.T., and Ramoni, M.F., Prediction of chronic obstructive pulmonary disease (COPD) in asthma patients using electronic medical records. J Am Med Inform Assoc. 16(3):371–379, 2009.
Semins, M.J., Trock, B.J., and Matlaga, B.R., Validity of administrative coding in identifying patients with upper urinary tract calculi. J Urol. 184(1):190–192, 2010.
Chotchaisuwatana, S., Jedsadayanmata, A., Chaiyakunapruk, N., and Jampachaisri, K., Validation of electronic medical database in patients with atrial fibrillation in community hospitals. J Med Assoc Thai. 94(6):686–692, 2011.
Birman-Deych, E., Waterman, A.D., Yan, Y., Nilasena, D.S., Radford, M.J., and Gage, B.F., Accuracy of ICD-9-CM codes for identifying cardiovascular and stroke risk factors. Med Care. 43(5):480–485, 2005.
O'Malley, K.J., Cook, K.F., Price, M.D., Wildes, K.R., Hurdle, J.F., and Ashton, C.M., Measuring diagnoses: ICD code accuracy. Health Serv Res. 40(5 Pt 2):1620–1639, 2005.
El-Serag, H.B., Petersen, L., Hampel, H., Richardson, P., and Cooper, G., The use of screening colonoscopy for patients cared for by the department of veterans affairs. Arch Intern Med. 166(20):2202–2208, 2006.
Kandula, S., Zeng-Treitler, Q., Chen, L., Salomon, W.L., and Bray, B.E., A bootstrapping algorithm to improve cohort identification using structured data. J Biomed Inform. 44(Suppl 1):S63–S68, 2011.
Asghari, S., Aref-Eshghi, E., Godwin, M., Duke, P., Williamson, T., and Mahdavian, M., Single and mixed dyslipidemia in Canadian primary care population: a comparison of statin-treated and untreated subjects from electronic medical records. BMJ open. 5:e007954, 2015.
Aref-Eshghi, E., Leung, J., Godwin, M., Duke, P., Williamson, T., Mahdavian, M., and Asghari, S., Low density lipoprotein cholesterol control in Canadian high risk cardiovascular population: findings from Canadian primary care sentinel surveillance network database. Lipids Health Dis. 14:60, 2015.
Hodge, T., EMR, EHR, and PHR – why all the confusion? Canada health infoway, 2011. Available from https://www.infoway-inforoute.ca/en/what-we-do/blog/digital-health-records/6852-emr-ehr-and-phr-why-all-the-confusion. Last accessed 24 Jan 2017.
Genest, J., McPherson, R., Frohlich, J., Anderson, T., Campbell, N., Carpentier, A., et al., Canadian cardiovascular society/Canadian guidelines for the diagnosis and treatment of dyslipidemia and prevention of cardiovascular disease in the adult - 2009 recommendations. Can J Cardiol. 25(10):567–579, 2009.
Oake, J., Aref-Eshghi, E., Godwin, M., Collins, K., Aubrey-Bassler, K., Duke, P., Mahdavian, M., and Asghari, S., Using electronic medical record to identify patients with dyslipidemia in primary care settings: international classification of disease code matters from one region to a national database. Biomed Inform Insights. 9(1):1–7, 2017.
Joseph, L., Gyorkos, T.W., and Coupal, L., Bayesian estimation of disease prevalence and the parameters of diagnostic tests in the absence of a gold standard. American Journal of Epidemiology. 141(3):263–272, 1995.
Acknowledgements
We thank Ms. Kathleen Murphy for language editing of the manuscript.
Authors’ contributions
Study Design: SA, EAE, JO; Data collection: SA, EAE; Manuscript writing: SA, JO, EAE; Critical comments on the manuscript: EAE, PD, KAB, MG, PD, MM.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The authors have no potential conflicts to declare.
Funding source
This study was funded by the Newfoundland and Labrador Centre for Applied Health Research (NLCAHR). All of the study steps including data analysis, interpreting the results, and manuscript writing were performed with the support of the mentioned funding source.
Additional information
This article is part of the Topical Collection on Systems-Level Quality Improvement.
Rights and permissions
About this article
Cite this article
Aref-Eshghi, E., Oake, J., Godwin, M. et al. Identification of Dyslipidemic Patients Attending Primary Care Clinics Using Electronic Medical Record (EMR) Data from the Canadian Primary Care Sentinel Surveillance Network (CPCSSN) Database. J Med Syst 41, 45 (2017). https://doi.org/10.1007/s10916-017-0694-7
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10916-017-0694-7