Abstract
Artificial intelligence (AI) and machine learning in healthcare are growing at an unprecedented rate. Myriad uses of medical AI, ranging from tumor identification on imaging to workforce management, make use of a wealth of available healthcare data. These models are becoming increasingly commercially available. However, much of the utility of medical AI depends on the quality of the data models trained on, and critically, the contexts and biases within which these models are created. In this chapter, we first describe a business-informed framework that influences product development and commercialization of these technologies. We describe the consumer side that includes purchasers, end users, and patients. Subsequently, we underscore the pitfalls of the assumption that models trained in one context can be applied to another, that is, the myth of generalizability. We propose solutions to these problems and describe the importance of co-creation and multi-stakeholder engagement in designing medical AI. We highlight the need to define value metrics that consider equity and the mitigation of healthcare disparities. Lastly, we draw attention to open ethical, legal, and policy questions that must be answered as the role of AI in medicine progresses and grows.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Artificial Intelligence in Healthcare Market with Covid-19 Impact Analysis by Offering (Hardware, Software, Services), Technology (Machine Learning, NLP, Context-Aware Computing, Computer Vision), End-Use Application, End User and Region – Global Forecast. Markets and Markets. Published 2020. https://www.marketsandmarkets.com/PressReleases/artificial-intelligence-healthcare.asp. Accessed 12 Dec 2020.
Schaffter T, Buist DSM, Lee CI, et al. Evaluation of combined artificial intelligence and radiologist assessment to interpret screening mammograms. JAMA Netw open. Published online 2020. https://doi.org/10.1001/jamanetworkopen.2020.0265.
Salim M, Wåhlin E, Dembrower K, et al. External evaluation of 3 commercial artificial intelligence algorithms for independent assessment of screening mammograms. JAMA Oncol. Published online 2020. https://doi.org/10.1001/jamaoncol.2020.3321.
Hong JC, Eclov NCW, Dalal NH, et al. System for high-intensity evaluation during radiation therapy (SHIELD-RT): a prospective randomized study of machine learning–directed clinical evaluations during radiation and chemoradiation. J Clin Oncol. Published online 2020. https://doi.org/10.1200/JCO.20.01688.
Spatharou A, Hieronimus S, Jenkins J. Transforming healthcare with AI: the impact on the workforce and organizations. McKinsey & Company.
Berwick DM. Elusive waste: the Fermi Paradox in US health care. JAMA – J Am Med Assoc. Published online 2019. https://doi.org/10.1001/jama.2019.14610.
Schneeweiss S. Learning from big health care data. N Engl J Med. Published online 2014. https://doi.org/10.1056/nejmp1401111.
Wynants L, Van Calster B, Collins GS, et al. Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal. BMJ. Published online 2020. https://doi.org/10.1136/bmj.m1328.
Futoma J, Simons M, Panch T, Doshi-Velez F, Celi LA. The myth of generalisability in clinical research and machine learning in health care. Lancet Digit Health. Published online 2020. https://doi.org/10.1016/S2589-7500(20)30186-2.
Luo W, Phung D, Tran T, et al. Guidelines for developing and reporting machine learning predictive models in biomedical research: a multidisciplinary view. J Med Internet Res. Published online 2016. https://doi.org/10.2196/jmir.5870.
Bluemke DA, Moy L, Bredella MA, et al. Assessing radiology research on artificial intelligence: a brief guide for authors, reviewers, and readers-from the Radiology Editorial Board. Radiology. Published online 2020. https://doi.org/10.1148/radiol.2019192515.
Leisman DE, Harhay MO, Lederer DJ, et al. Development and reporting of prediction models. Crit Care Med. Published online 2020. https://doi.org/10.1097/ccm.0000000000004246.
Bedoya AD, Clement ME, Phelan M, Steorts RC, O’Brien C, Goldstein BA. Minimal impact of implemented early warning score and best practice alert for patient deterioration. Crit Care Med. Published online 2019. https://doi.org/10.1097/CCM.0000000000003439.
Downey CL, Tahir W, Randell R, Brown JM, Jayne DG. Strengths and limitations of early warning scores: a systematic review and narrative synthesis. Int J Nurs Stud. Published online 2017. https://doi.org/10.1016/j.ijnurstu.2017.09.003.
Gerry S, Bonnici T, Birks J, et al. Early warning scores for detecting deterioration in adult hospital patients: systematic review and critical appraisal of methodology. BMJ. Published online 2020. https://doi.org/10.1136/bmj.m1501.
Rothwell PM. Factors that can affect the external validity of randomised controlled trials. PLoS Clin Trials. Published online 2006. https://doi.org/10.1371/journal.pctr.0010009.
Rothwell PM. External validity of randomised controlled trials: “to whom do the results of this trial apply?” Lancet. Published online 2005. https://doi.org/10.1016/S0140-6736(04)17670-8.
Jüni P, Altman DG, Egger M. Systematic reviews in health care: assessing the quality of controlled clinical trials. Br Med J. Published online 2001. https://doi.org/10.1136/bmj.323.7303.42.
Geis JR, Brady A, Wu CC, et al. Ethics of artificial intelligence in radiology: summary of the joint European and North American multisociety statement. Insights Imaging. Published online 2019. https://doi.org/10.1186/s13244-019-0785-8.
Rencsok EM, Bazzi LA, McKay RR, et al. Diversity of enrollment in prostate cancer clinical trials: current status and future directions. Cancer Epidemiol Biomarkers Prev. Published online 2020. https://doi.org/10.1158/1055-9965.EPI-19-1616.
Murthy VH, Krumholz HM, Gross CP. Participation in cancer clinical trials: race-, sex-, and age-based disparities. J Am Med Assoc. Published online 2004. https://doi.org/10.1001/jama.291.22.2720.
King TE. Racial disparities in clinical trials. N Engl J Med. Published online 2002. https://doi.org/10.1056/nejm200205023461812.
Adamson AS, Smith A. Machine learning and health care disparities in dermatology. JAMA Dermatol. Published online 2018. https://doi.org/10.1001/jamadermatol.2018.2348.
Buolamwini J. Gender shades: intersectional accuracy disparities in commercial gender classification supplementary materials. 2018.
Wahl B, Cossy-Gantner A, Germann S, … Artificial intelligence (AI) and global health: how can AI contribute to health in resource-poor settings? BMJ Glob Heal. Published online 2018.
Parikh RB, Teeple S, Navathe AS. Addressing bias in artificial intelligence in health care. JAMA – J Am Med Assoc. Published online 2019. https://doi.org/10.1001/jama.2019.18058.
Gulshan V, Rajan RP, Widner K, et al. Performance of a deep-learning algorithm vs manual grading for detecting diabetic retinopathy in India. JAMA Ophthalmol. Published online 2019. https://doi.org/10.1001/jamaophthalmol.2019.2004.
Krause J, Gulshan V, Rahimy E, et al. Grader variability and the importance of reference standards for evaluating machine learning models for diabetic retinopathy. Ophthalmology. Published online 2018. https://doi.org/10.1016/j.ophtha.2018.01.034.
Schaekermann M, Hammel N, Terry M, et al. Remote tool-based adjudication for grading diabetic retinopathy. Transl Vis Sci Technol. Published online 2019. https://doi.org/10.1167/tvst.8.6.40.
Beede E, Baylor E, Hersch F, et al. A human-centered evaluation of a deep learning system deployed in clinics for the detection of diabetic retinopathy. In: Conference on human factors in computing systems – proceedings. 2020. https://doi.org/10.1145/3313831.3376718.
Zech JR, Badgeley MA, Liu M, Costa AB, Titano JJ, Oermann EK. Variable generalization performance of a deep learning model to detect pneumonia in chest radiographs: a cross-sectional study. PLoS Med. Published online 2018. https://doi.org/10.1371/journal.pmed.1002683.
Geissbauer R, Wunderlin J, Schrauf S, et al. Digital Product Development 2025: agile, collaborative, AI driven and customer centric. PricewaterhouseCoopers GmbH Wirtschaftsprüfungsgesellschaf. Published 2019. https://www.pwc.de/de/digitale-transformation/pwc-studie-digital-product-development-2025.pdf
Komorowski M, Celi LA, Badawi O, Gordon AC, Faisal AA. The artificial intelligence clinician learns optimal treatment strategies for sepsis in intensive care. Nat Med. Published online 2018. https://doi.org/10.1038/s41591-018-0213-5.
Hampton JR. Evidence-based medicine, opinion-based medicine, and real-world medicine. Perspect Biol Med. Published online 2002. https://doi.org/10.1353/pbm.2002.0070.
Sherman RE, Anderson SA, Dal Pan GJ, et al. Real-world evidence – what is it and what can it tell us? N Engl J Med. Published online 2016. https://doi.org/10.1056/NEJMsb1609216.
Panch T, Pollard TJ, Mattie H, Lindemer E, Keane PA, Celi LA. “Yes, but will it work for my patients?” Driving clinically relevant research with benchmark datasets. npj Digit Med. Published online 2020. https://doi.org/10.1038/s41746-020-0295-6.
Deo RC. Machine learning in medicine. Circulation. Published online 2015. https://doi.org/10.1161/CIRCULATIONAHA.115.001593.
Challen R, Denny J, Pitt M, Gompels L, Edwards T, Tsaneva-Atanasova K. Artificial intelligence, bias and clinical safety. BMJ Qual Saf. Published online 2019. https://doi.org/10.1136/bmjqs-2018-008370.
Sheridan S, Schrandt S, Forsythe L, Hilliard TS, Paez KA. The PCORI engagement rubric: promising practices for partnering in research. Ann Fam Med. Published online 2017. https://doi.org/10.1370/afm.2042.
Patient-Centred Outcomes Research Institute. Engagement rubric for applicants. 2014. Published online 2016.
Boaz A, Hanney S, Borst R, O’Shea A, Kok M. How to engage stakeholders in research: design principles to support improvement. Heal Res Policy Syst. Published online 2018. https://doi.org/10.1186/s12961-018-0337-6.
Oliver A, Greenberg CC. Measuring outcomes in oncology treatment: the importance of patient-centered outcomes. Surg Clin North Am. Published online 2009. https://doi.org/10.1016/j.suc.2008.09.015.
Valero-Elizondo J, Khera R, Saxena A, et al. Financial hardship from medical bills among nonelderly U.S. adults with atherosclerotic cardiovascular disease. J Am Coll Cardiol. 2019;73(6):727–32. https://doi.org/10.1016/j.jacc.2018.12.004.
Knight TG, Deal AM, Dusetzina SB, et al. Financial toxicity in adults with cancer: adverse outcomes and noncompliance. J Oncol Pract. 2018;14(11):e665–73. https://doi.org/10.1200/jop.18.00120.
Thurman WA, Harrison T. Social context and value-based care: a capabilities approach for addressing health disparities. Policy Polit Nurs Pract. Published online 2017. https://doi.org/10.1177/1527154417698145.
Casalino LP, Elster A. Will pay-for-performance and quality reporting affect health care disparities? Health Aff. Published online 2007. https://doi.org/10.1377/hlthaff.26.3.w405.
Alberti PM, Bonham AC, Kirch DG. Making equity a value in value-based health care. Acad Med. Published online 2013. https://doi.org/10.1097/ACM.0b013e3182a7f76f.
Musser E. Measuring for equity: the medicaid quality network. NCQA Blog.
Greenwood BN, Carnahan S, Huang L. Patient–physician gender concordance and increased mortality among female heart attack patients. Proc Natl Acad Sci U S A. Published online 2018. https://doi.org/10.1073/pnas.1800097115.
Mahase E. Black babies are less likely to die when cared for by black doctors, US study finds. BMJ. Published online 2020. https://doi.org/10.1136/bmj.m3315.
Greenwood BN, Hardeman RR, Huang L, Sojourner A. Physician-patient racial concordance and disparities in birthing mortality for newborns. Proc Natl Acad Sci U S A. Published online 2020. https://doi.org/10.1073/pnas.1913405117.
Schuster A, Lange T, Backhaus SJ, et al. Artificial intelligence based fully automated myocardial function assessment for diagnostic and prognostic stratification following myocardial infarction. J Am Coll Cardiol. Published online 2020. https://doi.org/10.1016/s0735-1097(20)32192-6.
Zeng W, Yuan J, Yuan C, Wang Q, Liu F, Wang Y. Classification of myocardial infarction based on hybrid feature extraction and artificial intelligence tools by adopting tunable-Q wavelet transform (TQWT), variational mode decomposition (VMD) and neural networks. Artif Intell Med. Published online 2020. https://doi.org/10.1016/j.artmed.2020.101848.
Obermeyer Z, Powers B, Vogeli C, Mullainathan S. Dissecting racial bias in an algorithm used to manage the health of populations. Science (80- ). Published online 2019. https://doi.org/10.1126/science.aax2342.
Slater J. Spirituality and the curriculum. Taboo J Cult Educ. Published online 2005.
New AMA policy recognizes racism as a public health threat. AMA. Published 2020. https://www.ama-assn.org/press-center/press-releases/new-ama-policy-recognizes-racism-public-health-threat. Accessed 12 Dec 2020.
Johnson K. Researchers are starting to refuse to review Google AI papers. Venture Beat.
Ownby GT. Malpractice case: you’re liable, even if your EHR malfunctions. MedScape.
Makary MA, Daniel M. Medical error-the third leading cause of death in the US. BMJ. Published online 2016. https://doi.org/10.1136/bmj.i2139.
Commission E. A European strategy for data 19.2.2020 COM(2020) 66 Final Communication. 2020.
Segal A. The coming tech cold war with china beijing is already countering washington’s policy. Foreign affairs. Published 9 September 2020. Accessed via https://www.foreignaffairs.com/articles/north-america/2020-09-09/coming-tech-cold-war-china. Last access 15 August 2021.
Feijóo C, Kwon Y, Bauer JM, et al. Harnessing artificial intelligence (AI) to increase wellbeing for all: the case for a new technology diplomacy. Telecomm Policy. Published online 2020. https://doi.org/10.1016/j.telpol.2020.101988.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this entry
Cite this entry
Dee, E.C., Yu, R.C., Celi, L.A., Nehal, U.S. (2022). AIM and Business Models of Healthcare. In: Lidströmer, N., Ashrafian, H. (eds) Artificial Intelligence in Medicine. Springer, Cham. https://doi.org/10.1007/978-3-030-64573-1_247
Download citation
DOI: https://doi.org/10.1007/978-3-030-64573-1_247
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-64572-4
Online ISBN: 978-3-030-64573-1
eBook Packages: MedicineReference Module Medicine