Abstract
Artificial intelligence (AI) has been increasingly implemented within the healthcare sector. In that regard, efforts are being made toward commercialising diagnostic-assistive technologies. The ability of such systems to mine a significant amount of clinical data has enabled diagnostics to become progressively more precise. Nevertheless, the usage of this technology poses critical challenges regarding ethical, legal and sociological aspects that ought to be addressed and call for regulation. Diagnostic-assistive technologies may be implemented in multiple healthcare fields, all of which require the policymakers’ attention. Despite having transversal concerns, studying the impact of this technology for dermatological diagnosis purposes is paramount, considering that it poses a specific concern in this particular field of application: discrimination. Algorithmic biases such as misrepresentation due to insufficient data for data training processes render the accuracy of the diagnosis provided by this technology selective which favours one group of people over another, solely based on skin colour (a physiognomic feature highly relevant to this field of medicine). Moreover, this technology poses relevant questions regarding the inefficiency of the current framework on liability, such as the Product Liability Directive, which establishes inadequate regimes to encompass these instruments. Additionally, by being so onerous to the healthcare structure, the current legislation enables physicians to adopt defensive behaviours, which tend to favour their patients less. This article aims at understanding how regulatory actions can prevent the lack of legal certainty and social concerns regarding using dermatological diagnostic-assistive technologies.
Similar content being viewed by others
Data availability
The dataset used for this study regarding the demonstration of the accuracy of a specific dermatological diagnostic-assistive technology powered by a convolutional neural network (CNN) in detecting skin cancer may be found in S Albawi et al., Understanding of a convolutional neural network. International Conference of Engineering and Technology (ICET) 1–6 (2017).
Notes
IBM Website, ‘How AI is impacting healthcare’. Website How AI is impacting healthcare | Watson Health | IBM, accessed on 3rd May 2022 [15].
GS Guthart and S. JK. The Intuitive telesurgery system: Overview and application. Proc 2000 ICRA Millenn Conf IEEE Int Conf Robot Autom Symp Proc. 1: 618–621 [3].
Policy Department for Citizens' Rights and Constitutional Affairs Directorate-General for Internal Policies, ‘Artificial Intelligence and Civil Liability’, 2020 [21].
Ibid.
Scientific American, 'Health Care AI Systems Are Biased'. Website Health Care AI Systems Are Biased—Scientific American, accessed on 3rd May 2022 [17].
A Esteva, B Kuprel, RA Novoa, 'Dermatologist-level classification of skin cancer with deep neural networks. (2017) 542 Nature 115–118 [1].
S Gerke et al., 'Ethical and legal challenges of artificial intelligence-driven healthcare. Artificial Intelligence in Healthcare 295–336 (2020) [10].
Scientific American, 'Health Care AI Systems Are Biased'. Website Health Care AI Systems Are Biased—Scientific American, accessed on 23rd May 2022 [17].
Ibid.
World Health Organisation, Health product and policy standards, 'Access to assistive technology & medical devices'. Website https://www.who.int/teams/health-product-policy-and-standards/assistive-and-medical-technology, accessed on 23rd May 2022 [18].
R Williams, 'What is Assistive Tech, who is it for, and what does it enable?' [2018]. Website https://at2030.org/what-is-assistive-tech,-who-is-it-for,-and-what-does-it-enable?/, accessed on 23rd May 2022 [16].
World Health Organisation, 'Assistive Technology: What is in a name?' [2020]. Website https://at2030.org/assistive-technology,-what-is-in-a-name?/, accessed on 23rd May 2022 [19].
A Esteva, B Kuprel, RA Novoa, 'Dermatologist-level classification of skin cancer with deep neural networks'. 542 Nature 115–118 (2017) [1].
S Jartarkar et al., 'New diagnostic and imaging technologies in dermatology. Journal of Cosmetic Dermatology 20(12):3782–3787 (2021) [11].
A Esteva, B Kuprel, RA Novoa, 'Dermatologist-level classification of skin cancer with deep neural networks'. 542 Nature 115–118 (2017) [1].
S Albawi et al., Understanding of a convolutional neural network. International Conference of Engineering and Technology (ICET) 1–6 (2017) [8].
R Chakravorty et al., 'Exploiting Local and Generic Features for Accurate Skin Lesions Classification Using Clinical and Dermoscopy Imaging. International Symposium on Biomedical Imaging (2017) [5].
A Bowling, 'Training Watson to Help Detect Melanomas Earlier and Faster' IBM Watson. Website https://www.ibm.com/blogs/think/2017/03/training-watson-to-detect-melanomas-earlier-and-faster/, accessed on 23rd May 2022 [13].
Policy Department for Citizens' Rights and Constitutional Affairs Directorate-General for Internal Policies, ‘Artificial Intelligence and Civil Liability’, 2020 [21].
Council Directive 85/374/EEC of 25 July 1985 on the approximation of the laws, regulations and administrative provisions of the Member States concerning liability for defective products [22].
Case: VI v KRONE-Verlag Gesellschaft mbH and Co KG (Case C-65/20) ECLI:EU:C:2021:471 [24].
European Commission considers new civil liability rules for the digital age and artificial intelligence. Website https://www.nortonrosefulbright.com/en-de/knowledge/publications/dfbc5dc8/european-commission-considers-new-civil-liability-rules, accessed on 23rd May 2022 [14].
Policy Department for Citizens' Rights and Constitutional Affairs Directorate-General for Internal Policies, ‘Artificial Intelligence and Civil Liability’, 2020 [21].
Ibid.
B Koch, Medical Liability in Europe: Comparative Analysis Medical Liability in Europe A Comparison of Selected Jurisdictions ( edn, De Gruyter 2011) [2].
S Dalton-brown, 'The Ethics of Medical AI and the Physician–Patient Relationship. Cambridge Quarterly of Healthcare Ethics 29(1):115–12 (2020) [9].
European Parliament resolution of 16 February 2017 with recommendations to the Commission on Civil Law Rules on Robotics (2015/2103(INL)), paragraph 32 [23].
Policy Department for Citizens' Rights and Constitutional Affairs Directorate-General for Internal Policies, ‘Artificial Intelligence and Civil Liability’, 2020 [21].
A Esteva, B Kuprel, RA Novoa, 'Dermatologist-level classification of skin cancer with deep neural networks'. 542 Nature 115–118 (2017) [1].
Scientific American, 'Health Care AI Systems Are Biased'. Website Health Care AI Systems Are Biased—Scientific American, accessed on 24th May 2022 [17].
R Daneshjou et al., Disparities in Dermatology AI Performance on a Diverse, Curated Clinical Image Set [6].
Z Villines, 'Skin cancer by race and ethnicity' [2021] MedicalNewsToday. Website https://www.medicalnewstoday.com/articles/skin-cancer-by-race, accessed on 24th May 2022 [20].
T. Beauchamp and J. Childress, Principles of Biomedical Ethics (7th edn, Oxford University Press 2016) [17].
Scientific American, 'Health Care AI Systems Are Biased'. Website Health Care AI Systems Are Biased—Scientific American, accessed on 24th May 2022 [17].
L Lessig, ‘The Law of the Horse: What Cyberlaw Might Teach’ (1999) 6 Harvard Law Review 501 [4].
Ronald Leenes, Erica Palmerini, Bert-Jaap Koops, Andrea Bertolini, Pericle Salvini & Federica Lucivero (2017) Regulatory challenges of robotics: some guidelines for addressing legal and ethical issues, Law, Innovation and Technology, 9:1, 1–44, https://doi.org/10.1080/17579961.2017.1304921 [7].
References
Esteva, A., Kuprel, B., Novoa, R.A.: Dermatologist-level classification of skin cancer with deep neural networks. Nature 542, 115–118 (2017)
Koch, B.: Medical liability in Europe: comparative analysis medical liability in Europe A comparison of selected jurisdictions. De Gruyter (2011)
Guthart, G.S., JK, S.: The Intuitive telesurgery system: overview and application. In: Proc 2000 ICRA Millenn Conf IEEE Int Conf Robot Autom Symp. 1:618–621 (2000)
Lessig, L.: The law of the horse: what cyberlaw might teach. Harvard Law Rev. 6, 501 (1999)
Chakravorty, R. et al.: Exploiting local and generic features for accurate skin lesions classification using clinical and dermoscopy imaging. In: International Symposium on Biomedical Imaging (2017)
Daneshjou, R. et al.: Disparities in dermatology AI performance on a diverse, curated clinical image set
Leenes, R., Palmerini, E., Koops, B.-J., Bertolini, A., Salvini, P., Lucivero, F.: Regulatory challenges of robotics: some guidelines for addressing legal and ethical issues. Law Innov. Technol. 9, 1 (2017)
Albawi, S. et al.: Understanding of a convolutional neural network. In: International Conference of Engineering and Technology (ICET) (2017)
Dalton-Brown, S.: The ethics of medical AI and the physician-patient relationship. Camb Q Healthc Ethics 29(1), 115–121 (2020)
Gerke, S., et al.: Ethical and legal challenges of artificial intelligence-driven healthcare. In: Artificial intelligence in healthcare, pp. 295–336. Academic Press (2020)
Jartarkar, S., et al.: New diagnostic and imaging technologies in dermatology. J. Cosmet. Dermatol. 20(12), 3782–3787 (2021)
Beauchamp, T., Childress, J.: Principles of biomedical ethics, 7th edn. Oxford University Press (2016)
Bowling, A.: Training Watson to help detect melanomas earlier and faster. IBM Watson. Website https://www.ibm.com/blogs/think/2017/03/training-watson-to-detect-melanomas-earlier-and-faster/
European Commission considers new civil liability rules for the digital age and artificial intelligence Website https://www.nortonrosefulbright.com/en-de/knowledge/publications/dfbc5dc8/european-commission-considers-new-civil-liability-rules
IBM Website: How AI is impacting healthcare. How AI is impacting healthcare|Watson Health|IBM
Williams, R.: What is assistive tech, who is it for, and what does it enable? (2018) Website https://at2030.org/what-is-assistive-tech,-who-is-it-for,-and-what-does-it-enable?
Scientific American: Health care AI systems are biased. Website Health Care AI Systems Are Biased—Scientific American
World Health Organisation: Health product and policy standards. Access to assistive technology & medical devices. Website https://www.who.int/teams/health-product-policy-and-standards/assistive-and-medical-technology.
World Health Organisation: Assistive technology: what is in a name? (2020). Website https://at2030.org/assistive-technology,-what-is-in-a-name?
Villines, Z.: Skin cancer by race and ethnicity. MedicalNewsToday (2021). Website https://www.medicalnewstoday.com/articles/skin-cancer-by-race
Policy Department for Citizens' Rights and Constitutional Affairs Directorate-General for Internal Policies. Artificial Intelligence and Civil Liability (2020)
Council Directive 85/374/EEC of 25 July 1985 on the approximation of the laws, regulations and administrative provisions of the Member States concerning liability for defective products
European Parliament resolution of 16 February 2017 with recommendations to the Commission on Civil Law Rules on Robotics (2015/2103(INL))
Case: VI v KRONE-Verlag Gesellschaft mbH and Co KG (Case C-65/20) ECLI:EU:C:2021:471
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Adapted essay written as an evaluation element for the course of Health, Care and Regulation, at Tilburg University (2022).
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Pinto-Alves, M. Dermatological diagnostic-assistive technologies: a call for regulatory action. AI Ethics (2023). https://doi.org/10.1007/s43681-023-00262-z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s43681-023-00262-z