Frontiers in Human Dynamics (Jul 2021)
Co-Design of a Trustworthy AI System in Healthcare: Deep Learning Based Skin Lesion Classifier
- Roberto V. Zicari,
- Roberto V. Zicari,
- Roberto V. Zicari,
- Sheraz Ahmed,
- Julia Amann,
- Stephan Alexander Braun,
- Stephan Alexander Braun,
- John Brodersen,
- John Brodersen,
- Frédérick Bruneault,
- James Brusseau,
- Erik Campano,
- Megan Coffee,
- Andreas Dengel,
- Andreas Dengel,
- Boris Düdder,
- Alessio Gallucci,
- Thomas Krendl Gilbert,
- Philippe Gottfrois,
- Emmanuel Goffi,
- Christoffer Bjerre Haase,
- Christoffer Bjerre Haase,
- Thilo Hagendorff,
- Eleanore Hickman,
- Elisabeth Hildt,
- Sune Holm,
- Pedro Kringen,
- Ulrich Kühne,
- Adriano Lucieri,
- Adriano Lucieri,
- Vince I. Madai,
- Vince I. Madai,
- Vince I. Madai,
- Pedro A. Moreno-Sánchez,
- Oriana Medlicott,
- Matiss Ozols,
- Matiss Ozols,
- Eberhard Schnebel,
- Andy Spezzatti,
- Jesmin Jahan Tithi,
- Steven Umbrello,
- Dennis Vetter,
- Holger Volland,
- Magnus Westerlund,
- Renee Wurth
Affiliations
- Roberto V. Zicari
- Frankfurt Big Data Lab, Goethe University Frankfurt, Frankfurt, Germany
- Roberto V. Zicari
- Department of Business Management and Analytics, Arcada University of Applied Sciences, Helsinki, Finland
- Roberto V. Zicari
- Data Science Graduate School, Seoul National University, Seoul, South Korea
- Sheraz Ahmed
- German Research Center for Artificial Intelligence (DFKI), Kaiserslautern, Germany
- Julia Amann
- Health Ethics and Policy Lab, Swiss Federal Institute of Technology (ETH Zurich), Zurich, Switzerland
- Stephan Alexander Braun
- Department of Dermatology, University Clinic Münster, Münster, Germany
- Stephan Alexander Braun
- Department of Dermatology, Medical Faculty, Heinrich-Heine University, Düsseldorf, Germany
- John Brodersen
- Section of General Practice and Research Unit for General Practice, Department of Public Health, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Danemark
- John Brodersen
- Primary Health Care Research Unit, Region Zealand, Denmark
- Frédérick Bruneault
- 0École des médias, Collège André-Laurendeau, Université du Québec à Montréal and Philosophie, Montreal, QC, Canada
- James Brusseau
- 1Philosophy Department, Pace University, New York, NY, United States
- Erik Campano
- 2Department of Informatics, Umeå University, Umeå, Sweden
- Megan Coffee
- 3Department of Medicine and Division of Infectious Diseases and Immunology, NYU Grossman School of Medicine, New York, NY, United States
- Andreas Dengel
- German Research Center for Artificial Intelligence (DFKI), Kaiserslautern, Germany
- Andreas Dengel
- 4Department of Computer Science, TU Kaiserslautern, Kaiserslautern, Germany
- Boris Düdder
- 5Department of Computer Science (DIKU), University of Copenhagen (UCPH), Copenhagen, Denmark
- Alessio Gallucci
- 6Department of Mathematics and Computer Science, Eindhoven University of Technology, Eindhoven, Netherlands
- Thomas Krendl Gilbert
- 7Center for Human-Compatible AI, University of California, Berkeley, CA, United States
- Philippe Gottfrois
- 8Department of Biomedical Engineering, Basel University, Basel, Switzerland
- Emmanuel Goffi
- 9The Global AI Ethics Institute, Paris, France
- Christoffer Bjerre Haase
- 0Section for Health Service Research and Section for General Practice, Department of Public Health, University of Copenhagen, Copenhagen, Denmark
- Christoffer Bjerre Haase
- 1Centre for Research in Assessment and Digital Learning, Deakin University, Melbourne, VIC, Australia
- Thilo Hagendorff
- 2Ethics & Philosophy Lab, University of Tuebingen, Tuebingen, Germany
- Eleanore Hickman
- 3Faculty of Law, University of Cambridge, Cambridge, United Kingdom
- Elisabeth Hildt
- 4Center for the Study of Ethics in the Professions, Illinois Institute of Technology, Chicago, IL, United States
- Sune Holm
- 5Department of Food and Resource Economics, Faculty of Science, University of Copenhagen, Copenhagen, Denmark
- Pedro Kringen
- Frankfurt Big Data Lab, Goethe University Frankfurt, Frankfurt, Germany
- Ulrich Kühne
- 6Hautmedizin Bad Soden, Bad Soden, Germany
- Adriano Lucieri
- German Research Center for Artificial Intelligence (DFKI), Kaiserslautern, Germany
- Adriano Lucieri
- 4Department of Computer Science, TU Kaiserslautern, Kaiserslautern, Germany
- Vince I. Madai
- 7Charité Lab for AI in Medicine, Charité Universitätsmedizin Berlin, Berlin, Germany
- Vince I. Madai
- 8QUEST Center for Transforming Biomedical Research, Berlin Institute of Health (BIH), Charité Universitätsmedizin Berlin, Berlin, Germany
- Vince I. Madai
- 9School of Computing and Digital Technology, Faculty of Computing, Engineering and the Built Environment, Birmingham City University, Birmingham, United Kingdom
- Pedro A. Moreno-Sánchez
- 0School of Healthcare and Social Work Seinäjoki University of Applied Sciences (SeAMK), Seinäjoki, Finland
- Oriana Medlicott
- 1Freelance researcher, writer and consultant in AI Ethics, London, United Kingdom
- Matiss Ozols
- 2Division of Cell Matrix Biology and Regenerative Medicine, The University of Manchester, Manchester, United Kingdom
- Matiss Ozols
- 3Human Genetics, Wellcome Sanger Institute, England, United Kingdom
- Eberhard Schnebel
- Frankfurt Big Data Lab, Goethe University Frankfurt, Frankfurt, Germany
- Andy Spezzatti
- 4Industrial Engineering & Operation Research, UC Berkeley, CA, United States
- Jesmin Jahan Tithi
- 5Intel Labs, Santa Clara, CA, United States
- Steven Umbrello
- 6Institute for Ethics and Emerging Technologies, University of Turin, Turin, Italy
- Dennis Vetter
- Frankfurt Big Data Lab, Goethe University Frankfurt, Frankfurt, Germany
- Holger Volland
- 7Z-Inspection® Initiative, New York, NY, United States
- Magnus Westerlund
- Department of Business Management and Analytics, Arcada University of Applied Sciences, Helsinki, Finland
- Renee Wurth
- 8T. H Chan School of Public Health, Harvard University, Cambridge, MA, United States
- DOI
- https://doi.org/10.3389/fhumd.2021.688152
- Journal volume & issue
-
Vol. 3
Abstract
This paper documents how an ethically aligned co-design methodology ensures trustworthiness in the early design phase of an artificial intelligence (AI) system component for healthcare. The system explains decisions made by deep learning networks analyzing images of skin lesions. The co-design of trustworthy AI developed here used a holistic approach rather than a static ethical checklist and required a multidisciplinary team of experts working with the AI designers and their managers. Ethical, legal, and technical issues potentially arising from the future use of the AI system were investigated. This paper is a first report on co-designing in the early design phase. Our results can also serve as guidance for other early-phase AI-similar tool developments.
Keywords