Assessing Trustworthy AI in Times of COVID-19.: Deep Learning for Predicting a Multiregional Score Conveying the Degree of Lung Compromise in COVID-19 Patients

Himanshi Allahabadi; Julia Amann; Isabelle Balot; Andrea Beretta; Charles Binkley; Jonas Bozenhard; Frederick Bruneault; James Brusseau; Sema Candemir; Luca Alessandro Cappellini; Subrata Chakraborty; Nicoleta Cherciu; Christina Cociancig; Megan Coffee; Irene Ek; Leonardo Espinosa-Leal; Davide Farina; Genevieve Fieux-Castagnet; Thomas Frauenfelder; Alessio Gallucci; Guya Giuliani; Adam Golda; Irmhild van Halem; Elisabeth Hildt; Sune Holm; Georgios Kararigas; Sebastien A Krier; Ulrich Kuhne; Francesca Lizzi; Vince I Madai; Aniek F Markus; Serg Masis; Emilie Wiinblad Mathez; Francesco Mureddu; Emanuele Neri; Walter Osika; Matiss Ozols; Cecilia Panigutti; Brendan Parent; Francesca Pratesi; Pedro A Moreno-Sanchez; Giovanni Sartor; Mattia Savardi; Alberto Signoroni; Hanna-Maria Sormunen; Andy Spezzatti; Adarsh Srivastava; Annette F Stephansen; Lau Bee Theng; Jesmin Jahan Tithi; Jarno Tuominen; Steven Umbrello; Filippo Vaccher; Dennis Vetter; Magnus Westerlund; Renee Wurth; Roberto V Zicari

doi:10.1109/TTS.2022.3195114

Assessing Trustworthy AI in Times of COVID-19. Deep Learning for Predicting a Multiregional Score Conveying the Degree of Lung Compromise in COVID-19 Patients

Himanshi Allahabadi, Julia Amann, Isabelle Balot, Andrea Beretta, Charles Binkley, Jonas Bozenhard, Frederick Bruneault, James Brusseau, Sema Candemir, Luca Alessandro Cappellini, Subrata Chakraborty, Nicoleta Cherciu, Christina Cociancig, Megan Coffee, Irene Ek, Leonardo Espinosa-Leal, Davide Farina, Genevieve Fieux-Castagnet, Thomas Frauenfelder, Alessio GallucciGuya Giuliani, Adam Golda, Irmhild van Halem, Elisabeth Hildt, Sune Holm, Georgios Kararigas, Sebastien A Krier, Ulrich Kuhne, Francesca Lizzi, Vince I Madai, Aniek F Markus, Serg Masis, Emilie Wiinblad Mathez, Francesco Mureddu, Emanuele Neri, Walter Osika, Matiss Ozols, Cecilia Panigutti, Brendan Parent, Francesca Pratesi, Pedro A Moreno-Sanchez, Giovanni Sartor, Mattia Savardi, Alberto Signoroni, Hanna-Maria Sormunen, Andy Spezzatti, Adarsh Srivastava, Annette F Stephansen, Lau Bee Theng, Jesmin Jahan Tithi, Jarno Tuominen, Steven Umbrello, Filippo Vaccher, Dennis Vetter, Magnus Westerlund, Renee Wurth, Roberto V Zicari

Medical Informatics

Research output: Contribution to journal › Article › Academic › peer-review

36 Downloads (Pure)

Abstract

This article's main contributions are twofold: 1) to demonstrate how to apply the general European Union's High-Level Expert Group's (EU HLEG) guidelines for trustworthy AI in practice for the domain of healthcare and 2) to investigate the research question of what does "trustworthy AI" mean at the time of the COVID-19 pandemic. To this end, we present the results of a post-hoc self-assessment to evaluate the trustworthiness of an AI system for predicting a multiregional score conveying the degree of lung compromise in COVID-19 patients, developed and verified by an interdisciplinary team with members from academia, public hospitals, and industry in time of pandemic. The AI system aims to help radiologists to estimate and communicate the severity of damage in a patient's lung from Chest X-rays. It has been experimentally deployed in the radiology department of the ASST Spedali Civili clinic in Brescia, Italy, since December 2020 during pandemic time. The methodology we have applied for our post-hoc assessment, called Z-Inspection®, uses sociotechnical scenarios to identify ethical, technical, and domain-specific issues in the use of the AI system in the context of the pandemic.

Original language	English
Pages (from-to)	272-289
Number of pages	18
Journal	IEEE transactions on technology and society
Volume	3
Issue number	4
DOIs	https://doi.org/10.1109/TTS.2022.3195114
Publication status	Published - Dec 2022

Bibliographical note

ACKNOWLEDGMENT
The authors would like to thank Elia Belussi, Matthias Braun, Helga Brøgger, Andrew Bushell, Marcelo Corrales Compagnucci, Boris Düdder, Mads Kjolby, Maria Forss,
Fosca Giannotti, Thomas Gilbert, David Higgins, Asiatu Agnes Jalloh, Ahmed Khali, Federica Lucivero, Oriana Medlicott, Timo Minssen, Belona Sonna, Leonoor
Tideman, and Karsten Tolle who actively participated in Zoom meetings and/or offered valuable comments. Brendan Parent is the principal investigator on a Robert Wood Johnson
Foundation grant to study the ethics of big data for AI applications in health care.

Access to Document

10.1109/TTS.2022.3195114Licence: CC BY-NC-ND

tts_zicari_3195114Final published version, 877 KBLicence: CC BY-NC-ND

Cite this

Allahabadi, H., Amann, J., Balot, I., Beretta, A., Binkley, C., Bozenhard, J., Bruneault, F., Brusseau, J., Candemir, S., Cappellini, L. A., Chakraborty, S., Cherciu, N., Cociancig, C., Coffee, M., Ek, I., Espinosa-Leal, L., Farina, D., Fieux-Castagnet, G., Frauenfelder, T., ... Zicari, R. V. (2022). Assessing Trustworthy AI in Times of COVID-19. Deep Learning for Predicting a Multiregional Score Conveying the Degree of Lung Compromise in COVID-19 Patients. IEEE transactions on technology and society, 3(4), 272-289. https://doi.org/10.1109/TTS.2022.3195114

@article{83c69f4da89c45d0a848d82ddccf18f2,

title = "Assessing Trustworthy AI in Times of COVID-19.: Deep Learning for Predicting a Multiregional Score Conveying the Degree of Lung Compromise in COVID-19 Patients",

abstract = "This article's main contributions are twofold: 1) to demonstrate how to apply the general European Union's High-Level Expert Group's (EU HLEG) guidelines for trustworthy AI in practice for the domain of healthcare and 2) to investigate the research question of what does {"}trustworthy AI{"} mean at the time of the COVID-19 pandemic. To this end, we present the results of a post-hoc self-assessment to evaluate the trustworthiness of an AI system for predicting a multiregional score conveying the degree of lung compromise in COVID-19 patients, developed and verified by an interdisciplinary team with members from academia, public hospitals, and industry in time of pandemic. The AI system aims to help radiologists to estimate and communicate the severity of damage in a patient's lung from Chest X-rays. It has been experimentally deployed in the radiology department of the ASST Spedali Civili clinic in Brescia, Italy, since December 2020 during pandemic time. The methodology we have applied for our post-hoc assessment, called Z-Inspection{\textregistered}, uses sociotechnical scenarios to identify ethical, technical, and domain-specific issues in the use of the AI system in the context of the pandemic.",

author = "Himanshi Allahabadi and Julia Amann and Isabelle Balot and Andrea Beretta and Charles Binkley and Jonas Bozenhard and Frederick Bruneault and James Brusseau and Sema Candemir and Cappellini, {Luca Alessandro} and Subrata Chakraborty and Nicoleta Cherciu and Christina Cociancig and Megan Coffee and Irene Ek and Leonardo Espinosa-Leal and Davide Farina and Genevieve Fieux-Castagnet and Thomas Frauenfelder and Alessio Gallucci and Guya Giuliani and Adam Golda and {van Halem}, Irmhild and Elisabeth Hildt and Sune Holm and Georgios Kararigas and Krier, {Sebastien A} and Ulrich Kuhne and Francesca Lizzi and Madai, {Vince I} and Markus, {Aniek F} and Serg Masis and Mathez, {Emilie Wiinblad} and Francesco Mureddu and Emanuele Neri and Walter Osika and Matiss Ozols and Cecilia Panigutti and Brendan Parent and Francesca Pratesi and Moreno-Sanchez, {Pedro A} and Giovanni Sartor and Mattia Savardi and Alberto Signoroni and Hanna-Maria Sormunen and Andy Spezzatti and Adarsh Srivastava and Stephansen, {Annette F} and Theng, {Lau Bee} and Tithi, {Jesmin Jahan} and Jarno Tuominen and Steven Umbrello and Filippo Vaccher and Dennis Vetter and Magnus Westerlund and Renee Wurth and Zicari, {Roberto V}",

note = "ACKNOWLEDGMENT The authors would like to thank Elia Belussi, Matthias Braun, Helga Br{\o}gger, Andrew Bushell, Marcelo Corrales Compagnucci, Boris D{\"u}dder, Mads Kjolby, Maria Forss, Fosca Giannotti, Thomas Gilbert, David Higgins, Asiatu Agnes Jalloh, Ahmed Khali, Federica Lucivero, Oriana Medlicott, Timo Minssen, Belona Sonna, Leonoor Tideman, and Karsten Tolle who actively participated in Zoom meetings and/or offered valuable comments. Brendan Parent is the principal investigator on a Robert Wood Johnson Foundation grant to study the ethics of big data for AI applications in health care.",

year = "2022",

month = dec,

doi = "10.1109/TTS.2022.3195114",

language = "English",

volume = "3",

pages = "272--289",

number = "4",

}

Allahabadi, H, Amann, J, Balot, I, Beretta, A, Binkley, C, Bozenhard, J, Bruneault, F, Brusseau, J, Candemir, S, Cappellini, LA, Chakraborty, S, Cherciu, N, Cociancig, C, Coffee, M, Ek, I, Espinosa-Leal, L, Farina, D, Fieux-Castagnet, G, Frauenfelder, T, Gallucci, A, Giuliani, G, Golda, A, van Halem, I, Hildt, E, Holm, S, Kararigas, G, Krier, SA, Kuhne, U, Lizzi, F, Madai, VI, Markus, AF, Masis, S, Mathez, EW, Mureddu, F, Neri, E, Osika, W, Ozols, M, Panigutti, C, Parent, B, Pratesi, F, Moreno-Sanchez, PA, Sartor, G, Savardi, M, Signoroni, A, Sormunen, H-M, Spezzatti, A, Srivastava, A, Stephansen, AF, Theng, LB, Tithi, JJ, Tuominen, J, Umbrello, S, Vaccher, F, Vetter, D, Westerlund, M, Wurth, R & Zicari, RV 2022, 'Assessing Trustworthy AI in Times of COVID-19. Deep Learning for Predicting a Multiregional Score Conveying the Degree of Lung Compromise in COVID-19 Patients', IEEE transactions on technology and society, vol. 3, no. 4, pp. 272-289. https://doi.org/10.1109/TTS.2022.3195114

Assessing Trustworthy AI in Times of COVID-19. Deep Learning for Predicting a Multiregional Score Conveying the Degree of Lung Compromise in COVID-19 Patients. / Allahabadi, Himanshi; Amann, Julia; Balot, Isabelle et al.
In: IEEE transactions on technology and society, Vol. 3, No. 4, 12.2022, p. 272-289.

Research output: Contribution to journal › Article › Academic › peer-review

TY - JOUR

T1 - Assessing Trustworthy AI in Times of COVID-19.

T2 - Deep Learning for Predicting a Multiregional Score Conveying the Degree of Lung Compromise in COVID-19 Patients

AU - Allahabadi, Himanshi

AU - Amann, Julia

AU - Balot, Isabelle

AU - Beretta, Andrea

AU - Binkley, Charles

AU - Bozenhard, Jonas

AU - Bruneault, Frederick

AU - Brusseau, James

AU - Candemir, Sema

AU - Cappellini, Luca Alessandro

AU - Chakraborty, Subrata

AU - Cherciu, Nicoleta

AU - Cociancig, Christina

AU - Coffee, Megan

AU - Ek, Irene

AU - Espinosa-Leal, Leonardo

AU - Farina, Davide

AU - Fieux-Castagnet, Genevieve

AU - Frauenfelder, Thomas

AU - Gallucci, Alessio

AU - Giuliani, Guya

AU - Golda, Adam

AU - van Halem, Irmhild

AU - Hildt, Elisabeth

AU - Holm, Sune

AU - Kararigas, Georgios

AU - Krier, Sebastien A

AU - Kuhne, Ulrich

AU - Lizzi, Francesca

AU - Madai, Vince I

AU - Markus, Aniek F

AU - Masis, Serg

AU - Mathez, Emilie Wiinblad

AU - Mureddu, Francesco

AU - Neri, Emanuele

AU - Osika, Walter

AU - Ozols, Matiss

AU - Panigutti, Cecilia

AU - Parent, Brendan

AU - Pratesi, Francesca

AU - Moreno-Sanchez, Pedro A

AU - Sartor, Giovanni

AU - Savardi, Mattia

AU - Signoroni, Alberto

AU - Sormunen, Hanna-Maria

AU - Spezzatti, Andy

AU - Srivastava, Adarsh

AU - Stephansen, Annette F

AU - Theng, Lau Bee

AU - Tithi, Jesmin Jahan

AU - Tuominen, Jarno

AU - Umbrello, Steven

AU - Vaccher, Filippo

AU - Vetter, Dennis

AU - Westerlund, Magnus

AU - Wurth, Renee

AU - Zicari, Roberto V

N1 - ACKNOWLEDGMENT The authors would like to thank Elia Belussi, Matthias Braun, Helga Brøgger, Andrew Bushell, Marcelo Corrales Compagnucci, Boris Düdder, Mads Kjolby, Maria Forss, Fosca Giannotti, Thomas Gilbert, David Higgins, Asiatu Agnes Jalloh, Ahmed Khali, Federica Lucivero, Oriana Medlicott, Timo Minssen, Belona Sonna, Leonoor Tideman, and Karsten Tolle who actively participated in Zoom meetings and/or offered valuable comments. Brendan Parent is the principal investigator on a Robert Wood Johnson Foundation grant to study the ethics of big data for AI applications in health care.

PY - 2022/12

Y1 - 2022/12

N2 - This article's main contributions are twofold: 1) to demonstrate how to apply the general European Union's High-Level Expert Group's (EU HLEG) guidelines for trustworthy AI in practice for the domain of healthcare and 2) to investigate the research question of what does "trustworthy AI" mean at the time of the COVID-19 pandemic. To this end, we present the results of a post-hoc self-assessment to evaluate the trustworthiness of an AI system for predicting a multiregional score conveying the degree of lung compromise in COVID-19 patients, developed and verified by an interdisciplinary team with members from academia, public hospitals, and industry in time of pandemic. The AI system aims to help radiologists to estimate and communicate the severity of damage in a patient's lung from Chest X-rays. It has been experimentally deployed in the radiology department of the ASST Spedali Civili clinic in Brescia, Italy, since December 2020 during pandemic time. The methodology we have applied for our post-hoc assessment, called Z-Inspection®, uses sociotechnical scenarios to identify ethical, technical, and domain-specific issues in the use of the AI system in the context of the pandemic.

AB - This article's main contributions are twofold: 1) to demonstrate how to apply the general European Union's High-Level Expert Group's (EU HLEG) guidelines for trustworthy AI in practice for the domain of healthcare and 2) to investigate the research question of what does "trustworthy AI" mean at the time of the COVID-19 pandemic. To this end, we present the results of a post-hoc self-assessment to evaluate the trustworthiness of an AI system for predicting a multiregional score conveying the degree of lung compromise in COVID-19 patients, developed and verified by an interdisciplinary team with members from academia, public hospitals, and industry in time of pandemic. The AI system aims to help radiologists to estimate and communicate the severity of damage in a patient's lung from Chest X-rays. It has been experimentally deployed in the radiology department of the ASST Spedali Civili clinic in Brescia, Italy, since December 2020 during pandemic time. The methodology we have applied for our post-hoc assessment, called Z-Inspection®, uses sociotechnical scenarios to identify ethical, technical, and domain-specific issues in the use of the AI system in the context of the pandemic.

U2 - 10.1109/TTS.2022.3195114

DO - 10.1109/TTS.2022.3195114

M3 - Article

C2 - 36573115

SN - 2637-6415

VL - 3

SP - 272

EP - 289

JO - IEEE transactions on technology and society

JF - IEEE transactions on technology and society

IS - 4

ER -

Assessing Trustworthy AI in Times of COVID-19. Deep Learning for Predicting a Multiregional Score Conveying the Degree of Lung Compromise in COVID-19 Patients

Abstract

Bibliographical note

Access to Document

Fingerprint

Cite this