TY - JOUR
T1 - Assessing the impact of deep-learning assistance on the histopathological diagnosis of serous tubal intraepithelial carcinoma (STIC) in fallopian tubes
AU - Bogaerts, Joep M.A.
AU - Steenbeek, Miranda P.
AU - Bokhorst, John Melle
AU - AI-STIC Study Group
AU - van Bommel, Majke H.D.
AU - Abete, Luca
AU - Addante, Francesca
AU - Brinkhuis, Mariel
AU - Chrzan, Alicja
AU - Cordier, Fleur
AU - Devouassoux-Shisheboran, Mojgan
AU - Fernández-Pérez, Juan
AU - Fischer, Anna
AU - Gilks, C. Blake
AU - Guerriero, Angela
AU - Jaconi, Marta
AU - Kleijn, Tony G.
AU - Kooreman, Loes
AU - Martin, Spencer
AU - Milla, Jakob
AU - Narducci, Nadine
AU - Ntala, Chara
AU - Parkash, Vinita
AU - de Pauw, Christophe
AU - Rabban, Joseph T.
AU - Rijstenberg, Lucia
AU - Rottscholl, Robert
AU - Staebler, Annette
AU - Van de Vijver, Koen
AU - Zannoni, Gian Franco
AU - van Zanten, Monica
AU - de Hullu, Joanne A.
AU - Simons, Michiel
AU - van der Laak, Jeroen A.W.M.
AU - Bart, Joost
AU - Bentz, Jessica L.
AU - Bosse, Tjalling
AU - Bulten, Johan
AU - Desouki, Mohamed Mokhtar
AU - Lastra, Ricardo R.
AU - Numan, Tricia A.
AU - Schoolmeester, J. Kenneth
AU - Schwartz, Lauren E.
AU - Shih, Ie Ming
AU - Soong, T. Rinda
AU - Turashvili, Gulisa
AU - Vang, Russell
AU - Volchek, Mila
AU - Aliredjo, Riena P.
AU - Kusters-Vandevelde, Heidi
N1 - Publisher Copyright:
© 2024 The Author(s). The Journal of Pathology: Clinical Research published by The Pathological Society of Great Britain and Ireland and John Wiley & Sons Ltd.
PY - 2024/11
Y1 - 2024/11
N2 - In recent years, it has become clear that artificial intelligence (AI) models can achieve high accuracy in specific pathology-related tasks. An example is our deep-learning model, designed to automatically detect serous tubal intraepithelial carcinoma (STIC), the precursor lesion to high-grade serous ovarian carcinoma, found in the fallopian tube. However, the standalone performance of a model is insufficient to determine its value in the diagnostic setting. To evaluate the impact of the use of this model on pathologists' performance, we set up a fully crossed multireader, multicase study, in which 26 participants, from 11 countries, reviewed 100 digitalized H&E-stained slides of fallopian tubes (30 cases/70 controls) with and without AI assistance, with a washout period between the sessions. We evaluated the effect of the deep-learning model on accuracy, slide review time and (subjectively perceived) diagnostic certainty, using mixed-models analysis. With AI assistance, we found a significant increase in accuracy (p < 0.01) whereby the average sensitivity increased from 82% to 93%. Further, there was a significant 44 s (32%) reduction in slide review time (p < 0.01). The level of certainty that the participants felt versus their own assessment also significantly increased, by 0.24 on a 10-point scale (p < 0.01). In conclusion, we found that, in a diverse group of pathologists and pathology residents, AI support resulted in a significant improvement in the accuracy of STIC diagnosis and was coupled with a substantial reduction in slide review time. This model has the potential to provide meaningful support to pathologists in the diagnosis of STIC, ultimately streamlining and optimizing the overall diagnostic process.
AB - In recent years, it has become clear that artificial intelligence (AI) models can achieve high accuracy in specific pathology-related tasks. An example is our deep-learning model, designed to automatically detect serous tubal intraepithelial carcinoma (STIC), the precursor lesion to high-grade serous ovarian carcinoma, found in the fallopian tube. However, the standalone performance of a model is insufficient to determine its value in the diagnostic setting. To evaluate the impact of the use of this model on pathologists' performance, we set up a fully crossed multireader, multicase study, in which 26 participants, from 11 countries, reviewed 100 digitalized H&E-stained slides of fallopian tubes (30 cases/70 controls) with and without AI assistance, with a washout period between the sessions. We evaluated the effect of the deep-learning model on accuracy, slide review time and (subjectively perceived) diagnostic certainty, using mixed-models analysis. With AI assistance, we found a significant increase in accuracy (p < 0.01) whereby the average sensitivity increased from 82% to 93%. Further, there was a significant 44 s (32%) reduction in slide review time (p < 0.01). The level of certainty that the participants felt versus their own assessment also significantly increased, by 0.24 on a 10-point scale (p < 0.01). In conclusion, we found that, in a diverse group of pathologists and pathology residents, AI support resulted in a significant improvement in the accuracy of STIC diagnosis and was coupled with a substantial reduction in slide review time. This model has the potential to provide meaningful support to pathologists in the diagnosis of STIC, ultimately streamlining and optimizing the overall diagnostic process.
UR - http://www.scopus.com/inward/record.url?scp=85207019243&partnerID=8YFLogxK
U2 - 10.1002/2056-4538.70006
DO - 10.1002/2056-4538.70006
M3 - Article
C2 - 39439213
AN - SCOPUS:85207019243
SN - 2056-4538
VL - 10
JO - Journal of Pathology: Clinical Research
JF - Journal of Pathology: Clinical Research
IS - 6
M1 - e70006
ER -