Deep learning helps discriminate between autoimmune hepatitis and primary biliary cholangitis
Alessio Gerussi,
Oliver Lester Saldanha,
Giorgio Cazzaniga,
Damiano Verda,
Zunamys I. Carrero,
Bastian Engel,
Richard Taubert,
Francesca Bolis,
Laura Cristoferi,
Federica Malinverno,
Francesca Colapietro,
Reha Akpinar,
Luca Di Tommaso,
Luigi Terracciano,
Ana Lleo,
Mauro Viganó,
Cristina Rigamonti,
Daniela Cabibi,
Vincenza Calvaruso,
Fabio Gibilisco,
Nicoló Caldonazzi,
Alessandro Valentino,
Stefano Ceola,
Valentina Canini,
Eugenia Nofit,
Marco Muselli,
Julien Calderaro,
Dina Tiniakos,
Vincenzo L’Imperio,
Fabio Pagni,
Nicola Zucchini,
Pietro Invernizzi,
Marco Carbone,
Jakob Nikolas Kather
Affiliations
Alessio Gerussi
Division of Gastroenterology, Center for Autoimmune Liver Diseases, European Reference Network on Hepatological Diseases (ERN RARE-LIVER), Fondazione IRCCS San Gerardo dei Tintori, Monza, Italy; Department of Medicine and Surgery, University of Milano-Bicocca, Monza, Italy
Oliver Lester Saldanha
Else Kroener Fresenius Center for Digital Health, Medical Faculty Carl Gustav Carus, Technical University Dresden, Dresden, Germany; Department of Diagnostic and Interventional Radiology, University Hospital RWTH Aachen, Aachen, Germany
Giorgio Cazzaniga
Department of Medicine and Surgery, Pathology, Fondazione IRCCS San Gerardo dei Tintori, Università di Milano-Bicocca, Monza, Italy
Damiano Verda
Rulex Innovation Labs, Rulex Inc., Genoa, Italy
Zunamys I. Carrero
Else Kroener Fresenius Center for Digital Health, Medical Faculty Carl Gustav Carus, Technical University Dresden, Dresden, Germany
Bastian Engel
Department of Gastroenterology, Hepatology, Infectious Diseases and Endocrinology, Hannover Medical School, Hannover, Germany; European Reference Network on Hepatological Diseases (ERN RARE-LIVER), Hamburg, Germany
Richard Taubert
Department of Gastroenterology, Hepatology, Infectious Diseases and Endocrinology, Hannover Medical School, Hannover, Germany; European Reference Network on Hepatological Diseases (ERN RARE-LIVER), Hamburg, Germany
Francesca Bolis
Division of Gastroenterology, Center for Autoimmune Liver Diseases, European Reference Network on Hepatological Diseases (ERN RARE-LIVER), Fondazione IRCCS San Gerardo dei Tintori, Monza, Italy; Department of Medicine and Surgery, University of Milano-Bicocca, Monza, Italy
Laura Cristoferi
Division of Gastroenterology, Center for Autoimmune Liver Diseases, European Reference Network on Hepatological Diseases (ERN RARE-LIVER), Fondazione IRCCS San Gerardo dei Tintori, Monza, Italy; Department of Medicine and Surgery, University of Milano-Bicocca, Monza, Italy
Federica Malinverno
Division of Gastroenterology, Center for Autoimmune Liver Diseases, European Reference Network on Hepatological Diseases (ERN RARE-LIVER), Fondazione IRCCS San Gerardo dei Tintori, Monza, Italy; Department of Medicine and Surgery, University of Milano-Bicocca, Monza, Italy
Francesca Colapietro
Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Milan, Italy; Division of Internal Medicine and Hepatology, Department of Gastroenterology, IRCCS Humanitas Research Hospital, Rozzano, Milan, Italy
Reha Akpinar
Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Milan, Italy; Department of Pathology, IRCSS Humanitas Research Hospital, Rozzano-Milan, Italy
Luca Di Tommaso
Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Milan, Italy; Department of Pathology, IRCSS Humanitas Research Hospital, Rozzano-Milan, Italy
Luigi Terracciano
Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Milan, Italy; Department of Pathology, IRCSS Humanitas Research Hospital, Rozzano-Milan, Italy
Ana Lleo
Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Milan, Italy; Division of Internal Medicine and Hepatology, Department of Gastroenterology, IRCCS Humanitas Research Hospital, Rozzano, Milan, Italy
Mauro Viganó
Gastroenterology Hepatology and Transplantation Unit, ASST Papa Giovanni XXIII, Bergamo, Italy
Cristina Rigamonti
Department of Translational Medicine, Università del Piemonte Orientale, Division of Internal Medicine, AOU Maggiore della Carità, Novara, Italy
Daniela Cabibi
Pathology Institute, PROMISE, University of Palermo, Palermo, Italy
Vincenza Calvaruso
Gastrointestinal and Liver Unit, Department of Health Promotion Sciences, Maternal and Infantile Care, Internal Medicine and Medical Specialties, University of Palermo, Palermo, Italy
Fabio Gibilisco
Department of Pathology, Hospital “Gravina e Santo Pietro”, Caltagirone, Italy; Department of Medical and Surgical Sciences and Advanced Technologies, “G. F. Ingrassia”, University of Catania, Catania, Italy
Nicoló Caldonazzi
Department of Diagnostics and Public Health, Section of Pathology, University of Verona, Verona, Italy
Alessandro Valentino
Pathological Unit, Niguarda Hospital, Milan, Italy
Stefano Ceola
Department of Medicine and Surgery, Pathology, Fondazione IRCCS San Gerardo dei Tintori, Università di Milano-Bicocca, Monza, Italy
Valentina Canini
Department of Medicine and Surgery, Pathology, Fondazione IRCCS San Gerardo dei Tintori, Università di Milano-Bicocca, Monza, Italy
Eugenia Nofit
Division of Gastroenterology, Center for Autoimmune Liver Diseases, European Reference Network on Hepatological Diseases (ERN RARE-LIVER), Fondazione IRCCS San Gerardo dei Tintori, Monza, Italy; Department of Medicine and Surgery, University of Milano-Bicocca, Monza, Italy
Marco Muselli
Rulex Innovation Labs, Rulex Inc., Genoa, Italy
Julien Calderaro
Université Paris Est Créteil, INSERM, IMRB, Créteil, France; Assistance Publique-Hôpitaux de Paris, Henri Mondor-Albert Chenevier University Hospital, Department of Pathology, Créteil, France; Inserm, U955, Team 18, Créteil, France
Dina Tiniakos
Department of Pathology, Aretaieion Hospital, Medical School, National and Kapodistrian University of Athens, Athens, Greece; Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
Vincenzo L’Imperio
Department of Medicine and Surgery, Pathology, Fondazione IRCCS San Gerardo dei Tintori, Università di Milano-Bicocca, Monza, Italy
Fabio Pagni
Department of Medicine and Surgery, Pathology, Fondazione IRCCS San Gerardo dei Tintori, Università di Milano-Bicocca, Monza, Italy
Nicola Zucchini
Department of Medicine and Surgery, Pathology, Fondazione IRCCS San Gerardo dei Tintori, Università di Milano-Bicocca, Monza, Italy
Pietro Invernizzi
Division of Gastroenterology, Center for Autoimmune Liver Diseases, European Reference Network on Hepatological Diseases (ERN RARE-LIVER), Fondazione IRCCS San Gerardo dei Tintori, Monza, Italy; Department of Medicine and Surgery, University of Milano-Bicocca, Monza, Italy; Corresponding authors. Addresses: Division of Gastroenterology and Center for Autoimmune Liver Diseases, Department of Medicine and Surgery, University of Milano - Bicocca, Via Cadore 48, 20900 Monza (MB), Italy. Tel.: +39-039-233-2187 (P. Invernizzi); Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany (J.N. Kather).
Marco Carbone
Department of Medicine and Surgery, University of Milano-Bicocca, Monza, Italy; Liver Unit, ASST Grande Ospedale Metropolitano Niguarda, Milan, Italy
Jakob Nikolas Kather
Else Kroener Fresenius Center for Digital Health, Medical Faculty Carl Gustav Carus, Technical University Dresden, Dresden, Germany; Medical Oncology, National Center for Tumor Diseases (NCT), University Hospital Heidelberg, Heidelberg, Germany; Department of Medicine 1, University Hospital and Faculty of Medicine Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany; Corresponding authors. Addresses: Division of Gastroenterology and Center for Autoimmune Liver Diseases, Department of Medicine and Surgery, University of Milano - Bicocca, Via Cadore 48, 20900 Monza (MB), Italy. Tel.: +39-039-233-2187 (P. Invernizzi); Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany (J.N. Kather).
Background & Aims: Biliary abnormalities in autoimmune hepatitis (AIH) and interface hepatitis in primary biliary cholangitis (PBC) occur frequently, and misinterpretation may lead to therapeutic mistakes with a negative impact on patients. This study investigates the use of a deep learning (DL)-based pipeline for the diagnosis of AIH and PBC to aid differential diagnosis. Methods: We conducted a multicenter study across six European referral centers, and built a library of digitized liver biopsy slides dating from 1997 to 2023. A training set of 354 cases (266 AIH and 102 PBC) and an external validation set of 92 cases (62 AIH and 30 PBC) were available for analysis. A novel DL model, the autoimmune liver neural estimator (ALNE), was trained on whole-slide images (WSIs) with H&E staining, without human annotations. The ALNE model was evaluated against clinico-pathological diagnoses and tested for interobserver variability among general pathologists. Results: The ALNE model demonstrated high accuracy in differentiating AIH from PBC, achieving an area under the receiver operating characteristic curve of 0.81 in external validation. Attention heatmaps showed that ALNE tends to focus more on areas with increased inflammation, associating such patterns predominantly with AIH. A multivariate explainable ML model revealed that PBC cases misclassified as AIH more often had ALP values between 1 × upper limit of normal (ULN) and 2 × ULN, coupled with AST values above 1 × ULN. Inconsistency among general pathologists was noticed when evaluating a random sample of the same cases (Fleiss’s kappa value 0.09). Conclusions: The ALNE model is the first system generating a quantitative and accurate differential diagnosis between cases with AIH or PBC. Impact and implications: This study demonstrates the significant potential of the autoimmune liver neural estimator model, a transformer-based deep learning system, in accurately distinguishing between autoimmune hepatitis and primary biliary cholangitis using digitized liver biopsy slides without human annotation. The scientific justification for this work lies in addressing the challenge of differentiating these conditions, which often present with overlapping features and can lead to therapeutic mistakes. In addition, there is need for quantitative assessment of information embedded in liver biopsies, which are currently evaluated on qualitative or semi-quantitative methods. The results of this study are crucial for pathologists, researchers, and clinicians, providing a reliable diagnostic tool that reduces interobserver variability and improves diagnostic accuracy of these conditions. Potential methodological limitations, such as the diversity in scanning techniques and slide colorations, were considered, ensuring the robustness and generalizability of the findings.