Cancers (Feb 2023)
ONEST (Observers Needed to Evaluate Subjective Tests) Analysis of Stromal Tumour-Infiltrating Lymphocytes (sTILs) in Breast Cancer and Its Limitations
- Bálint Cserni,
- Darren Kilmartin,
- Mark O’Loughlin,
- Xavier Andreu,
- Zsuzsanna Bagó-Horváth,
- Simonetta Bianchi,
- Ewa Chmielik,
- Paulo Figueiredo,
- Giuseppe Floris,
- Maria Pia Foschini,
- Anikó Kovács,
- Päivi Heikkilä,
- Janina Kulka,
- Anne-Vibeke Laenkholm,
- Inta Liepniece-Karele,
- Caterina Marchiò,
- Elena Provenzano,
- Peter Regitnig,
- Angelika Reiner,
- Aleš Ryška,
- Anna Sapino,
- Elisabeth Specht Stovgaard,
- Cecily Quinn,
- Vasiliki Zolota,
- Mark Webber,
- Sharon A. Glynn,
- Rita Bori,
- Erika Csörgő,
- Orsolya Oláh-Németh,
- Tamás Pancsa,
- Anita Sejben,
- István Sejben,
- András Vörös,
- Tamás Zombori,
- Tibor Nyári,
- Grace Callagy,
- Gábor Cserni
Affiliations
- Bálint Cserni
- TNG Technology Consulting GmbH, Király u. 26., 1061 Budapest, Hungary
- Darren Kilmartin
- Discipline of Pathology, Lambe Institute for Translational Research, School of Medicine, University of Galway, H91 TK33 Galway, Ireland
- Mark O’Loughlin
- Discipline of Pathology, Lambe Institute for Translational Research, School of Medicine, University of Galway, H91 TK33 Galway, Ireland
- Xavier Andreu
- Pathology Department, Atryshealth Co., Ltd., 08039 Barcelona, Spain
- Zsuzsanna Bagó-Horváth
- Department of Pathology, Medical University of Vienna, Währinger Gürtel 18-20, 1090 Vienna, Austria
- Simonetta Bianchi
- Division of Pathological Anatomy, Department of Health Sciences, University of Florence, 50134 Florence, Italy
- Ewa Chmielik
- Tumor Pathology Department, Maria Sklodowska-Curie National Research Institute of Oncology, Gliwice Branch, 44-102 Gliwice, Poland
- Paulo Figueiredo
- Laboratório de Anatomia Patológica, IPO Coimbra, 3000-075 Coimbra, Portugal
- Giuseppe Floris
- Laboratory of Translational Cell & Tissue Research and KU Leuven, Department of Imaging and Pathology, Department of Pathology, University Hospitals Leuven, University of Leuven, Oude Market 13, 3000 Leuven, Belgium
- Maria Pia Foschini
- Unit of Anatomic Pathology, Department of Biomedical and Neuromotor Sciences, University of Bologna, Bellaria Hospital, 40139 Bologna, Italy
- Anikó Kovács
- Department of Clinical Pathology, Sahlgrenska University Hospital, 41345 Gothenburg, Sweden
- Päivi Heikkilä
- Department of Pathology, Helsinki University Central Hospital, 00029 Helsinki, Finland
- Janina Kulka
- Department of Pathology, Forensic and Insurance Medicine, Semmelweis University Budapest, Üllői út 93, 1091 Budapest, Hungary
- Anne-Vibeke Laenkholm
- Department of Surgical Pathology, Zealand University Hospital, 4000 Roskilde, Denmark
- Inta Liepniece-Karele
- Department of Pathology, Riga Stradins University, Riga East Clinical University Hospital, LV-1038 Riga, Latvia
- Caterina Marchiò
- Unit of Pathology, Candiolo Cancer Institute FPO-IRCCS, 10060 Candiolo, Italy
- Elena Provenzano
- Department of Histopathology, Cambridge University Hospitals National Health Service (NHS) Foundation Trust, Cambridge CB2 0QQ, UK
- Peter Regitnig
- Diagnostic and Research Institute of Pathology, Medical University of Graz, 8010 Graz, Austria
- Angelika Reiner
- Department of Pathology, Klinikum Donaustadt, 1090 Vienna, Austria
- Aleš Ryška
- The Fingerland Department of Pathology, Charles University Medical Faculty and University Hospital, 50003 Hradec Kralove, Czech Republic
- Anna Sapino
- Unit of Pathology, Candiolo Cancer Institute FPO-IRCCS, 10060 Candiolo, Italy
- Elisabeth Specht Stovgaard
- Pathology Department, Herlev University Hospital, DK-2730 Herlev, Denmark
- Cecily Quinn
- Department of Histopathology, Irish National Breast Screening Programme, BreastCheck, St. Vincent’s University Hospital and School of Medicine, University College Dublin, D04 T6F4 Dublin, Ireland
- Vasiliki Zolota
- Department of Pathology, School of Medicine, University of Patras, 26504 Rion, Greece
- Mark Webber
- Discipline of Pathology, Lambe Institute for Translational Research, School of Medicine, University of Galway, H91 TK33 Galway, Ireland
- Sharon A. Glynn
- Discipline of Pathology, Lambe Institute for Translational Research, School of Medicine, University of Galway, H91 TK33 Galway, Ireland
- Rita Bori
- Department of Pathology, Bács-Kiskun County Teaching Hospital, 6000 Kecskemét, Hungary
- Erika Csörgő
- Department of Pathology, Bács-Kiskun County Teaching Hospital, 6000 Kecskemét, Hungary
- Orsolya Oláh-Németh
- Department of Pathology, University of Szeged, 6720 Szeged, Hungary
- Tamás Pancsa
- Department of Pathology, University of Szeged, 6720 Szeged, Hungary
- Anita Sejben
- Department of Pathology, University of Szeged, 6720 Szeged, Hungary
- István Sejben
- Department of Pathology, Bács-Kiskun County Teaching Hospital, 6000 Kecskemét, Hungary
- András Vörös
- Department of Pathology, University of Szeged, 6720 Szeged, Hungary
- Tamás Zombori
- Department of Pathology, University of Szeged, 6720 Szeged, Hungary
- Tibor Nyári
- Department of Medical Physics and Informatics, University of Szeged, 6720 Szeged, Hungary
- Grace Callagy
- Discipline of Pathology, Lambe Institute for Translational Research, School of Medicine, University of Galway, H91 TK33 Galway, Ireland
- Gábor Cserni
- Department of Pathology, Bács-Kiskun County Teaching Hospital, 6000 Kecskemét, Hungary
- DOI
- https://doi.org/10.3390/cancers15041199
- Journal volume & issue
-
Vol. 15,
no. 4
p. 1199
Abstract
Tumour-infiltrating lymphocytes (TILs) reflect antitumour immunity. Their evaluation of histopathology specimens is influenced by several factors and is subject to issues of reproducibility. ONEST (Observers Needed to Evaluate Subjective Tests) helps in determining the number of observers that would be sufficient for the reliable estimation of inter-observer agreement of TIL categorisation. This has not been explored previously in relation to TILs. ONEST analyses, using an open-source software developed by the first author, were performed on TIL quantification in breast cancers taken from two previous studies. These were one reproducibility study involving 49 breast cancers, 23 in the first circulation and 14 pathologists in the second circulation, and one study involving 100 cases and 9 pathologists. In addition to the estimates of the number of observers required, other factors influencing the results of ONEST were examined. The analyses reveal that between six and nine observers (range 2–11) are most commonly needed to give a robust estimate of reproducibility. In addition, the number and experience of observers, the distribution of values around or away from the extremes, and outliers in the classification also influence the results. Due to the simplicity and the potentially relevant information it may give, we propose ONEST to be a part of new reproducibility analyses.
Keywords
- ONEST
- observers needed to evaluate subjective tests
- TILs
- sTILs
- tumour-infiltrating lymphocytes
- triple-negative
