npj Precision Oncology (Mar 2023)

Self-supervised attention-based deep learning for pan-cancer mutation prediction from histopathology

  • Oliver Lester Saldanha,
  • Chiara M. L. Loeffler,
  • Jan Moritz Niehues,
  • Marko van Treeck,
  • Tobias P. Seraphin,
  • Katherine Jane Hewitt,
  • Didem Cifci,
  • Gregory Patrick Veldhuizen,
  • Siddhi Ramesh,
  • Alexander T. Pearson,
  • Jakob Nikolas Kather

DOI
https://doi.org/10.1038/s41698-023-00365-0
Journal volume & issue
Vol. 7, no. 1
pp. 1 – 5

Abstract

Read online

Abstract The histopathological phenotype of tumors reflects the underlying genetic makeup. Deep learning can predict genetic alterations from pathology slides, but it is unclear how well these predictions generalize to external datasets. We performed a systematic study on Deep-Learning-based prediction of genetic alterations from histology, using two large datasets of multiple tumor types. We show that an analysis pipeline that integrates self-supervised feature extraction and attention-based multiple instance learning achieves a robust predictability and generalizability.