Advanced Science (Sep 2023)

Deep‐MSIM: Fast Image Reconstruction with Deep Learning in Multifocal Structured Illumination Microscopy

  • Jianhui Liao,
  • Chenshuang Zhang,
  • Xiangcong Xu,
  • Liangliang Zhou,
  • Bin Yu,
  • Danying Lin,
  • Jia Li,
  • Junle Qu

DOI
https://doi.org/10.1002/advs.202300947
Journal volume & issue
Vol. 10, no. 27
pp. n/a – n/a

Abstract

Read online

Abstract Fast and precise reconstruction algorithm is desired for for multifocal structured illumination microscopy (MSIM) to obtain the super‐resolution image. This work proposes a deep convolutional neural network (CNN) to learn a direct mapping from raw MSIM images to super‐resolution image, which takes advantage of the computational advances of deep learning to accelerate the reconstruction. The method is validated on diverse biological structures and in vivo imaging of zebrafish at a depth of 100 µm. The results show that high‐quality, super‐resolution images can be reconstructed in one‐third of the runtime consumed by conventional MSIM method, without compromising spatial resolution. Last but not least, a fourfold reduction in the number of raw images required for reconstruction is achieved by using the same network architecture, yet with different training data.

Keywords