Advanced Science (May 2024)

In Vivo Intelligent Fluorescence Endo‐Microscopy by Varifocal Meta‐Device and Deep Learning

  • Yu‐Hsin Chia,
  • Wei‐Hao Liao,
  • Sunil Vyas,
  • Cheng Hung Chu,
  • Takeshi Yamaguchi,
  • Xiaoyuan Liu,
  • Takuo Tanaka,
  • Yi‐You Huang,
  • Mu Ku Chen,
  • Wen‐Shiang Chen,
  • Din Ping Tsai,
  • Yuan Luo

DOI
https://doi.org/10.1002/advs.202307837
Journal volume & issue
Vol. 11, no. 20
pp. n/a – n/a

Abstract

Read online

Abstract Endo‐microscopy is crucial for real‐time 3D visualization of internal tissues and subcellular structures. Conventional methods rely on axial movement of optical components for precise focus adjustment, limiting miniaturization and complicating procedures. Meta‐device, composed of artificial nanostructures, is an emerging optical flat device that can freely manipulate the phase and amplitude of light. Here, an intelligent fluorescence endo‐microscope is developed based on varifocal meta‐lens and deep learning (DL). The breakthrough enables in vivo 3D imaging of mouse brains, where varifocal meta‐lens focal length adjusts through relative rotation angle. The system offers key advantages such as invariant magnification, a large field‐of‐view, and optical sectioning at a maximum focal length tuning range of ≈2 mm with 3 µm lateral resolution. Using a DL network, image acquisition time and system complexity are significantly reduced, and in vivo high‐resolution brain images of detailed vessels and surrounding perivascular space are clearly observed within 0.1 s (≈50 times faster). The approach will benefit various surgical procedures, such as gastrointestinal biopsies, neural imaging, brain surgery, etc.

Keywords