Aberration Modeling in Deep Learning for Volumetric Reconstruction of Light‐Field Microscopy

Abstract Optical aberration is a crucial issue in optical microscopes, fundamentally constraining the achievable imaging performance. As a commonly encountered one, spherical aberration is introduced by the refractive index mismatches between samples and their surrounding environments, leading to pr...

Full description

Saved in:
Bibliographic Details
Published inLaser & photonics reviews Vol. 17; no. 10
Main Authors Zhou, You, Jin, Zhouyu, Zhao, Qianhui, Xiong, Bo, Cao, Xun
Format Journal Article
LanguageEnglish
Published Weinheim Wiley Subscription Services, Inc 01.10.2023
Subjects
Aberration
Blurring
Image reconstruction
Microscopy
Modelling
Optical microscopes
Point spread functions
Refractivity
Spatial resolution
Zebrafish
Online AccessGet full text

Cover

More Information
Summary:Abstract Optical aberration is a crucial issue in optical microscopes, fundamentally constraining the achievable imaging performance. As a commonly encountered one, spherical aberration is introduced by the refractive index mismatches between samples and their surrounding environments, leading to problems like low contrast, blurring, and distortion in imaging. Light‐field microscopy (LFM) has recently emerged as a powerful tool for rapid volumetric imaging. The presence of spherical aberration in LFM will cause substantial changes of the point spread function (PSF) and thus greatly affects the imaging performance. Here, the aberration‐modeling view‐channel‐depth (AM‐VCD) network is proposed for LFM reconstruction, effectively mitigating the influence of severe spherical aberration. By quantitatively estimating the spherical aberration in advance and incorporating it into the network training, the AM‐VCD achieves aberration‐corrected high‐speed visualization of 3D processes with uniform spatial resolution and real‐time reconstruction speed. Without necessitating hardware modifications, this method provides a convenient way for directly observing the 3D dynamics of samples in solution. The capability of AM‐VCD under a large refractive index mismatch is demonstrated through volumetric imaging of a large‐scale fishbone of a largemouth bass. Furthermore, the capability of AM‐VCD in nearly 100 Hz volumetric imaging of neutrophil migration and a beating heart in living zebrafish is investigated.
ISSN:1863-8880
1863-8899
DOI:10.1002/lpor.202300154