Final published version
Licence: CC BY: Creative Commons Attribution 4.0 International License
Research output: Contribution to Journal/Magazine › Journal article › peer-review
Research output: Contribution to Journal/Magazine › Journal article › peer-review
}
TY - JOUR
T1 - Deep learning-based aberration compensation improves contrast and resolution in fluorescence microscopy
AU - Guo, M.
AU - Wu, Y.
AU - Hobson, C.M.
AU - Su, Y.
AU - Qian, S.
AU - Krueger, E.
AU - Christensen, R.
AU - Kroeschell, G.
AU - Bui, J.
AU - Chaw, M.
AU - Zhang, L.
AU - Liu, J.
AU - Hou, X.
AU - Han, X.
AU - Lu, Z.
AU - Ma, X.
AU - Zhovmer, A.
AU - Combs, C.
AU - Moyle, M.
AU - Yemini, E.
AU - Liu, H.
AU - Liu, Z.
AU - Benedetto, A.
AU - La Riviere, P.
AU - Colón-Ramos, D.
AU - Shroff, H.
PY - 2025/1/2
Y1 - 2025/1/2
N2 - Optical aberrations hinder fluorescence microscopy of thick samples, reducing image signal, contrast, and resolution. Here we introduce a deep learning-based strategy for aberration compensation, improving image quality without slowing image acquisition, applying additional dose, or introducing more optics. Our method (i) introduces synthetic aberrations to images acquired on the shallow side of image stacks, making them resemble those acquired deeper into the volume and (ii) trains neural networks to reverse the effect of these aberrations. We use simulations and experiments to show that applying the trained ‘de-aberration’ networks outperforms alternative methods, providing restoration on par with adaptive optics techniques; and subsequently apply the networks to diverse datasets captured with confocal, light-sheet, multi-photon, and super-resolution microscopy. In all cases, the improved quality of the restored data facilitates qualitative image inspection and improves downstream image quantitation, including orientational analysis of blood vessels in mouse tissue and improved membrane and nuclear segmentation in C. elegans embryos.
AB - Optical aberrations hinder fluorescence microscopy of thick samples, reducing image signal, contrast, and resolution. Here we introduce a deep learning-based strategy for aberration compensation, improving image quality without slowing image acquisition, applying additional dose, or introducing more optics. Our method (i) introduces synthetic aberrations to images acquired on the shallow side of image stacks, making them resemble those acquired deeper into the volume and (ii) trains neural networks to reverse the effect of these aberrations. We use simulations and experiments to show that applying the trained ‘de-aberration’ networks outperforms alternative methods, providing restoration on par with adaptive optics techniques; and subsequently apply the networks to diverse datasets captured with confocal, light-sheet, multi-photon, and super-resolution microscopy. In all cases, the improved quality of the restored data facilitates qualitative image inspection and improves downstream image quantitation, including orientational analysis of blood vessels in mouse tissue and improved membrane and nuclear segmentation in C. elegans embryos.
KW - blood
KW - detection method
KW - image analysis
KW - image resolution
KW - instrumentation
KW - segmentation
KW - signal processing
KW - simulation
KW - article
KW - blood vessel
KW - Caenorhabditis elegans
KW - compensation
KW - contrast
KW - controlled study
KW - deep learning
KW - embryo
KW - fluorescence
KW - fluorescence microscopy
KW - image quality
KW - microscopy
KW - mouse
KW - nerve cell network
KW - nonhuman
KW - photon
KW - animal
KW - artificial neural network
KW - confocal microscopy
KW - image processing
KW - procedures
KW - Animals
KW - Deep Learning
KW - Image Processing, Computer-Assisted
KW - Mice
KW - Microscopy, Confocal
KW - Microscopy, Fluorescence
KW - Neural Networks, Computer
U2 - 10.1038/s41467-024-55267-x
DO - 10.1038/s41467-024-55267-x
M3 - Journal article
VL - 16
JO - Nature Communications
JF - Nature Communications
SN - 2041-1723
IS - 1
M1 - 313
ER -