SenseAI: Real-Time Inpainting for Electron Microscopy

Despite their proven success and broad applicability to Electron Microscopy (EM) data, joint dictionary-learning and sparse-coding based inpainting algorithms have so far remained impractical for real-time usage with an Electron Microscope. For many EM applications, the reconstruction time for a sin...

Full description

Saved in:
Bibliographic Details
Main Authors Wells, Jack, Moshtaghpour, Amirafshar, Nicholls, Daniel, Robinson, Alex W, Zheng, Yalin, Castagna, Jony, Browning, Nigel D
Format Journal Article
LanguageEnglish
Published 25.11.2023
Online AccessGet full text

Cover

More Information
Summary:Despite their proven success and broad applicability to Electron Microscopy (EM) data, joint dictionary-learning and sparse-coding based inpainting algorithms have so far remained impractical for real-time usage with an Electron Microscope. For many EM applications, the reconstruction time for a single frame is orders of magnitude longer than the data acquisition time, making it impossible to perform exclusively subsampled acquisition. This limitation has led to the development of SenseAI, a C++/CUDA library capable of extremely efficient dictionary-based inpainting. SenseAI provides N-dimensional dictionary learning, live reconstructions, dictionary transfer and visualization, as well as real-time plotting of statistics, parameters, and image quality metrics.
Bibliography:ISCS23-35
DOI:10.48550/arxiv.2311.15061