Reliability-Aware Restoration Framework for 4D Spectral Photoacoustic Data

• Published in: IEEE transactions on pattern analysis and machine intelligence Vol. 45; no. 12; pp. 15445 - 15461
• Main Authors: Liao, Weihang, Subpa-asa, Art, Asano, Yuta, Zheng, Yinqiang, Kajita, Hiroki, Imanishi, Nobuaki, Yagi, Takayuki, Aiso, Sadakazu, Kishi, Kazuo, Sato, Imari
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.12.2023; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Correlation; Data models; Graph; Image restoration; New technology; Noise reduction; photoacoustic imaging; Reliability; reliability analysis; Restoration; Self-similarity; Signal to noise ratio; Subjective assessment; Three-dimensional displays
• ISSN: 0162-8828; 1939-3539; 2160-9292
• DOI: 10.1109/TPAMI.2023.3310981

Spectral photoacoustic imaging (PAI) is a new technology that is able to provide 3D geometric structure associated with 1D wavelength-dependent absorption information of the interior of a target in a non-invasive manner. It has potentially broad applications in clinical and medical diagnosis. Unfortunately, the usability of spectral PAI is severely affected by a time-consuming data scanning process and complex noise. Therefore in this study, we propose a reliability-aware restoration framework to recover clean 4D data from incomplete and noisy observations. To the best of our knowledge, this is the first attempt for the 4D spectral PA data restoration problem that solves data completion and denoising simultaneously. We first present a sequence of analyses, including modeling of data reliability in the depth and spectral domains, developing an adaptive correlation graph, and analyzing local patch orientation. On the basis of these analyses, we explore global sparsity and local self-similarity for restoration. We demonstrated the effectiveness of our proposed approach through experiments on real data captured from patients, where our approach outperformed the state-of-the-art methods in both objective evaluation and subjective assessment.