Machine Learning Model for Complete Reconstruction of Diagnostic Polarimetric Images from partial Mueller polarimetry data

• Published in: arXiv.org
• Main Authors: Chae, Sooyong, Huang, Tongyu, Rodrıguez-Nunez, Omar, Lucas, Théotim, Jean-Charles Vanel, Vizet, Jérémy, Angelo Pierangelo, Piavchenko, Gennadii, Genova, Tsanislava, Ajmal, Ajmal, Ramella-Roman, Jessica C, Doronin, Alexander, Ma, Hui, Novikova, Tatiana
• Format: Paper
• Language: English
• Published: Ithaca Cornell University Library, arXiv.org 19.09.2024
• Subjects: Algorithms; Biological effects; Data transmission; Depolarization; Human tissues; Image acquisition; Image reconstruction; Machine learning; Matrices (mathematics); Medical imaging; Neural networks; Optical data processing; Parallel processing; Pixels; Polarimeters; Polarimetry; Video data
• ISSN: 2331-8422

The translation of imaging Mueller polarimetry to clinical practice is often hindered by large footprint and relatively slow acquisition speed of the existing instruments. Using polarization-sensitive camera as a detector may reduce instrument dimensions and allow data streaming at video rate. However, only the first three rows of a complete 4x4 Mueller matrix can be measured. To overcome this hurdle we developed a machine learning approach using sequential neural network algorithm for the reconstruction of missing elements of a Mueller matrix from the measured elements of the first three rows. The algorithm was trained and tested on the dataset of polarimetric images of various excised human tissues (uterine cervix, colon, skin, brain) acquired with two different imaging Mueller polarimeters operating in either reflection (wide-field imaging system) or transmission (microscope) configurations at different wavelengths of 550 nm and 385 nm, respectively. The reconstruction performance was evaluated using various error metrics, all of which confirmed low error values. The execution time of the trained neural network algorithm was about 300 microseconds for a single image pixel. It suggests that a machine learning approach with parallel processing of all image pixels combined with the partial Mueller polarimeter operating at video rate can effectively substitute for the complete Mueller polarimeter and produce accurate maps of depolarization, linear retardance and orientation of the optical axis of biological tissues, which can be used for medical diagnosis in clinical settings.