Whole-Slide Imaging, Mutual Information Registration for Multiplex Immunohistochemistry and Immunofluorescence

• Published in: Laboratory investigation Vol. 103; no. 8; p. 100175
• Main Authors: Doyle, Joshua, Green, Benjamin F., Eminizer, Margaret, Jimenez-Sanchez, Daniel, Lu, Steve, Engle, Elizabeth L., Xu, Haiying, Ogurtsova, Aleksandra, Lai, Jonathan, Soto-Diaz, Sigfredo, Roskes, Jeffrey S., Deutsch, Julie S., Taube, Janis M., Sunshine, Joel C., Szalay, Alexander S.
• Format: Journal Article
• Language: English
• Published: United States Elsevier Inc 01.08.2023
• Subjects: biomarker; Cell Membrane; Coloring Agents; Diagnostic Imaging; digital pathology; Fluorescent Antibody Technique; Immunohistochemistry; multiplex immunofluorescence; mutual information; registration; Retrospective Studies; tumor immune microenvironment; whole slide imaging; digital pathology; tumor immune microenvironment; multiplex immunofluorescence; whole slide imaging; registration; mutual information; biomarker
• ISSN: 0023-6837; 1530-0307; 1530-0307
• DOI: 10.1016/j.labinv.2023.100175

Multiplex immunohistochemistry/immunofluorescence (mIHC/mIF) is a developing technology that facilitates the evaluation of multiple, simultaneous protein expressions at single-cell resolution while preserving tissue architecture. These approaches have shown great potential for biomarker discovery, yet many challenges remain. Importantly, streamlined cross-registration of multiplex immunofluorescence images with additional imaging modalities and immunohistochemistry (IHC) can help increase the plex and/or improve the quality of the data generated by potentiating downstream processes such as cell segmentation. To address this problem, a fully automated process was designed to perform a hierarchical, parallelizable, and deformable registration of multiplexed digital whole-slide images (WSIs). We generalized the calculation of mutual information as a registration criterion to an arbitrary number of dimensions, making it well suited for multiplexed imaging. We also used the self-information of a given IF channel as a criterion to select the optimal channels to use for registration. Additionally, as precise labeling of cellular membranes in situ is essential for robust cell segmentation, a pan-membrane immunohistochemical staining method was developed for incorporation into mIF panels or for use as an IHC followed by cross-registration. In this study, we demonstrate this process by registering whole-slide 6-plex/7-color mIF images with whole-slide brightfield mIHC images, including a CD3 and a pan-membrane stain. Our algorithm, WSI, mutual information registration (WSIMIR), performed highly accurate registration allowing the retrospective generation of an 8-plex/9-color, WSI, and outperformed 2 alternative automated methods for cross-registration by Jaccard index and Dice similarity coefficient (WSIMIR vs automated WARPY, P < .01 and P < .01, respectively, vs HALO + transformix, P = .083 and P = .049, respectively). Furthermore, the addition of a pan-membrane IHC stain cross-registered to an mIF panel facilitated improved automated cell segmentation across mIF WSIs, as measured by significantly increased correct detections, Jaccard index (0.78 vs 0.65), and Dice similarity coefficient (0.88 vs 0.79).