In Silico Labeling: Predicting Fluorescent Labels in Unlabeled Images

• Published in: Cell Vol. 173; no. 3; pp. 792 - 803.e19
• Main Authors: Christiansen, Eric M., Yang, Samuel J., Ando, D. Michael, Javaherian, Ashkan, Skibinski, Gaia, Lipnick, Scott, Mount, Elliot, O’Neil, Alison, Shah, Kevan, Lee, Alicia K., Goyal, Piyush, Fedus, William, Poplin, Ryan, Esteva, Andre, Berndl, Marc, Rubin, Lee L., Nelson, Philip, Finkbeiner, Steven
• Format: Journal Article
• Language: English
• Published: United States Elsevier Inc 19.04.2018
• Subjects: Algorithms; Animals; cancer; Cell Line, Tumor; Cell Survival; Cerebral Cortex - cytology; computer vision; deep learning; Fluorescent Dyes - chemistry; Humans; Image Processing, Computer-Assisted - methods; Induced Pluripotent Stem Cells - cytology; Machine Learning; microscopy; Microscopy, Fluorescence - methods; Motor Neurons - cytology; Neural Networks, Computer; neuroscience; Neurosciences; Rats; Software; stem cells; Stem Cells - cytology; deep learning; stem cells; neuroscience; computer vision; microscopy; cancer; machine learning
• ISSN: 0092-8674; 1097-4172
• DOI: 10.1016/j.cell.2018.03.040

Microscopy is a central method in life sciences. Many popular methods, such as antibody labeling, are used to add physical fluorescent labels to specific cellular constituents. However, these approaches have significant drawbacks, including inconsistency; limitations in the number of simultaneous labels because of spectral overlap; and necessary perturbations of the experiment, such as fixing the cells, to generate the measurement. Here, we show that a computational machine-learning approach, which we call “in silico labeling” (ISL), reliably predicts some fluorescent labels from transmitted-light images of unlabeled fixed or live biological samples. ISL predicts a range of labels, such as those for nuclei, cell type (e.g., neural), and cell state (e.g., cell death). Because prediction happens in silico, the method is consistent, is not limited by spectral overlap, and does not disturb the experiment. ISL generates biological measurements that would otherwise be problematic or impossible to acquire. [Display omitted] •Fluorescence microscopy images can be predicted from transmitted-light z stacks•7 fluorescent labels were validated across three labs, modalities, and cell types•New labels can be predicted using minimal additional training data In silico labeling, a machine-learning approach, reliably infers fluorescent measurements from transmitted-light images of unlabeled fixed or live biological samples.