Gramian Angular Fields for leveraging pretrained computer vision models with anomalous diffusion trajectories

• Published in: arXiv.org
• Main Authors: Garibo-i-Orts, Òscar, Firbas, Nicolás, Sebastiá, Laura, Conejero, J Alberto
• Format: Paper Journal Article
• Language: English
• Published: Ithaca Cornell University Library, arXiv.org 02.09.2023
• Subjects: Arthropods; Computer Science - Artificial Intelligence; Computer Science - Learning; Computer vision; Machine learning; Particle tracking; Physics - Biological Physics; Quantitative Biology - Quantitative Methods; Trajectory analysis; Ultracold atoms
• ISSN: 2331-8422
• DOI: 10.48550/arxiv.2310.01416

Anomalous diffusion is present at all scales, from atomic to large scales. Some exemplary systems are; ultra-cold atoms, telomeres in the nucleus of cells, moisture transport in cement-based materials, the free movement of arthropods, and the migration patterns of birds. The characterization of the diffusion gives critical information about the dynamics of these systems and provides an interdisciplinary framework with which to study diffusive transport. Thus, the problem of identifying underlying diffusive regimes and inferring the anomalous diffusion exponent {\(\alpha\)} with high confidence is critical to physics, chemistry, biology, and ecology. Classification and analysis of raw trajectories combining machine learning techniques with statistics extracted from them have widely been studied in the Anomalous Diffusion Challenge ge (Munoz-Gil et al., 2021). Here we present a new data-driven method for working with diffusive trajectories. This method utilizes Gramian Angular Fields (GAF) to encode one-dimensional trajectories as images (Gramian Matrices), while preserving their spatiotemporal structure for input to computer-vision models. This allows us to leverage two well-established pre-trained computer-vision models, ResNet and MobileNet, to characterize the underlying diffusive regime, and infer the anomalous diffusion exponent {\(\alpha\)}. Short raw trajectories, of lengths between 10 and 50, are commonly encountered in single-particle tracking experiments and are the most difficult to characterize. We show that by using GAF images, we can outperform the current state-of-the-art while increasing accessibility to machine learning methods in an applied setting.