A multimodal framework for extraction and fusion of satellite images and public health data

In low- and middle-income countries, the substantial costs associated with traditional data collection pose an obstacle to facilitating decision-making in the field of public health. Satellite imagery offers a potential solution, but the image extraction and analysis can be costly and requires speci...

Full description

Saved in:
Bibliographic Details
Published inScientific data Vol. 11; no. 1; pp. 634 - 20
Main Authors Moukheiber, Dana, Restrepo, David, Cajas, Sebastián Andrés, Montoya, María Patricia Arbeláez, Celi, Leo Anthony, Kuo, Kuan-Ting, López, Diego M, Moukheiber, Lama, Moukheiber, Mira, Moukheiber, Sulaiman, Osorio-Valencia, Juan Sebastian, Purkayastha, Saptarshi, Paddo, Atika Rahman, Wu, Chenwei, Kuo, Po-Chih
Format Journal Article
LanguageEnglish
Published England Nature Publishing Group 15.06.2024
Nature Publishing Group UK
Nature Portfolio
Subjects
Access to education
Analysis
Colombia
Computer engineering
Computer science
Data collection
Datasets
Decision making
Dengue
Dengue fever
Humans
Image processing
Informatics
Low income groups
Machine learning
Metadata
Neural networks
Public Health
Satellite Imagery
Satellites
Support vector machines
Time series
Colombia
Online AccessGet full text

Cover

More Information
Summary:In low- and middle-income countries, the substantial costs associated with traditional data collection pose an obstacle to facilitating decision-making in the field of public health. Satellite imagery offers a potential solution, but the image extraction and analysis can be costly and requires specialized expertise. We introduce SatelliteBench, a scalable framework for satellite image extraction and vector embeddings generation. We also propose a novel multimodal fusion pipeline that utilizes a series of satellite imagery and metadata. The framework was evaluated generating a dataset with a collection of 12,636 images and embeddings accompanied by comprehensive metadata, from 81 municipalities in Colombia between 2016 and 2018. The dataset was then evaluated in 3 tasks: including dengue case prediction, poverty assessment, and access to education. The performance showcases the versatility and practicality of SatelliteBench, offering a reproducible, accessible and open tool to enhance decision-making in public health.
Bibliography:ObjectType-Article-2
SourceType-Scholarly Journals-1
ObjectType-Undefined-1
ObjectType-Feature-3
content type line 23
ISSN:2052-4463
2052-4463
DOI:10.1038/s41597-024-03366-1