Trellis for efficient data and task management in the VA Million Veteran Program

Biomedical studies have become larger in size and yielded large quantities of data, yet efficient data processing remains a challenge. Here we present Trellis, a cloud-based data and task management framework that completely automates the process from data ingestion to result presentation, while tra...

Full description

Saved in:
Bibliographic Details
Published inScientific reports Vol. 11; no. 1; p. 23229
Main Authors Ross, Paul Billing, Song, Jina, Tsao, Philip S., Pan, Cuiping
Format Journal Article
LanguageEnglish
Published London Nature Publishing Group UK 01.12.2021
Nature Publishing Group
Nature Portfolio
Subjects
631/114
631/114/129
631/114/1314
631/114/2785
631/114/794
Bioinformatics
Data processing
Genomes
Humanities and Social Sciences
Ingestion
multidisciplinary
Science
Science (multidisciplinary)
Online AccessGet full text

Cover

More Information
Summary:Biomedical studies have become larger in size and yielded large quantities of data, yet efficient data processing remains a challenge. Here we present Trellis, a cloud-based data and task management framework that completely automates the process from data ingestion to result presentation, while tracking data lineage, facilitating information query, and supporting fault-tolerance and scalability. Using a graph database to coordinate the state of the data processing workflows and a scalable microservice architecture to perform bioinformatics tasks, Trellis has enabled efficient variant calling on 100,000 human genomes collected in the VA Million Veteran Program.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:2045-2322
2045-2322
DOI:10.1038/s41598-021-02569-5