Foundation Models for Predictive Molecular Epidemiology

PI Arvind Ramanathan, Argonne National Laboratory
Co-PI Thomas Brettin, Argonne National Laboratory
Anima Anandkumar, California Institute of Technology and NVIDIA Inc.
Nicholas Chia, Mayo Clinic
Christian Dallago, NVIDIA Inc.
Thomas Gibbs, NVIDIA Inc.
Ian Foster, Argonne National Laboratory
Logan Ward, Argonne National Laboratory
Christopher Henry, Argonne National Laboratory
James Davis, Argonne National Laboratory
Maulik Shukla, Argonne National Laboratory
Azton Wells, Argonne National Laboratory
Carla Mann, Argonne National Laboratory
Venkatram Vishwananth, Argonne National Laboratory
Ramanathan INCITE 2024

Genome-scale language models (GenSLMs) for predictive molecular epidemiology.

Project Description

The potential for extant and emerging pathogens to become global health crises necessitates the development of novel methods for proactively engaging these threats before they become pandemic. Recent advances in machine learning and artificial intelligence—specifically, large language models (LLMs)—provide powerful tools for predictive modeling and monitoring of pathogens of concern. The team’s prior work developing genome-scale Language Models (GenSLMs demonstrated the potential for LLMs to predict future SARS-CoV-2 variants of concern prior to their emergence by modeling the evolutionary process. In this project the team builds on that work by scaling GenSLMs beyond the (relatively) simple SARS-CoV-2 to multi-segmented viruses and comparatively enormous bacterial genomes, and even further to more complex eukaryotic organisms including yeast and humans. This project will thus increase biopreparedness by providing a continuous watchlist of pandemic-potential variants across several different pathogens; and will additionally benefit the community by making GenSLM models, data, and code available to a broad user base, who can fine-tune our foundation models for their own downstream predictive tasks.

Allocations