The Antiviral Competition ResultsSee the results of the Polaris competition, organized by ASAP Discovery and OpenADMET.

Competition

asap-discovery/antiviral-ligand-poses-2025

Since the rise of structure-informed drug discovery in the 1980s-1990s, structural biology is key to drug discovery. We challenge you to predict MERS-CoV Mpro and SARS-CoV-2 Mpro poses using knowledge from the SARS-CoV-2 Mpro crystallography data that ASAP created.

Duration: 2 monthsTrain size: 770Test size: 195
Ended 22 days ago

Competition Hosts

Quick Links

Tags

MERS-CoV
SARS-CoV-2
Mpro
ligand
poses

Modalities

MOLECULE
MOLECULE_3D
PROTEIN
PROTEIN_3D

Details

README

banner

This is the ligand pose challenge, part of the ASAP Discovery x OpenADMET challenge.

Ligand Poses

Since the rise of structure-informed drug discovery in the 1980s-1990s, structural biology is key to drug discovery. The structural effect of small adjustments to molecules can now be rapidly shown with X-Ray crystallography. However, creating the right experimental conditions (the right protein construct, buffer concentrations, etc) is extremly difficult even for the most experienced structural biology team. At ASAP, the SARS-CoV-2 Mpro program was structurally enabled from the start of the consortium, but the MERS-CoV Mpro program was not. This led to a delay in MERS-CoV Mpro potency even though the proteins are highly similar. We will challenge you to predict MERS-CoV Mpro poses using knowledge from the SARS-CoV-2 Mpro crystallography data that ASAP created.

📊 Data

The training set will have the following variables:

ColumnDtypeDescription
Chain A SequencestrPrimary structure of the protein's A chain: A linear sequence of amino acids.
Chain B SequencestrPrimary structure of the protein's B chain, if any: A linear sequence of amino acids.
CXSMILESstrText representation of the 2D molecular structure
Complex StructurePDB (fastpdb.AtomArray)3D system of the ligand bound to the protein, prepared using OESpruce and aligned to a reference Mpro
Protein StructurePDB (fastpdb.AtomArray)3D system of just the protein structure, prepared using OESpruce and aligned to a reference Mpro
Ligand PoseSDF (rdkit.Chem.Mol)3D conformation of the molecule, bound to the protein
Protein LabelstrEither SARS-CoV-2 Mpro or MERS-CoV Mpro

At test time, we will only provide the Protein Label, Chain A Sequence,Chain B Sequence and CXSMILES.

🧑‍💻 Get started

We provide notebooks to get started with the challenge that cover several important topics, such as how to prepare your submission and the data format. Get started here.

✂️ Split

We will provide training data on SARS CoV-2 Mpro, but participants are free to use any data in the public domain. The test set will be comprised of both MERS-CoV Mpro and SARS-CoV-2 Mpro structures

✅ Evaluation criteria

The challenge will be judged based on the judging criteria outlined here.

  • We will evaluate your submission using % of poses with a RMSD<2A compared to the crystallographic pose.
  • You can enter as many times as desired, but we will only evaluate your last submission.
  • In the open science spirit of ASAP Discovery we would love to see open code showing how you created your submission if possible. If not, we require at least a written report.

🏆 Prizes

We will be offering Polaris merch packs to the three top performing teams for each sub-challenge. We will also be writing our conclusions up as a paper, to which all submitting teams are invited to share co-authorship.

Post-challenge virtual workshop

Participants with considerable performance or learnings will have the opportunity to present their work at a special blind-challenge workshop to share learnings, hosted by the NIH ASAP Open Science Forum.

A special issue in the Journal of Chemical Information and Modeling

We encourage everyone participating in this challenge to share a preprint - we will track these during the challenge so that participants can compare learnings on-the-fly - that describes their approach, results, performance and learnings from comparing their approach with other groups. We are working with the editors of Journal of Chemical Information and Modeling (JCIM; a high-impact journal in chemical informatics and molecular modeling) on a collection of papers/ special issue that will report on the breadth of learnings and outcomes from this challenge.

💭 Any feedback?

If you have any suggestions on how we could evaluate the submitted predictions to further improve our shared understanding, we'd love to hear it! Please open a Github issue or discussion in this repository to share your ideas with the community.


About the ASAP Discovery x OpenADMET challenge

ASAP Discovery is an NIH-funded consortium leveraging open science for antiviral drug discovery, with the goal of equitable and affordable global access to effective antivirals. ASAP has pursued several programs and targets, the most advanced being ASAP's dual SARS-CoV-2 and MERS-CoV main protease (Mpro) program, which has reached preclinical candidate nomination. You can see a full list of ASAP's programs on the website. ASAP Discovery is passionate about open science and has put a huge amount of effort into sharing its outputs in a digestible way with the community. For example, if you navigate to ASAP's website, the drug discovery pipeline is fully interactive for users. Clicking any filled box will navigate you to the continuously published data for those experiments, and experimental protocols used.

ASAP Discovery is approaching a patent disclosure for its preclinical candidates for its two coronavirus Mpro drug discovery programs see blogpost for a high-level overview. There is a batch of data in these projects that ASAP Discovery has not publicly disclosed at this point; this will be the blind test data of this challenge. The blind challenge will mirror some of the real-world drug discovery challenges that ASAP has had to overcome in the last three years: we would love to challenge the community with the same hurdles that we've had to overcome during this process - can you use your models to solve these problems better than we have? You will be working with active and real drug discovery data that is normally restricted to large pharmaceutical companies!

banner The ASAP Discovery Consortium group meeting in NYC May 2023

All subchallenges:

Timeline

  • Sample data released: December 3 (2024)
  • Challenge start: Jan 13 (2025)
  • Jan-Feb: Walk in online sessions (2025)
  • Challenge end: March 10 (2025)
  • Winners announced: March 25 (2025)

Endpoints included in this challenge

We have designed this challenge to let you experience a diverse set of computational drug discovery problems that are pivotal in pushing the pharmaceutical decision-making process forward. To understand the typical medicinal-chemistry way of thinking about making a preclinical candidate, it's best to start at the top. Target Candidate Profiles (TCPs) are internal documents that pharmaceutical companies draw up that set a series of goals or must-haves (and sometimes nice-to-haves) that the intended preclininical candidate must have. With ASAP, these are public. Our SARS-CoV-2/MERS-Mpro dual inhibitor TCP is available here. You'll see there are many goals: the set of goals and their values depend heavily on the target indication (the disease that we're trying to treat).

You'll also notice that potency (IC50 or Kd) is only a small part of this TCP. That is typical: in close-to-preclinical stages such as lead optimization, potency is not the main challenge anymore. Rather, the challenge is to balance a wide array of more complex parameters such as cell potency, formulation, pharmacokinetics/dynamics and safety. These are all part of the 'assay cascade': promisingly potent lead molecules are subjected to a first tier of affordable follow-up assays. Ones that come out of those assays as acceptable (i.e. within the bounds of the TCP requirements) are followed up on in subsequent assay tiers. In this way, lead molecules follow the cascade from simple biochemical potency assays all the way to more involved assays and ultimately animal studies.

User Attributes

These are custom, user-defined attributes that are not required by the Polaris data model.

AttributeValue
MethodX-ray crystallography