Submission Rules & Eligibility — HIPC scRNA-seq Annotation Benchmark Challenge

Entries are accepted throughout the challenge period (). Please read the following rules carefully before submitting.

General Rules

Submissions are accepted from registered teams only. To participate, teams must sign up via the challenge registration form prior to submitting. Each team must have a designated team lead, who will receive login credentials and is responsible for the final submission.

A submission is defined as a single attempt encompassing annotations for all assigned datasets. Each team may submit only once. If a group wishes to submit multiple independent attempts (e.g., using different pipelines or methods), each attempt must be registered as a separate team.

Each team must annotate only their assigned studies and should not work on datasets assigned to other teams. To preserve the integrity of the benchmark, please do not discuss your assigned studies or annotations with other participating teams.

Technical Requirements

All cell type labels must be mapped to the standardized Cell Ontology dictionary provided in CT_Ontology_Spreadsheet_*.xlsx. Annotations that do not match the required nomenclature will not be evaluated. All entries must include fully documented, runnable code (R Markdown or Jupyter Notebook) hosted on GitHub. Submissions without reproducible workflows cannot be accepted.

How to Submit

When ready, submit your final bundle via the secure Google Form. Submissions via email are not accepted.

For questions related to data access or cell ontology, please write your queries here in the comments.