Important Data Updates for HIPC Single-Cell Annotation Benchmark (May 11, 2026)

A few updates that affect your HIPC scRNA-seq Challenge datasets and submissions. Please review carefully before submitting.

1. In response to participant requests, both unfiltered (raw) and filtered (processed) data are now available on the portal for all assigned studies, with two exceptions (infection_study_07 and vaccination_study_10) for which raw data is unavailable. All previous data has been moved to a legacy_data subfolder within each study folder and is version-controlled.

2. Cell barcode requirements: Annotations must correspond to the specific cell barcodes in the processed data:

  • Standard format: TSV files must match the cell_id barcodes in the processed metadata.

  • Alternative format: If you encounter technical issues with the standard format, use the study_annotation_template.tsv template. This format also allows you to include additional cell barcodes beyond those covered by the standard.

3. New optional column - confidence_score: A confidence_score column has been added to the submission templates. Reporting these values is optional but strongly encouraged, as it will support our post-challenge methodological analysis.

Reminders:

  • Submission deadline: June 12, 2026

  • Final Q&A webinar: June 8, 2026 (9-10AM PT).

  • Cell labels: Use the HIPC Cell Ontology Dictionary for all annotations.

If you have questions, please reply to this thread.

Best regards,

Pramod

HIPC Benchmark Organizing Team