Software Heritage Datasets

This page lists the different public datasets and periodic data dumps of the archive produced and released by Software Heritage.

If you need help accessing our data, please send an email to datasets@softwareheritage.org.

The Software Heritage Graph Dataset

the entire graph of Software Heritage in a fully-deduplicated Merkle DAG representation.

Contents:

• Software Heritage Graph Dataset
  • Dataset
  • Relational schema
  • Setup on Amazon Athena
  • Setup on Azure Databricks
• Exporting a dataset
• Exporting a subdataset
• swh.export package
  • swh.export.exporters package
  • swh.export.test namespace
  • swh.export.athena module
  • swh.export.cli module
  • swh.export.exporter module
  • swh.export.fullnames module
  • swh.export.journalprocessor module
  • swh.export.luigi module
  • swh.export.relational module
  • swh.export.utils module