swh.graph.e2e_check module

Spawns a gRPC server on a newly compressed graph, and checks responses are as expected.

swh.graph.e2e_check.run_e2e_check(graph_name: str, in_dir: str | None, out_dir: str | None, sensitive_in_dir: str | None, sensitive_out_dir: str | None, check_flavor: Literal['full', 'history_hosting', 'staging', 'example', 'none'], profile: Literal['release', 'debug'] = 'release', logger: Logger | None = None)

Empirically check the graph compression correctness.

Check for specific SWHIDs in the compressed graph and do simple traversal requests to ensure the compression went well.

Parameters:

• graph_name – Graph base name, relative to in_dir.

• in_dir – Input directory, where the uncompressed graph can be found.

• out_dir – Output directory, where the compressed graph can be found.

• sensitive_in_dir – Sensitive input directory, where the uncompressed sensitive graph can be found.

• sensitive_out_dir – Sensitive output directory, where the compressed sensitive graph can be found.

• check_flavor –

  Which flavor of checks to run.

  • ”full”: for a dataset made from the entire archive

  • ”history_hosting”: for a history and hosting dataset

  • ”staging”: for a dataset made from staging

  • ”example”: for the example dataset shipped with swh-graph

  • ”none”: for preventing to run the checks altogether

• profile – Which Rust executables to use.

Raises:

Exception – GRPC server unexpectedly stopped.