swh.storage.proxies.blocking.cls module

swh.storage.proxies.blocking.cls.get_datastore(cls, db=None, blocking_db=None, **kwargs)

swh.storage.proxies.blocking.cls.blocking_overhead_timer(method_name: str) → DifferentialTimer

Return a properly setup DifferentialTimer for method_name of the storage

class swh.storage.proxies.blocking.cls.BlockingProxyStorage(storage: Dict | StorageInterface, db: str | None = None, blocking_db: str | None = None, min_pool_conns: int = 1, max_pool_conns: int = 5)

Bases: object

Blocking storage proxy

This proxy prevents visits from a known list of origins to be performed at all.

It uses a specific PostgreSQL database (which for now is colocated with the swh.storage PostgreSQL database), the access to which is implemented in the blocking.db submodule.

Sample configuration

origin_visit_status_add(visit_statuses: List[OriginVisitStatus]) → Dict[str, int]

origin_visit_add(visits: List[OriginVisit]) → Iterable[OriginVisit]

origin_add(origins: List[Origin]) → Dict[str, int]