swh.scrubber.journal_checker module#

Reads all objects in a swh-storage instance and recomputes their checksums.

class swh.scrubber.journal_checker.JournalChecker(db: ScrubberDb, journal: Dict[str, Any])[source]#

Bases: object

Reads a chunk of a swh-storage database, recomputes checksums, and reports errors in a separate database.

datastore_info() → Datastore[source]#

Returns a Datastore instance representing the journal instance being checked.

run()[source]#

Runs a journal client with the given configuration. This method does not return, unless otherwise configured (with stop_on_eof).

process_kafka_messages(all_messages: Dict[str, List[bytes]])[source]#