swh.objstorage.backends.generator module

class swh.objstorage.backends.generator.Randomizer

Bases: object

read(size)

swh.objstorage.backends.generator.gen_sizes()

generates numbers according to the rought distribution of file size in the SWH archive

swh.objstorage.backends.generator.gen_random_content(total=None, filesize=None)

generates random (file) content which sizes roughly follows the SWH archive file size distribution (by default).

Parameters:

• total (int) – the total number of objects to generate. Infinite if unset.

• filesize (int) – generate objects with fixed size instead of random ones.

class swh.objstorage.backends.generator.RandomGeneratorObjStorage(filesize=None, total=None, **kwargs)

Bases: ObjStorage

A stupid read-only storage that generates blobs for testing purpose.

name: str = 'generator'

Default objstorage name; can be overloaded at instantiation time giving a ‘name’ argument to the constructor

property content_generator

check_config(*, check_write)

get(obj_id, *args, **kwargs)

add(content, obj_id, check_presence=True, *args, **kwargs)

check(obj_id, *args, **kwargs)

Check if a content is found and recompute its hash to check integrity.

delete(obj_id, *args, **kwargs)

list_content(last_obj_id: bytes | CompositeObjId | None = None, limit: int | None = 10000) → Iterator[CompositeObjId]