swh.loader.git.base module#

class swh.loader.git.base.BaseGitLoader(storage: StorageInterface, origin_url: str, logging_class: str | None = None, save_data_path: str | None = None, max_content_size: int | None = None, lister_name: str | None = None, lister_instance_name: str | None = None, metadata_fetcher_credentials: Dict[str, Dict[str, List[Dict[str, str]]]] | None = None, create_partial_snapshot: bool = False)[source]#

Bases: BaseLoader

This base class is a pattern for both git loaders

Those loaders are able to load all the data in one go.

cleanup() → None[source]#: Clean up an eventual state installed for computations.

has_contents() → bool[source]#: Checks whether we need to load contents

get_contents() → Iterable[BaseContent][source]#: Get the contents that need to be loaded

has_directories() → bool[source]#: Checks whether we need to load directories

get_directories() → Iterable[Directory][source]#: Get the directories that need to be loaded

has_revisions() → bool[source]#: Checks whether we need to load revisions

get_revisions() → Iterable[Revision][source]#: Get the revisions that need to be loaded

has_releases() → bool[source]#: Checks whether we need to load releases

get_releases() → Iterable[Release][source]#: Get the releases that need to be loaded

get_snapshot() → Snapshot[source]#: Get the snapshot that needs to be loaded

eventful() → bool[source]#: Whether the load was eventful

store_data() → None[source]#

Store fetched and processed data in the storage.

This should call the storage.<object>_add methods, which handle the objects to store in the storage.