swh.loader.git.base module#

class swh.loader.git.base.BaseGitLoader(storage: StorageInterface, origin_url: str, logging_class: str | None = None, save_data_path: str | None = None, max_content_size: int | None = None, lister_name: str | None = None, lister_instance_name: str | None = None, metadata_fetcher_credentials: Dict[str, Dict[str, List[Dict[str, str]]]] | None = None, create_partial_snapshot: bool = False)[source]#

Bases: BaseLoader

This base class is a pattern for both git loaders

Those loaders are able to load all the data in one go.

cleanup() None[source]#

Clean up an eventual state installed for computations.

has_contents() bool[source]#

Checks whether we need to load contents

get_contents() Iterable[BaseContent][source]#

Get the contents that need to be loaded

has_directories() bool[source]#

Checks whether we need to load directories

get_directories() Iterable[Directory][source]#

Get the directories that need to be loaded

has_revisions() bool[source]#

Checks whether we need to load revisions

get_revisions() Iterable[Revision][source]#

Get the revisions that need to be loaded

has_releases() bool[source]#

Checks whether we need to load releases

get_releases() Iterable[Release][source]#

Get the releases that need to be loaded

get_snapshot() Snapshot[source]#

Get the snapshot that needs to be loaded

eventful() bool[source]#

Whether the load was eventful

store_data() None[source]#

Store fetched and processed data in the storage.

This should call the storage.<object>_add methods, which handle the objects to store in the storage.