swh.loader.package.utils module
- swh.loader.package.utils.api_info(url: str, **extra_params) bytes[source]
- Basic api client to retrieve information on project. This deals with
fetching json metadata about pypi projects.
- Parameters
url (str) – The api url (e.g PyPI, npm, etc…)
- Raises
NotFound in case of query failures (for some reasons – 404, …)
- Returns
The associated response’s information
- swh.loader.package.utils.download(url: str, dest: str, hashes: Dict = {}, filename: Optional[str] = None, auth: Optional[Tuple[str, str]] = None, extra_request_headers: Optional[Dict[str, str]] = None) Tuple[str, Dict][source]
- Download a remote tarball from url, uncompresses and computes swh hashes
on it.
- Parameters
url – Artifact uri to fetch, uncompress and hash
dest – Directory to write the archive to
hashes – Dict of expected hashes (key is the hash algo) for the artifact to download (those hashes are expected to be hex string)
auth – Optional tuple of login/password (for http authentication service, e.g. deposit)
- Raises
ValueError in case of any error when fetching/computing (length, –
checksums mismatched...) –
- Returns
Tuple of local (filepath, hashes of filepath)