swh.loader.package.utils module¶
-
swh.loader.package.utils.
api_info
(url: str, **extra_params) → bytes[source]¶ - Basic api client to retrieve information on project. This deals with
fetching json metadata about pypi projects.
- Parameters
url (str) – The api url (e.g PyPI, npm, etc…)
- Raises
ValueError in case of query failures (for some reasons – 404, …)
- Returns
The associated response’s information
-
swh.loader.package.utils.
download
(url: str, dest: str, hashes: Dict = {}, filename: Optional[str] = None, auth: Optional[Tuple[str, str]] = None) → Tuple[str, Dict][source]¶ - Download a remote tarball from url, uncompresses and computes swh hashes
on it.
- Parameters
url – Artifact uri to fetch, uncompress and hash
dest – Directory to write the archive to
hashes – Dict of expected hashes (key is the hash algo) for the artifact to download (those hashes are expected to be hex string)
auth – Optional tuple of login/password (for http authentication service, e.g. deposit)
- Raises
ValueError in case of any error when fetching/computing (length, –
checksums mismatched...) –
- Returns
Tuple of local (filepath, hashes of filepath)