swh.scanner.data module#

class swh.scanner.data.MerkleNodeInfo[source]#

Bases: dict

Store additional information about Merkle DAG nodes, using SWHIDs as keys

swh.scanner.data.init_merkle_node_info(source_tree: Directory, data: MerkleNodeInfo, info: set)[source]#: Populate the MerkleNodeInfo with the SWHIDs of the given source tree and the attributes that will be stored.

async swh.scanner.data.add_origin(source_tree: Directory, data: MerkleNodeInfo, client: Client)[source]#: Store origin information about software artifacts retrieved from the Software Heritage graph service.

swh.scanner.data.get_directory_data(root_path: str, source_tree: Directory, nodes_data: MerkleNodeInfo, directory_data: Dict = {}) → Dict[Path, dict][source]#

Get content information for each directory inside source_tree.

Returns:: A dictionary with a directory path as key and the relative contents information as values.

swh.scanner.data.directory_content(node: Directory, nodes_data: MerkleNodeInfo) → Tuple[int, int][source]#

Count known contents inside the given directory.

Returns:: A tuple with the total number of contents inside the directory and the number of known contents.

swh.scanner.data.has_dirs(node: Directory) → bool[source]#: Check if the given directory has other directories inside.

swh.scanner.data.get_content_from(node_path: bytes, source_tree: Directory, nodes_data: MerkleNodeInfo) → Dict[bytes, dict][source]#: Get content information from the given directory node.