swh.graph namespace

Subpackages:

• swh.graph.example_dataset package
  • swh.graph.example_dataset.generate_dataset module
    • main()
  • PERSONS
  • CONTENTS
  • SKIPPED_CONTENTS
  • DIRECTORIES
  • REVISIONS
  • RELEASES
  • SNAPSHOTS
  • ORIGIN_VISITS
  • ORIGIN_VISIT_STATUSES
  • INITIAL_ORIGIN
  • FORKED_ORIGIN
  • ORIGINS
  • DATASET
  • DATASET_DIR
  • SENSITIVE_DATASET_DIR
• swh.graph.grpc namespace
  • swh.graph.grpc.swhgraph_pb2 module
    • ContentData
    • CountResponse
    • EdgeLabel
    • FindPathBetweenRequest
    • FindPathToRequest
    • GetNodeRequest
    • LabeledNode
    • Node
    • NodeFilter
    • OriginData
    • Path
    • ReleaseData
    • RevisionData
    • StatsRequest
    • StatsResponse
    • Successor
    • TraversalRequest
  • swh.graph.grpc.swhgraph_pb2_grpc module
    • TraversalServiceStub
    • TraversalServiceServicer
    • add_TraversalServiceServicer_to_server()
    • TraversalService
• swh.graph.libs package
  • swh.graph.libs.luigi package
    • swh.graph.libs.luigi.topology module
    • Luigi tasks
  • swh.graph.libs.shell module
    • Rust
• swh.graph.luigi package
  • swh.graph.luigi.compressed_graph module
    • Luigi tasks for compression
    • ObjectTypesParameter
    • ExtractNodes
    • ExtractLabels
    • NodeStats
    • EdgeStats
    • LabelStats
    • Mph
    • InitialOrder
    • Bv
    • BvEf
    • BfsRoots
    • Bfs
    • PermuteAndSimplifyBfs
    • BfsEf
    • BfsDcf
    • Llp
    • PermuteLlp
    • Ef
    • ComposeOrders
    • Transpose
    • TransposeEf
    • Maps
    • ExtractPersons
    • PersonsStats
    • MphPersons
    • ExtractFullnames
    • FullnamesEf
    • NodeProperties
    • PthashLabels
    • LabelsOrder
    • FclLabels
    • EdgeLabels
    • EdgeLabelsTranspose
    • EdgeLabelsEf
    • EdgeLabelsTransposeEf
    • Stats
    • EndToEndCheck
    • CompressGraph
    • UploadGraphToS3
    • DownloadGraphFromS3
    • LocalGraph
  • swh.graph.luigi.subdataset module
    • SelectTopGithubOrigins
    • SubdatasetOriginsFromFile
    • ListSwhidsForSubdataset
    • CreateSubdatasetOnAthena
  • swh.graph.luigi.utils module
    • estimate_node_count()
    • count_nodes()
  • Luigi tasks

Submodules:

• swh.graph.cli module
  • StepOption
    • StepOption.name
    • StepOption.convert()
  • PathlibPath
    • PathlibPath.convert()
  • get_all_subclasses()
  • main()
• swh.graph.client module
• swh.graph.config module
  • check_config()
  • check_config_compress()
• swh.graph.download module
  • GraphDownloader
    • GraphDownloader.filter_objects()
    • GraphDownloader.can_download_file()
    • GraphDownloader.post_download_file()
    • GraphDownloader.post_downloads()
• swh.graph.e2e_check module
  • run_e2e_check()
• swh.graph.find_context module
  • fqswhid_of_traversal()
  • main()
• swh.graph.grpc_server module
  • ExecutableNotFound
  • build_rust_grpc_server_cmdline()
  • spawn_rust_grpc_server()
  • stop_grpc_server()
• swh.graph.http_client module
  • GraphAPIError
  • GraphArgumentException
  • RemoteGraphClient
    • RemoteGraphClient.raw_verb_lines()
    • RemoteGraphClient.get_lines()
    • RemoteGraphClient.raise_for_status()
    • RemoteGraphClient.stats()
    • RemoteGraphClient.leaves()
    • RemoteGraphClient.neighbors()
    • RemoteGraphClient.visit_nodes()
    • RemoteGraphClient.visit_edges()
    • RemoteGraphClient.visit_paths()
    • RemoteGraphClient.walk()
    • RemoteGraphClient.random_walk()
    • RemoteGraphClient.count_leaves()
    • RemoteGraphClient.count_neighbors()
    • RemoteGraphClient.count_visit_nodes()
• swh.graph.http_naive_client module
  • check_arguments()
  • filter_node_types()
  • NaiveClient
    • NaiveClient.stats()
    • NaiveClient.leaves()
    • NaiveClient.neighbors()
    • NaiveClient.visit_nodes()
    • NaiveClient.visit_edges()
    • NaiveClient.visit_paths()
    • NaiveClient.walk()
    • NaiveClient.random_walk()
    • NaiveClient.count_leaves()
    • NaiveClient.count_neighbors()
    • NaiveClient.count_visit_nodes()
  • Graph
    • Graph.get_filtered_neighbors()
    • Graph.get_subgraph()
    • Graph.iter_paths_dfs()
    • Graph.iter_edges_dfs()
  • SubgraphIterator
    • SubgraphIterator.more_work()
    • SubgraphIterator.pop()
    • SubgraphIterator.push()
  • DfsSubgraphIterator
    • DfsSubgraphIterator.more_work()
    • DfsSubgraphIterator.pop()
    • DfsSubgraphIterator.push()
• swh.graph.http_rpc_server module
  • GraphServerApp
  • index()
  • GraphView
    • GraphView.get_direction()
    • GraphView.get_edges()
    • GraphView.get_return_types()
    • GraphView.get_max_matching_nodes()
    • GraphView.get_max_edges()
    • GraphView.check_swhid()
  • StreamingGraphView
    • StreamingGraphView.content_type
    • StreamingGraphView.response_streamer()
    • StreamingGraphView.get()
    • StreamingGraphView.prepare_response()
    • StreamingGraphView.stream_response()
    • StreamingGraphView.stream_line()
  • StatsView
    • StatsView.get()
  • SimpleTraversalView
    • SimpleTraversalView.prepare_response()
    • SimpleTraversalView.configure_request()
    • SimpleTraversalView.stream_response()
  • LeavesView
    • LeavesView.configure_request()
  • NeighborsView
    • NeighborsView.configure_request()
  • VisitNodesView
  • VisitEdgesView
    • VisitEdgesView.configure_request()
    • VisitEdgesView.stream_response()
  • CountView
    • CountView.count_type
    • CountView.get()
    • CountView.configure_request()
  • CountNeighborsView
    • CountNeighborsView.configure_request()
  • CountLeavesView
    • CountLeavesView.configure_request()
  • CountVisitNodesView
  • make_app()
  • make_app_from_configfile()
• swh.graph.naive_client module
• swh.graph.pytest_plugin module
  • GraphServerProcess
    • GraphServerProcess.run()
    • GraphServerProcess.start()
    • GraphServerProcess.stop()
  • StatsdServer
    • StatsdServer.new_datagram
    • StatsdServer.close()
  • graph_statsd_server()
  • graph_grpc_backend_implementation()
  • graph_grpc_server_config()
  • graph_grpc_server_process()
  • graph_grpc_server_started()
  • graph_grpc_stub()
  • graph_grpc_server()
  • remote_graph_client_url()
  • remote_graph_client()
  • naive_graph_client()
  • graph_client()
• swh.graph.shell module
  • LOGBACK_CONF
  • CommandException
  • base_cgroup()
  • create_cgroup()
  • move_to_cgroup()
  • Command
    • Command.run()
  • Rust
  • Pipe
    • Pipe.run()
  • wc()
  • Sink
    • Sink.run()
  • AtomicFileSink
    • AtomicFileSink.run()
  • RunResult
    • RunResult.cgroup
    • RunResult.command
    • RunResult.cgroup_stats
• swh.graph.utils module
  • link()
• swh.graph.webgraph module
  • CompressionSubprocessError
  • CompressionStep
    • CompressionStep.EXTRACT_NODES
    • CompressionStep.EXTRACT_LABELS
    • CompressionStep.NODE_STATS
    • CompressionStep.EDGE_STATS
    • CompressionStep.LABEL_STATS
    • CompressionStep.MPH
    • CompressionStep.INITIAL_ORDER
    • CompressionStep.BV
    • CompressionStep.BV_EF
    • CompressionStep.BFS_ROOTS
    • CompressionStep.BFS
    • CompressionStep.PERMUTE_AND_SIMPLIFY_BFS
    • CompressionStep.BFS_EF
    • CompressionStep.BFS_DCF
    • CompressionStep.LLP
    • CompressionStep.COMPOSE_ORDERS
    • CompressionStep.PERMUTE_LLP
    • CompressionStep.EF
    • CompressionStep.TRANSPOSE
    • CompressionStep.TRANSPOSE_EF
    • CompressionStep.MAPS
    • CompressionStep.EXTRACT_PERSONS
    • CompressionStep.PERSONS_STATS
    • CompressionStep.MPH_PERSONS
    • CompressionStep.EXTRACT_FULLNAMES
    • CompressionStep.FULLNAMES_EF
    • CompressionStep.NODE_PROPERTIES
    • CompressionStep.MPH_LABELS
    • CompressionStep.LABELS_ORDER
    • CompressionStep.FCL_LABELS
    • CompressionStep.EDGE_LABELS
    • CompressionStep.EDGE_LABELS_TRANSPOSE
    • CompressionStep.EDGE_LABELS_EF
    • CompressionStep.EDGE_LABELS_TRANSPOSE_EF
    • CompressionStep.STATS
    • CompressionStep.E2E_CHECK
    • CompressionStep.CLEAN_TMP
  • do_step()
  • compress()