swh.scheduler.simulator.origin_scheduler module#

Agents using the new origin-aware scheduler.

swh.scheduler.simulator.origin_scheduler.scheduler_runner_process(env: Environment, task_queues: Dict[str, Queue], policy: str, min_batch_size: int) Iterator[Event][source]#

Scheduler runner. Grabs next visits from the database according to the scheduling policy, and fills the task_queues accordingly.

swh.scheduler.simulator.origin_scheduler.scheduler_journal_client_process(env: Environment, status_queue: Queue) Generator[Event, TaskEvent, None][source]#

Scheduler journal client. Every once in a while, pulls OriginVisitStatuses from the status_queue to update the scheduler origin_visit_stats table.