vllm_tbccl.worker_cpuΒΆ
CPU worker for heterogeneous pipelines (see worker.py): KV-cache layout agreement and the persistent PP receive buffer a CPU eager worker never creates.
Back to top