Vllm pd disaggregation

vLLM - PD Disaggregation

• Disaggregared Prefill
  • https://docs.vllm.ai/en/stable/examples/online_serving/disaggregated_prefill.html

• Disaggregated Serving

  • https://docs.vllm.ai/en/stable/examples/online_serving/disaggregated_serving.html#example-materials

• Refrence

  • https://github.com/vllm-project/vllm/issues/21800