$ cat vllm-delivers-day-0-support-for-kimi-k31-pro.md
vLLM Delivers Day-0 Support for Kimi K3.1 Pro
This article explains how vLLM added day-0 support for Kimi K3.1 Pro. It covers the model's sparse attention on a KDA hybrid, its packed KV cache using FP8 or NVFP4 latents and MXFP4 index keys, token-sharded prefill, decode context parallelism, and fused low-latency decode.
vLLM04 Nov 2026 · 1 min read · summary
Read on vllm.ai ↗vLLM supports Kimi K3.1 Pro on day 0: sparse attention on a KDA hybrid, a packed KV cache with FP8 or NVFP4 latents and MXFP4 index keys, token-sharded prefill, decode context parallelism, and fused low-latency decode.
source
This is a summary of an article first published by vLLM. The full piece is on their site.