$ cat introducing-kinference-an-open-source-inference-control-plane-for-vllm-and-kubernetes.md
Introducing Kinference: An Open Source Inference Control Plane for vLLM and Kubernetes
Kinference is a new open source inference control plane that works with vLLM and Kubernetes to help teams run scalable model serving. This post covers its main features: token rate limiting, per-tenant usage and cost tracking, load balancing, and inference policies.
vLLM04 Nov 2026 · 1 min read · summary
Read on vllm.ai ↗Kinference is a new open source inference control plane for building scalable inference platforms with vLLM and Kubernetes, providing token rate limiting, tenant usage and cost tracking, intelligent load balancing, and inference policies.
source
This is a summary of an article first published by vLLM. The full piece is on their site.