Buoyant Releases Kinference: An Open Source Inference Control Plane for Kubernetes and vLLM
MarkTechPosten
Buoyant has released Kinference, an Apache 2.0 inference control plane for vLLM on Kubernetes. It adds declarative routing policies, KV-cache-aware load balancing and per-tenant metrics, and cut median TTFT 95% in Buoyant’s own benchmark. The post Buoyant Releases Kinference: An Open Source Inference Control Plane for Kubernetes and vLLM appeared first on MarkTechPost .
This is a short summary published by AI Global Wire. The full article is owned and hosted by MarkTechPost — open it there to read it in full.
Read the full story at MarkTechPost- Verktyg
Related AI news
- Thinking Machines' Inkling 2 Small drops 316 F-bombs across benchmark runsThe Decoder · November 7, 2026
- The US let Nvidia sell chips to an empty office in ChinaThe Verge AI · November 7, 2026
- The gap between open and closed AI models in cyber capabilities keeps shrinkingThe Decoder · November 7, 2026
- Investigation: some Chinese firms approved by the US Commerce Department to handle Nvidia's H200 chips have empty offices and ties to firms under sanctions (New York Times)Techmeme · November 7, 2026
- Investigation: some Chinese companies approved by the US Commerce Department to handle Nvidia's H200 chips have empty offices and ties to firms under sanctions (New York Times)Techmeme · November 7, 2026
- The AI trade is now counting on Anthropic’s IPO — but it couldn’t be happening at a worse timeMarketWatch Tech · November 7, 2026