vLLM 0.32 changed four contracts at once
The release improves routing and memory, but it also changes browser policy, token admission, stream events, and runtime dependencies. Promote it as a serving migration, not a package update.
Topic ยท 2 articles
The latest analysis on Inference Infrastructure, across Daily Pulses and Weekly Reviews.
The release improves routing and memory, but it also changes browser policy, token admission, stream events, and runtime dependencies. Promote it as a serving migration, not a package update.
OpenAI externalizes the Codex harness as a managed Agents API, Anthropic adds server-evaluated tool permissions, and new military-domain evaluations show why runtime controls matter below the absolute model frontier.