#inference
← All posts
Modelplane v0.2: more clouds, and traffic you can direct
Modelplane v0.2 adds Nebius and Azure AKS as inference cluster providers, weighted routing for safe model rollouts, and cluster taints for reserving and draining capacity.
Any Engine, Any Topology, Any Infrastructure: How We Designed Modelplane
How we designed Modelplane's fleet-level inference API to fit any engine, in any topology, on any infrastructure — and what's under the hood now that v0.1 has shipped.
Introducing Modelplane: the control plane for AI inference
Today we're open sourcing Modelplane, a control plane that operates AI inference across a fleet of GPU clusters, on cloud, neocloud, and on-premise, as one inference platform.