Inference must sit adjacent to compute, storage, and network
The Blaxel team observed that inference for autonomous agents is no longer a remote service call: it must be colocated with compute, storage, and networking to avoid compounding latency on every agent loop.
Supporting evidence
Blaxel is joining Baseten to build the future of agentic infrastructure
Original excerpt
The primitive we didn't own was inference. We've seen open-weight & custom models become core to how autonomous agents get deployed in production. Inference is no longer a service you call from another data center. It has to sit next to compute, storage, and network; or latency compounds on every loop.