推理必须紧邻计算、存储和网络
Blaxel 团队观察到,面向自主智能体的推理不再是一项远程服务调用:它必须与计算、存储和网络共置,以避免在每次智能体循环中累积延迟。
支持这项说法
Blaxel 加入 Baseten,共建智能体基础设施的未来
我们未能自主掌控的原语是推理。我们已经看到,开放权重模型与定制模型正成为自主智能体在生产环境中部署方式的核心。推理不再是一项可以从另一个数据中心调用的服务。它必须紧邻计算、存储和网络;否则延迟会在每一次循环中不断累积。
原始摘录
The primitive we didn't own was inference. We've seen open-weight & custom models become core to how autonomous agents get deployed in production. Inference is no longer a service you call from another data center. It has to sit next to compute, storage, and network; or latency compounds on every loop.