Actual inference ownership requires owning, understanding, and optimizing the inference code
To actually own your inference, you need to own, understand, and optimize the code that runs the inference.
Supporting evidence
Introducing Modal Auto Endpoints: Optimized inference you actually own | Modal Blog
Original excerpt
If you work with open models served by an inference provider, you gain some control. But we think ownership runs deeper than the API. To actually own your inference, you need to own, understand, and optimize the code that runs the inference.