Avoid importing model-layer token pricing to the application layer
Pricing application-layer work in tokens imports the model provider’s cost structure into the customer relationship and anchors product value to a unit whose cost keeps falling. Carrying model-layer pricing logic into the application layer is often a mistake.
Evidencia a favor
You are not a model. Don’t price per token. | Andreessen Horowitz
Extracto original
When an application prices that work in tokens, it imports the model provider’s cost structure into the relationship with the customer and anchors the product’s value to a unit whose cost keeps falling. Based on our work, it’s often a mistake to carry the model layer’s pricing logic into the application layer.