Avoid importing model-layer token pricing to the application layer
Pricing application-layer work in tokens imports the model provider’s cost structure into the customer relationship and anchors product value to a unit whose cost keeps falling. Carrying model-layer pricing logic into the application layer is often a mistake.
Stützende Belege
You are not a model. Don’t price per token. | Andreessen Horowitz
Originalauszug
When an application prices that work in tokens, it imports the model provider’s cost structure into the relationship with the customer and anchors the product’s value to a unit whose cost keeps falling. Based on our work, it’s often a mistake to carry the model layer’s pricing logic into the application layer.