Avoid importing model-layer token pricing to the application layer
Pricing application-layer work in tokens imports the model provider’s cost structure into the customer relationship and anchors product value to a unit whose cost keeps falling. Carrying model-layer pricing logic into the application layer is often a mistake.
Éléments favorables
You are not a model. Don’t price per token. | Andreessen Horowitz
Extrait original
When an application prices that work in tokens, it imports the model provider’s cost structure into the relationship with the customer and anchors the product’s value to a unit whose cost keeps falling. Based on our work, it’s often a mistake to carry the model layer’s pricing logic into the application layer.