被当作‘万能神’的前沿LLM既昂贵又缓慢
随着前沿LLM的能力越来越强,我们开始把它们当作“神”,在任何涉及模糊输入的任务中都去求助于它们:散文生成、文档提取、搜索、排序、研究、分类等等。不幸的是,“神”既昂贵又缓慢。你在每次调用时都要为这种通用性付出代价,即使你需要的只是一个“是”或“否”。
原始摘录
As frontier LLMs have gotten more capable, we've started treating them like god, reaching for them for any task with fuzzy inputs: prose generation, document extraction, search, ranking, research, classification, and more. Unfortunately, god is expensive, and slow. You pay for that generality on every call, even when all you needed was a yes or no.