Transformer 之后是什么？
具体来说，我们首先讨论的是持续学习、记忆和推理。随着推进，我们意识到推理不应仅限于语言层面。在思维链中将事物用语言表达出来并不是进行推理的最优方式。使用思维链时，我们实质上是在把它粘在 transformer 之上，而 transformer 天然不擅长处理时间和从经验中学习。
原始摘录
Specifically, we’re talking about continual learning, memory, and reasoning first. And as we moved through it, we realized that reasoning shouldn’t just be linguistic. Verbalizing things in chain of thought is not the optimal way to do reasoning. With chain of thought, we’re essentially gluing it on top of a transformer, and transformers are naturally ill-suited to dealing with time and learning from experience.