PENSÉES EN RELATION

Atlas des connaissances

Explorez les personnes, leurs points de vue et les sources originales.

1 personnes · 1 sources · 1 opinions exprimées

EN CONTEXTE

post-transformer architecture motivation

Choisissez un point de vue et retrouvez la conversation originale.

RAG, context, and memory were bottlenecks in 2023–2024

EN CONTEXTEpost-transformer architecture motivation1 opinions exprimées
2026-09-24

Les secteurs égaux servent de repères, pas de classement.

Points de vue 1–1 sur 1 · Sources les plus récentes en premier

1 / 1

Point de vue sélectionné

RAG, context, and memory were bottlenecks in 2023–2024

Stamirowska says the team saw RAG, context, and memory as bottlenecks in 2023 and 2024. They were not efficient or sufficient for what she describes as 'AI with no ceiling, if you wish.'

Il s’agit de points de vue individuels, non d’une mesure du consensus. Le matériel source reste dans sa langue d’origine.

Éléments favorables

What Comes After Transformers?

Extrait original

But very concretely, what prompted us to start Pathway and to start working on post-transformer architectures was that we were looking forward to reasoning becoming a thing. We have a very strong background in dealing with the dimension of time in machine learning—any sort of online learning. And we saw RAG, context, and memory, and we’re talking about 2023 and 2024, as bottlenecks. They were not efficient or sufficient to unlock AI as we would like—AI with no ceiling, if you wish.

Les dates concernent les sources, pas des changements d’opinion. Les textes sans traduction révisée restent dans leur langue originale.