IDEAS CONECTADAS

Atlas de conocimiento

Explora personas, perspectivas y sus fuentes originales.

1 personas · 1 fuentes · 1 opiniones expresadas

EN CONTEXTO

post-transformer architecture motivation

Elige una perspectiva y vuelve a la conversación original.

RAG, context, and memory were bottlenecks in 2023–2024

EN CONTEXTOpost-transformer architecture motivation1 opiniones expresadas
2026-09-24

Los sectores iguales orientan la lectura, no indican una clasificación.

Perspectivas 1–1 de 1 · Fuentes más recientes primero

1 / 1

Perspectiva seleccionada

RAG, context, and memory were bottlenecks in 2023–2024

Stamirowska says the team saw RAG, context, and memory as bottlenecks in 2023 and 2024. They were not efficient or sufficient for what she describes as 'AI with no ceiling, if you wish.'

Estas son perspectivas individuales, no una medida de consenso. El material fuente permanece en su idioma original.

Evidencia a favor

What Comes After Transformers?

Extracto original

But very concretely, what prompted us to start Pathway and to start working on post-transformer architectures was that we were looking forward to reasoning becoming a thing. We have a very strong background in dealing with the dimension of time in machine learning—any sort of online learning. And we saw RAG, context, and memory, and we’re talking about 2023 and 2024, as bottlenecks. They were not efficient or sufficient to unlock AI as we would like—AI with no ceiling, if you wish.

Las fechas corresponden a las fuentes, no a cambios de opinión. Los textos sin traducción revisada se mantienen en su idioma original.