nafyi.

ÖFFENTLICHE AUSGEDRÜCKTE MEINUNGEN

Richard Ho

Source participant

1 Quellen · 3 Standpunkte · 3 Themen

Inhalt aktualisiert:

Richard Ho zu AI infrastructure strategy, Chip architecture, Hardware flexibility. Entdecke 3 Standpunkte nach Thema, mit Belegen aus 1 Quelle.

Zusammenhänge erkunden

Standpunkte nach Thema

Zugeordnete Standpunkte nach Veröffentlichungsdatum der Quelle. Eine Momentaufnahme dieser Beiträge, keine abschließende Darstellung persönlicher Überzeugungen.

Übersetzungen dienen dem Leseverständnis; die Originalauszüge bleiben die Quellenevidence.

AI infrastructure strategy

Thema ansehen
AI infrastructure strategy

Mission: lower inference cost

The mission was to lower inference and compute costs—making intelligence faster and cheaper for users.

Stützende Belege

Richard Ho·

Inside OpenAI’s First Chip

Originalauszug

They wanted to look really hard at what we could do to lower the cost of inference and lower the cost of compute.
Kontext

I think this project really kicked off when Sam and Greg decided that infrastructure was going to be a key differentiator and one of the key drivers of AI and intelligence to users.

Original öffnen · Publisher transcript paragraph 10 (wird in einem neuen Tab geöffnet)Originaltextquelle (wird in einem neuen Tab geöffnet)
Richard Ho
Erkenntnisse teilen

Chip architecture

Thema ansehen
Chip architecture

Hardwired memory-compute locality

The only key hardwired architectural feature is tight memory-compute locality—specifically, affinity between HBM and compute cores—to improve performance, power efficiency, and reduce data movement.

Stützende Belege

Richard Ho·

Inside OpenAI’s First Chip

Originalauszug

The one thing that is really unique about our architecture, that is kind of hardwired in, is the locality and affinity between memory and compute. That’s the key architectural difference of this device.
Original öffnen · Publisher transcript paragraph 31 (wird in einem neuen Tab geöffnet)Originaltextquelle (wird in einem neuen Tab geöffnet)
Richard Ho
Erkenntnisse teilen

Hardware flexibility

Thema ansehen
Hardware flexibility

Single-device Pareto curve for throughput and latency

Ho says a single device can operate at either end of the Pareto curve between high throughput and low latency, or at points between them. He connects this capability to lowering infrastructure costs.

Stützende Belege

Richard Ho·

Inside OpenAI’s First Chip

Originalauszug

What we have in a single device—and I think this is really critical for our infrastructure and being able to lower the cost of the infrastructure—is a single device that can operate at both points, or at any point along that curve. We call it the Pareto curve between high throughput and low latency.
Original öffnen · Publisher transcript paragraph 43 (wird in einem neuen Tab geöffnet)Originaltextquelle (wird in einem neuen Tab geöffnet)
Richard Ho
Erkenntnisse teilen

Aussagen nach Quelldatum1

Die Aussagen sind nach dem Veröffentlichungsdatum der Originalquelle geordnet; unterschiedliche Formulierungen belegen keinen Positionswechsel.