Temas / Hardware flexibilityPunto de vista parafraseado
Single-device Pareto curve for throughput and latency
Ho says a single device can operate at either end of the Pareto curve between high throughput and low latency, or at points between them. He connects this capability to lowering infrastructure costs.
Detrás de la opinión
Las traducciones son para facilitar la lectura; los extractos originales siguen siendo la source evidence.
Inside OpenAI’s First Chip
Extracto original
What we have in a single device—and I think this is really critical for our infrastructure and being able to lower the cost of the infrastructure—is a single device that can operate at both points, or at any point along that curve. We call it the Pareto curve between high throughput and low latency.