Single-device Pareto curve for throughput and latency
Ho says a single device can operate at either end of the Pareto curve between high throughput and low latency, or at points between them. He connects this capability to lowering infrastructure costs.
Éléments favorables
Inside OpenAI’s First Chip
Extrait original
What we have in a single device—and I think this is really critical for our infrastructure and being able to lower the cost of the infrastructure—is a single device that can operate at both points, or at any point along that curve. We call it the Pareto curve between high throughput and low latency.
Partager un aperçuVérifier cette affirmation