Single-device Pareto curve for throughput and latency

Inside OpenAI’s First Chip

Extrait original

What we have in a single device—and I think this is really critical for our infrastructure and being able to lower the cost of the infrastructure—is a single device that can operate at both points, or at any point along that curve. We call it the Pareto curve between high throughput and low latency.