OpenAI’s Jalapeño chip is built for fast inference at scale, benchmarks show· OpenAI 的 Jalapeño 芯片为大规模快速推理而设计

Tested on SemiAnalysis’ InferenceX benchmark, Jalapeño registered both more tokens per user and more throughput per kilowatt than the currently available state-of-the art.