OpenAI says its Jalapeño chip beats Nvidia's GB300 on inference

OpenAI has published its first benchmark results for Jalapeño, its in-house inference chip built with Broadcom. The company claims that the chip does more AI work per watt and returns answers faster than the Nvidia GB200 and GB300 rack systems that it was measured against. How does OpenAI’s new chip perform? OpenAI has published benchmark...