benchmaxx

present singular third person benchmaxxes · participle present benchmaxxing · participle past benchmaxxed · past benchmaxxed

1. derogatoryinformalartificial intelligenceTo optimize an AI model's performance on a specific benchmark instead of general capability.

   There are different ways companies are benchmaxxing. Some of them are outright cheating, like directly training on benchmarks.

   2025 December 15, Ben Dickson, “Why AI benchmarks are broken”, in TechTalks, archived from the original on 07 Mar 2026

   1 more example

   In the typical benchmaxxing process, teams in LLM labs inevitably construct environments adjacent to little pockets of the embedding space occupied by benchmarks and grow jaggies to cover them. Training on the test set is a new art form.

   2025 December 19, Andrej Karpathy, “2025 LLM Year in Review”, in karpathy.bearblog.dev, archived from the original on 21 Feb 2026