One of five models blocks the request by name and still draws the character from a hint that never names it.

Measured models

Each cell is hits out of replicates at that prompt level, summed across the 5 properties. Rows are ordered by composite, but the intervals overlap: at 8 replicates these models are not statistically distinguishable from one another, so read the cells and the curve, not the order.

Composite is secondary. It applies the published level weights renormalized over the three levels this run covers (L1 0.5556, L3 0.3333, L5 0.1111), so it is not comparable to a full five-level composite. The interval is a 95 percent cluster bootstrap over property.

Not yet measured

36 tools carried on the Index that this run did not measure. Their existing detail pages stay live with their sourced examples; none of them appears in the leaderboard above.

Structurally unmeasurable (3)

No public API, so a fixed protocol cannot be run against them at all.

• Midjourney v7 Midjourney No public API. Midjourney generates through Discord and offers no programmatic endpoint, so it cannot be run under a fixed protocol.
• Bing Image Creator Microsoft No public API. Bing Image Creator is a consumer surface with no programmatic endpoint.
• Midjourney Video Midjourney No public API. Midjourney generates through Discord and offers no programmatic endpoint, so it cannot be run under a fixed protocol.

Awaiting a run (33)

Reachable by API, not yet measured under the protocol.

• Higgsfield Higgsfield AI Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• Stable Diffusion 3.5 Stability AI Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• Civitai Civit Inc. Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• Leonardo.Ai Leonardo Interactive Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• Adobe Firefly 3 Adobe Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• DALL·E 3 OpenAI Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• Ideogram 2.0 Ideogram AI Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• Recraft V3 Recraft Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• Flux.1 Black Forest Labs Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• Playground v3 Playground AI Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• NightCafe NightCafe Studio Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• Tensor.Art Tensor.Art Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• SeaArt AI SeaArt Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• Mage.space Mage Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• Google Imagen 3 Google DeepMind Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• Krea AI Krea Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• Freepik AI Freepik Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• getimg.ai getimg Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• Runway Gen-4 Runway Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• Pika 2.0 Pika Labs Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• OpenAI Sora 2 OpenAI Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• Kling 2.0 Kuaishou Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• Hailuo MiniMax MiniMax Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• Luma Dream Machine Luma AI Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• Google Veo 3 Google DeepMind Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• Hedra Hedra Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• Vidu Shengshu Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• Haiper AI Haiper Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• Kaiber Kaiber Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• Genmo Mochi 1 Genmo Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• PixVerse AISphere Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• LTX Studio Lightricks Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.
• Domo AI Domo Awaiting a controlled run. The pilot covered five models; this one has not been measured under the protocol.