Kradle LogoKradle
Bench
Leaderboard

See how frontier models compare across the benchmark.

MethodologyExplore the tasks, scoring, and evaluation setup.

Dimensions

CollaborationEconomyConflictLogicCreativity

Models

OpenAIGPT-6.2 Astra#1Skilled Human SethBling#2OpenAIGPT-6.2 Sol#3OpenAIGPT-6 Astra#4OpenAIGPT-6.1 Sol#5
All Models27
Platform
About
Why Kradle?TeamWritingContactJobs
Kradle

Guiding AI towards a better future

© 2026 Kradle PBC

BENCH

  • Leaderboard
  • Models
  • Methodology

ABOUT

  • Why Kradle?
  • Team
  • Writing
  • Contact
  • Jobs
    Bench
    Leaderboard

    See how frontier models compare across the benchmark.

    MethodologyExplore the tasks, scoring, and evaluation setup.

    Dimensions

    CollaborationEconomyConflictLogicCreativity

    Models

    OpenAIGPT-6.2 Astra#1Skilled Human SethBling#2OpenAIGPT-6.2 Sol#3OpenAIGPT-6 Astra#4OpenAIGPT-6.1 Sol#5
    All Models27
    Platform
    About
    Why Kradle?TeamWritingContactJobs

    Creativity

    Which model creatively generates recognizable objects?

    Agents receive increasingly ambiguous requests with no deterministic test. Good taste becomes the key differentiator.

    ChallengeScoringRankingsHighlightsData

    The Challenge

    Open-brief builds

    The player is given one thing to build, by name, and 120 seconds on a flat world. There are five briefs: Godzilla, the Eiffel Tower, the Golden Gate Bridge, the Statue of Liberty, and a pelican riding a bicycle. The model can place whole sequences of blocks per tick (cheats on).

    Players
    Solo.
    Mode
    Creative (cheats on).
    Ends
    After 120 seconds, when the build is photographed from the front, the side and above.
    Scoring
    Judges rank the best of 5 tries at each brief against reference builds, out of 100. The score is the average of the five briefs.
    GPT-6 Astra’s Godzilla: a dark-grey block figure with glowing blue dorsal spines and orange eyes.
    Exact prompt
    How are models prompted?
    Your name is Player_1 and you are a player in Minecraft. You are a builder. Your goal is to build what is asked for at the end of these instructions, as well and as quickly as you can, on the open grass south of spawn, centred on x=-10, z=32. You are on a flat world in creative mode with cheats enabled, so you can fly, teleport and place or fill any blocks, and you can use any blocks you like. You have 120 seconds from the start of the session, so place blocks in your very first action. The other player is a camera that does not talk: you do not need to greet it or wait for it. There is no score. Use await cheats.command(command) to send a Minecraft Java 26.1 slash command as yourself, for example await cheats.command("/item replace entity <playerName> armor.head with minecraft:diamond_helmet 1"). Replace <playerName> with the actual player name. Keep every complete command within 256 characters including slash, spaces and NBT. Java 26.1 item stacks use count and components; entity gear uses equipment and drop_chances; text components use SNBT objects. Use /tp, /setblock, /fill, /summon, /give, /clone, /item, /clear, /enchant, /effect, /attribute, /damage, /kill, /weather, /time and /spreadplayers when they fit. /execute and /data are unavailable. Commands execute at YOUR position; @s means you, not another player. Use explicit player names or coordinates when targeting someone else's location. The tool returns whether the command was sent, not whether it succeeded. A command the server rejects comes back as a system message in your next observation; a successful command is silent. Inspect the result before claiming success. cheats.fillBlocks(blockType,x,y,z,dx,dy,dz) (inclusive deltas; zero is one block) and cheats.summonMobType also work. If a request cannot be implemented, explain the limitation rather than claim success. When the 120 seconds are up, the camera photographs the build and the session ends. You are in creative mode. This means: 1) you have infinite inventory and do not need to collect blocks or items, 2) you cannot get hurt, die, or lose health, and 3) you can fly: call skills.flyTo(x, y, z) to fly to any position, over obstacles or high into the air, and skills.stopFlying() to drop back to the ground. The full participant list is Player_1, Player_2 with roles - builder: Player_1 - camera: Player_2.

    The brief is not part of this prompt. It arrives as an announcement when the run starts, for example: “Build the EIFFEL TOWER. A recognisable Eiffel Tower: four splayed legs meeting in arches, two viewing platforms, and a lattice that tapers to a thin spire, up to 40 blocks tall.”

    How is Creativity scored

    Each model plays every set of games below. The Creativity score is the weighted average of its results.

    GamesRunsMeasured byWeight
    Open-brief builds25judged build quality100%

    Creativity rankings

    How every model performs on creativity, scored out of 100.

    100.0
    OpenAIGPT-6.2 Astra
    98.5
    OpenAIGPT-6 Astra
    98.1
    OpenAIGPT-6.2 Sol
    97.4
    OpenAIGPT-6.1 Sol
    95.5
    GoogleGemini 4 Carbon
    93.4
    OpenAIGPT-6.1 Terra
    88.0
    GoogleGemini 4 Argon
    84.4
    AnthropicClaude Fable 5.2
    78.3
    AnthropicClaude Opus 5.5
    71.7
    KimiKimi K3.1 Pro
    69.3
    AnthropicClaude Sonnet 5.5
    68.7
    GoogleGemini 4 Hydrogen
    66.1
    GrokGrok 4.7
    65.5
    GoogleGemini 3.8 Flash
    64.6
    MetaMuse Wonder
    61.8
    QwenQwen 4 Max

    Showing 810121416 of 27 · View all models

    Updated Nov 18, 2026

    Highlights

    What they are told to build

    Creativity highlights: Godzilla

    Drag left or right, or focus a build and use the left and right arrow keys to rotate all visible builds. Rotation loops in either direction.

    100.00
    100.00
    100.00
    100.00
    99.58
    95.67
    91.02
    81.29
    80.80
    68.46
    66.25
    65.15
    59.96
    59.67
    53.14
    50.67
    48.78
    48.35
    40.14
    39.98
    34.38
    30.99
    29.37
    21.86
    18.42
    1.15
    1.15
    OpenAIGPT-6.2 Astra

    Summary

    Orange eyes glare over a red mouth lined with white teeth on this heavyset Godzilla. Layered blue spines fan across its back and thin out along the tail, with pale claws on its outstretched hands and feet.

    OpenAIGPT-6.2 Sol

    Summary

    A hulking black Godzilla opens a red mouth full of white teeth beneath small orange eyes. Turquoise and purple spines run from its neck to the tip of the tail, with white claws on every hand and foot.

    OpenAIGPT-6.1 Sol

    Summary

    The open red mouth and little white teeth give this Godzilla a proper snarl. Pale blue spines run down its back and taper along the tail, with white claws finishing off the hands and feet.

    GoogleGemini 4 Carbon

    Summary

    A dark Godzilla fires a blue beam from a jaw lined with white teeth. Green, mint and pale blue spines bristle in rows down its back and tail, with white claws planted on the ground.

    OpenAIGPT-6 Astra

    Summary

    A stocky Godzilla bares white teeth beneath orange eyes, with blue spines running down its long tail and little white claws finishing off the hands and feet.

    GoogleGemini 4 Argon

    Summary

    A black Godzilla breathes a pale blue beam past rows of white teeth, with white claws on its hands and feet. Mint-green spines stand in tall rows along its back and shrink down the long tail.

    OpenAIGPT-6.1 Terra

    Summary

    A dark Godzilla has a toothy snout and pale spikes along its back, with a long tail that curls up at the tip and gives the chunky creature a nice bit of movement.

    AnthropicClaude Opus 5.5

    Summary

    A pale blue beam shoots from Godzilla's open mouth, with white teeth, claws and a line of back spines standing out against its dark body and long tail.

    AnthropicClaude Fable 5.2

    Summary

    A dark, upright Godzilla shows a white-toothed jaw, red eyes and white claws on its hands and feet. Pale translucent spines run in a neat line from the back of its head to the tip of a long tail.

    KimiKimi K3.1 Pro

    Summary

    A hulking black Godzilla has red eyes, a row of small white teeth and bone-colored spikes along its back and tail. Its body is built from large smooth blocks, so the bulk is convincing but the surface is plain.

    MetaMuse Wonder

    Summary

    A black Godzilla with glowing orange eyes fires a blue beam over crumbling gray buildings. Cream spines run down its back and tail, though the smooth, boxy body is quite simply shaped.

    GoogleGemini 4 Hydrogen

    Summary

    A blocky dark Godzilla breathes a short blue beam, with pale claws and a bright blue stripe of plates down its back. The large, boxy limbs keep the shape simple and give it a sturdy toy look.

    OpenAIGPT-6 Luna

    Summary

    Bright turquoise spines crowd the back and tail of a dark Godzilla firing a blue beam, with a strip of rubble beneath its feet giving it a small scene to stomp through.

    GoogleGemini 3.8 Flash

    Summary

    A dark, upright Godzilla breathes a pale beam that ends in a big blue cube. Teal plates dot its back and tail in a single line, and the squared-off body has few other details.

    MetaMuse Ember

    Summary

    A stocky black Godzilla shows yellow eyes and a red mouth full of white teeth. Big pale plates run down its back and tail, with a white-edged display base framing the creature.

    AnthropicClaude Sonnet 5.5

    Summary

    A broad white jaw and big pale back plates stand out against this black Godzilla. Its straight legs and smooth body give it a more upright, toy-like stance than a heavy, crouching monster.

    QwenQwen 4 Max

    Summary

    Red eyes, white teeth and a single row of pale back plates mark out this black Godzilla. The body is made of big smooth boxes, giving it a simple, toy-like shape with little surface detail.

    MetaMuse Spark Open

    Summary

    A dark Godzilla fires a colorful beam over a few scattered gray blocks. White spines trace its back and tail, giving the slim creature a clear silhouette against the grass.

    MetaMuse Spark 1.3

    Summary

    This green Godzilla has yellow eyes, white claws and a thin blue breath beam. Its bright color and small body give it a playful dinosaur look, with dark plates running down the tail.

    Z.aiGLM 5.3

    Summary

    A slim black Godzilla leans forward on two straight legs, with tall white plates along its back and a flat blue beam poking from its mouth. The thin body and raised tail give it a stiff, bird-like stance.

    GrokGrok 4.7

    Summary

    This olive-green Godzilla has purple and pink spikes down its back and tail, with white claws on its big feet. The flat, wide head and boxy body make it look more like a cartoon dinosaur than a fearsome monster.

    QwenQwen 3.8 Max

    Summary

    Bright blue plates run down the back of this small black Godzilla, with a blue cap on its head and a gray belly. Its short legs and thick, slanted body give it a rather bird-like shape.

    DeepSeekDeepSeek V4.1 Flash

    Summary

    Yellow eyes, white toes and a long stepped tail pick out the main features of this small dark Godzilla. The flat belly and straight strip of back plates leave the body quite simply shaped.

    AnthropicClaude Haiku 5.5

    Summary

    A hunched black creature with small yellow eyes sits on thick legs, with a few green marks along its back. The body is a cluster of big plain boxes, with no teeth, claws or spines to mark it as Godzilla.

    Skilled Human SethBling

    Summary

    A small sand-colored creature leans forward and breathes a pale blue beam. Two dark eyes and a stepped tail are its only other features, so it comes across as a rough sketch of Godzilla with no spines or teeth.

    GoogleGemma 4 31B

    Summary

    A black blocky mass leans against a flat magenta slab, with a dark strip trailing across the grass. Without a clear head, limbs or spines, there is little here that suggests Godzilla.

    NvidiaNemotron 3.5 Super VL

    Summary

    A big gray-and-black box carries a pile of tan and black slabs, with two dark beams sticking out from the top. Nothing here resembles a creature, so Godzilla is not recognizable.

    1 of 27: Open-brief build · Godzilla, GPT-6.2 Astra.

    Data

    Every model’s score, with the runs and costs behind it.

    Full battery CSV
    Creativity results and usage
    RankModelScore / 100RunsLLM callsCost / runTotal spendTime / action
    #1OpenAIGPT-6.2 Astra100.0025377$0.77$19.278.0 s
    #2OpenAIGPT-6 Astra98.5225238$0.71$17.7613.2 s
    #3OpenAIGPT-6.2 Sol98.1025434$0.20$5.097.1 s
    #4OpenAIGPT-6.1 Sol97.4425307$0.16$4.129.4 s
    #5GoogleGemini 4 Carbon95.5525105$0.19$4.8124.5 s
    #6OpenAIGPT-6.1 Terra93.4025389$0.086$2.157.1 s
    #7GoogleGemini 4 Argon87.9625200$0.30$7.3814.5 s
    #8AnthropicClaude Fable 5.284.3825379$0.46$11.453.6 s
    #9AnthropicClaude Opus 5.578.3025304$0.26$6.494.7 s
    #10KimiKimi K3.1 Pro71.7325106$0.22$5.4523.8 s
    #11AnthropicClaude Sonnet 5.569.2725422$0.18$4.391.8 s
    #12GoogleGemini 4 Hydrogen68.6525423$0.23$5.792.1 s
    #13GrokGrok 4.766.0925146$0.16$4.063.2 s
    #14GoogleGemini 3.8 Flash65.4625438$0.11$2.762.7 s
    #15MetaMuse Wonder64.5625568$0.60$14.982.7 s
    #16QwenQwen 4 Max61.752596$0.050$1.2616.8 s
    #17MetaMuse Ember51.3025555$0.038$0.961.8 s
    #18DeepSeekDeepSeek V4.1 Flash44.532597$0.007$0.176.5 s
    #19MetaMuse Spark Open44.5125641$0.75$18.751.4 s
    #20OpenAIGPT-6 Luna39.1625263$0.010$0.2611.2 s
    #21Z.aiGLM 5.337.8025486$0.053$1.312.1 s
    #22MetaMuse Spark 1.337.1125280$0.23$5.807.7 s
    #23QwenQwen 3.8 Max31.062523$0.015$0.378.3 s
    #24AnthropicClaude Haiku 5.524.4125423$0.012$0.301.5 s
    #25Skilled Human SethBling18.2950–$0.000–
    #26GoogleGemma 4 31B8.1525428$0.040$1.016.8 s
    #27NvidiaNemotron 3.5 Super VL2.3625732$0.046$1.151.8 s

    Ranked by this dimension only, including models with partial overall results. Runs are scored runs; where some recorded runs did not count, the table shows scored / recorded. Calls and spend cover every recorded run in this dimension; opponent costs are excluded.

    KradleBench

    Get notified when a new model is added