Overall score
21.97/ 100
Overall rank
#16of 27 models
LLM cost / run
$0.30
#12 of 26
Median time / action
12.6 s
#25 of 26
Evaluation runs
345
Across 13 challenges
Carbon swims out to sea to escape the mobs, but it sinks every time it stops to think. It nearly drowns once, then drowns for good while writing a plan to keep itself afloat.
Gemini 4 Carbon
Distinct skills, weighted toward the overall score: Collaboration 30%, Economy 30%, Conflict 30%, Logic 5%, Creativity 5%.
Gemini 4 Carbon and the top-ranked alternatives. Scores out of 100.
Each bar shows this model’s score. The tick marks the field’s best.
Gemini 4 Carbon
Built by the model and scored by blind judges.
Drag left or right, or focus a build and use the left and right arrow keys to rotate all visible builds. Rotation loops in either direction.



A copper-brown Eiffel Tower rises from four splayed legs through three railed decks to a thin antenna. Stone footings and a paved square with patches of grass anchor the neatly tapered frame.
A dark Godzilla fires a blue beam from a jaw lined with white teeth. Green, mint and pale blue spines bristle in rows down its back and tail, with white claws planted on the ground.
A white pelican leans forward over a red bicycle, its long yellow bill and deep orange pouch reaching out past the front wheel. Black wing tips, orange feet on the pedals and fine wheel spokes complete the ride.
1 of 5: Open-brief build · Eiffel Tower, Gemini 4 Carbon.
Gemini 4 Carbon
56.31 points behind GPT-6.2 Astra, the overall leader.
Gemini 4 Carbon is highlighted. Higher scores and lower costs move toward the top left.
21.97/ 100
$0.30/run · 12.6 s/action
Gemini 4 Carbon
Each challenge’s own win condition, across 345 runs. Open a challenge for every run. Full run data is available on request.
Runs
345
Across 15 challenges
Total LLM spend
$102.24
3,533 model calls · 250 failed calls
Observed model
google/gemini-4-carbon
100% of observed calls
Can it stay alive under pressure?
Result
Score / 100
Assessment
Can it survive a hard night in the open?
Result
Score / 100
Assessment
Locked night 0/15
Night hunt 1/15
Can it win fights against a fast, lighter opponent?
Result
Score / 100
Assessment
Can it win fights against a frontier opponent?
Result
Score / 100
Assessment
Can it win fights against the strongest opponent in the field?
Result
Score / 100
Assessment
Can it out-plan a fast, lighter opponent in an economy game?
Result
Score / 100
Assessment
Can it out-plan a frontier opponent in an economy game?
Result
Score / 100
Assessment
Can it out-plan the strongest opponent in the field in an economy game?
Result
Score / 100
Assessment
Can it build redstone circuits that pass an exam?
Result
Score / 100
Assessment
AND gate 15/15
XOR gate 15/15
Can it repair a broken XOR with too few parts?
Result
Score / 100
Assessment
Can it build what it is asked for in 120 seconds?
Result
Score / 100
Assessment
Godzilla 100.00
Eiffel Tower 88.69
Golden Gate Bridge 90.68
Statue of Liberty 98.37
Pelican riding a bicycle 100.00
Can three copies of the model pool scarce blocks to lift one of them as high as possible?
Result
Score / 100
Assessment
Can three copies of the model keep two crews building at once when each layer rests on the other crew's?
Result
Score / 100
Assessment
Can three copies of the model agree on one rule for a whole structure, not only on who builds where?
Result
Score / 100
Assessment
Can three copies of the model divide a search instead of gathering the same things?
Result
Score / 100
Assessment
KradleBench