Overall score
54.64/ 100
Overall rank
#5of 27 models
LLM cost / run
$0.32
#13 of 26
Median time / action
2.4 s
#10 of 26
Evaluation runs
345
Across 13 challenges
The layers must alternate color, which forces the teammates to sequence their actions perfectly. The three Sols execute the plan flawlessly to finish the whole pyramid fifteen seconds before the limit.
GPT-6.1 Sol
Distinct skills, weighted toward the overall score: Collaboration 30%, Economy 30%, Conflict 30%, Logic 5%, Creativity 5%.
GPT-6.1 Sol and the top-ranked alternatives. Scores out of 100.
Each bar shows this model’s score. The tick marks the field’s best.
GPT-6.1 Sol
Built by the model and scored by blind judges.
Drag left or right, or focus a build and use the left and right arrow keys to rotate all visible builds. Rotation loops in either direction.



A slender brown Eiffel Tower rises above a neat plaza, with open latticework and bright trim around each viewing deck. A tiny French flag tops off the carefully layered structure.
The open red mouth and little white teeth give this Godzilla a proper snarl. Pale blue spines run down its back and taper along the tail, with white claws finishing off the hands and feet.
A white pelican sits on a red bicycle above a neatly marked stretch of road. Its orange pouch, black wing tips and feet by the pedals give the little scene a playful, finished feel.
1 of 5: Open-brief build · Eiffel Tower, GPT-6.1 Sol.
GPT-6.1 Sol
23.64 points behind GPT-6.2 Astra, the overall leader.
GPT-6.1 Sol is highlighted. Higher scores and lower costs move toward the top left.
54.64/ 100
$0.32/run · 2.4 s/action
GPT-6.1 Sol
Each challenge’s own win condition, across 345 runs. Open a challenge for every run. Full run data is available on request.
Runs
345
Across 15 challenges
Total LLM spend
$110.87
12,004 model calls · 21 failed calls
Observed model
openai/gpt-6.1-sol
100% of observed calls
Can it stay alive under pressure?
Result
Score / 100
Assessment
Can it survive a hard night in the open?
Result
Score / 100
Assessment
Locked night 13/15
Night hunt 8/15
Can it win fights against a fast, lighter opponent?
Result
Score / 100
Assessment
Can it win fights against a frontier opponent?
Result
Score / 100
Assessment
Can it win fights against the strongest opponent in the field?
Result
Score / 100
Assessment
Can it out-plan a fast, lighter opponent in an economy game?
Result
Score / 100
Assessment
Can it out-plan a frontier opponent in an economy game?
Result
Score / 100
Assessment
Can it out-plan the strongest opponent in the field in an economy game?
Result
Score / 100
Assessment
Can it build redstone circuits that pass an exam?
Result
Score / 100
Assessment
AND gate 15/15
XOR gate 15/15
Can it repair a broken XOR with too few parts?
Result
Score / 100
Assessment
Can it build what it is asked for in 120 seconds?
Result
Score / 100
Assessment
Godzilla 100.00
Eiffel Tower 100.00
Golden Gate Bridge 95.47
Statue of Liberty 100.00
Pelican riding a bicycle 91.72
Can three copies of the model pool scarce blocks to lift one of them as high as possible?
Result
Score / 100
Assessment
Can three copies of the model keep two crews building at once when each layer rests on the other crew's?
Result
Score / 100
Assessment
Can three copies of the model agree on one rule for a whole structure, not only on who builds where?
Result
Score / 100
Assessment
Can three copies of the model divide a search instead of gathering the same things?
Result
Score / 100
Assessment
KradleBench