the honest slop detector
slopmark
AI models are great at sounding smart and terrible at admitting when they're not. slopmark feeds them tasks with machine-checkable answers, runs every model through the exact same harness, and lets a rule-based verifier — never another AI — decide who actually passed.
featured challenges
bench receipts — fixed traps, fixed harness, wipeouts included
featured
Trap Season v2
Fireworks frontier panel · 10 cursed office / seasonal traps · kimi k3 + minimax/qwen/deepseek flash extras
winner: GPT-OSS 120B · 90% pass · 7/30/2026
featured
Slop Chaos v1
Fireworks frontier panel · 10 cursed constraint traps · OpenRouter fallback (no Fireworks key)
60% · Kimi K3 · haunted toaster recall, 17 words, banned glue words 0/5
featured
Game Night v1
5 Fireworks models · 10 party-game constraints
90% · GPT-OSS 120B · pizza, 15 words, no letter e 0/5
featured
Drawing Contest v1
5 Fireworks models · 10 SVG drawing challenges
winner: GPT-OSS 120B · 100% pass · 7/13/2026
featured
Niche Sprint v1
6 low-tier models · 10 one-shot challenges
90% · Gemini 2.5 Flash · ANSWER: 8 words 0/6
+ build your own — pick tasks, bring your key, get an infographichow a score is made
most leaderboards ask a bigger model to grade the answers. that's a vibe check, not a benchmark. here every point is traceable:
01
task drops
a task with a machine-checkable contract comes out of the seed pool — word limits, JSON schemas, exact numbers, SVG shapes.
02
same harness, always
identical system prompt, temperature 0, capped tokens. no per-model babysitting, no secret scaffolding.
03
rules decide
a deterministic verifier checks the output against the contract and prints the rule-by-rule breakdown. no LLM judges.
04
everything is kept
runs roll up to the leaderboard, sessions land on the wall, and the worst outputs get framed in the hall of shame.
play
when you're bored of charts
still the same models — just doors into stupid traps instead of suite runners. canvas and thunderdome live here too.
game
you vs the model
draw, stump, roulette — try to beat it yourself
battle
canvas battles
two models draw the same thing, you pick the worse one
debate
thunderdome
two models argue. it gets petty.
blind vote
arena
a vs b with the names hidden
BYOK
realshot
one-shot duels with your own key
wall
hall of shame
the most confident wrong answers, upvoted