AhmedOSProjectsRésuméContact
Spot the Flaw

Spot the Flaw

A quiz built from Ahmed's own errata: read a real bug, name the measurement trap behind it.

Open Spot the Flaw ▸

The six traps

Every project on this site shipped a number that didn't survive a second look. The quiz shows you the real erratum with the project's name hidden, and you name the trap. The answer key is Ahmed's own write-up, What Checking 64 Projects Found, which files each project under one of these patterns:

  1. Toy inputs, not real files: Run It On The File People Actually Have (4 errata)
  2. Saw the answer key: The Benchmark Could See The Answer Key (5 errata)
  3. Nobody can rerun it: A Number Nobody Can Rerun Is A Claim (2 errata)
  4. Fix never ran: The Fix Was In A Module Nothing Imported (3 errata)
  5. Only tested one way: Sensitivity Without Specificity Is Not A Result (4 errata)
  6. One lucky seed: One Seed Is An Anecdote (3 errata)

21 questions from 21 projects. Six rounds per game; five right earns the badge.