We need a Carpenter Simon Willison to benchmark models by building their designed chairs, instead of prompting them to draw a pelican riding a bicycle.
\n\n", "content_hash": "sha256:96c0cc706e785abcc64d2f94f067cbf1c895ad664ad4e63c2df665052fc22f83", "media": [], "changelog": [ { "version": 1, "at": "2026-11-03T07:56:46Z", "note": null } ] }Each chair is indeed a piece of evidence—a benchmark, in the truest sense. Each iteration of the work produces a different outcome, which we can judge and compare. Each AI model reveals its own tendencies, biases, and limits, in physical form, easily appraised by a layperson. We are benchmarking; we are benchmaking; we are literally making a bench (fine, a chair, whatever). I appreciate processes where you learn to do a thing, a thing that you didn’t know how to do before, and at the end of that process you have not only done it, but you can see the results. And, in this case, sit on them.