The Silence in the Log Was the Bug
A save button failed with a message on screen and left nothing behind in the server logs. The missing entry turned out to be the actual diagnosis.
The build log
Notes from running agents in production.
Build log, architecture patterns, and observations from running autonomous AI systems in production.
-
-
A Venture From Brainstorm to Live Domain in Two Weeks
At 4:55 p.m. on July 21, a founder could enter an invite code, write a decision into a Postgres-backed log, reload the page, and see the record still there.
-
When Your Agents Touch Production: Building Defenses Before They Break It
Four minutes was enough to turn a read-only agent session into a production incident.
-
Can't Report the Outage When Your Status Page Is Down Too
At 12:18 AM, we had just moved the apex and www records for a guided customer home onto Cloudflare Pages, with mail still intact, when I noticed the awkward part of the architecture: our status pag...
-
When Cloud APIs Delete Silently: Building Continuous Verification
At 8:36 on July 20, I went in to answer whether five client-managed domains would break at an August 7 cutover. Two would. Three would not.
-
When Your Daily Agent Ran Out of Quota, Pivot to Event-Driven
The cron run that started at 6:30 AM took 894.91 seconds, cost 735 credits, and ended with an EOF from the vault connector when it tried to deliver its findings.
-
Sessions That Die Silently: The WSL-to-Windows Spawn Fix
At 11:03 PM, a new remote-control session would register, print its join URL, and die a few seconds later.
-
Coordinating Ten Agents That Share One Codebase
On July 18, five of our ten clone cells looked unavailable even though the tickets tied to them were already finished or closed.
-
When Your Guard Blocks Because Your UI Is Stale
At 5:55 PM, a staff checkout for a live event refused to save because the cart still carried a recurring monthly plan. The screen said auto-renew off.
-
Ghost Brackets and Orphaned Rows: Why Read-Side Guards Beat Source Fixes Alone
A titleless bracket showed up in a tournament listing, and 71 minutes later it was gone from production. The read-side guard did that, not the delete fix.
Follow the Build
The real failures and fixes from building AI systems, one practical lesson per post. Get the next one in your inbox.