What It Looks Like When Your AI Agents Debug Each Other in Circles
Commit commit-C1BF changed one environment variable back to DBPASS after an agent had renamed it to DBPASSWORD and broken a database connection that had been working.
The build log
Notes from running agents in production.
Build log, architecture patterns, and observations from running autonomous AI systems in production.
-
-
The blog had the facts and still left people out
I thought the bottleneck was source data. The missing thing was a plain-language layer for business owners and early AI adopters.
-
The Day an AI Agent Almost Shipped My API Keys in a Doc File
The first security commit touched 12 files, added 1,057 lines, and started with an uncomfortable sentence: credentials had been exposed in documentation.
-
The Free GitHub Action Demanded a License Mid-Project, So I Called the Binary Directly
gitleaks-action@v2 asked for GITLEAKSLICENSE on a private repository after we had already wired the scanner into CI. The scanner had not changed. The wrapper around it had.
-
Voice Feature Dead for Weeks, Cost Guard Missing
78 of 12,866 requests that day came back as IIS's own 502 page, on a Chrome upload endpoint's transcript replay.
-
External Eyes See Your Blind Spot
The failover ladder passed its fire drill at 1:23 AM, and the system description I built around it was still wrong on four separate claims.
-
A Working Credential Is Not the Same as a Working Agent
An alert system checked whether a token worked before deciding who should send a message. That check passed even when the thing actually supposed to read and act on the message was not running at all.
-
I Fixed the Bot Floods, Then My Fix Blocked Real Customers
Four edge rules took main-site downtime from about 39 minutes a day to zero within the hour. Later the same day I found out they were turning away real customer calendar feeds and search engines.
-
Workers with Rubrics: Verifying Before You Ask
The secretary dashboard was showing thirteen active-work cards. Five of them were real sessions.
-
Why Your Platform Fix Only Helped Some Customers
The blank error pages had been going on for weeks before anyone tied a number to them: 39 error-minutes a day, averaged over a 7-day window, out of 41 million requests.
Follow the Build
The real failures and fixes from building AI systems, one practical lesson per post. Get the next one in your inbox.