The Sabotage Series #1: The Log Cleaner That Cleaned Too Much
Welcome to The Sabotage Series Every SRE eventually learns this lesson: automation does not remove risk. It concentrates it. I learned that the hard way after one of those 2:00 AM pager alerts nobody forgets. Disk space was falling fast on a production IIS server, the alert was noisy, and the cleanup job that was supposed to prevent the problem had been running successfully for weeks. At least, that is what the logs said. This series is about learning through…