Insights & Engineering

The Anyshift Blog.

Deep dives into Site Reliability Engineering, AI in production, and scaling infrastructure gracefully. Written by the team building the future of SRE.

Browse by Category

AI in Production

AI Context for Prod, Optimized by AIs in Prod

AI Context for Prod, Optimized by AIs in Prod

Annie (our AI SRE agent) had institutional memory from ACE, the agentic context-engineering loop that curates cheatsheets from past runs. It worked, but clients kept catching her trusting stale entries or missing answers buried in her own bloated context. So we added five things on top: (1) a fixed set of memory items always presented to the agent, (2) per-query retrieval over the rest of the memory store, (3) an agent-optimized index of that store, (4) the ability for the agent to query the store mid-run, and (5) tried-and-true memory freshness mechanisms. Production context, now optimized by the AI using it. Here's the reasoning and what a few weeks in production say.

Ghazi Felhi
Ghazi Felhi
Jun 10, 2026 · 10 min read

Stay ahead of the pager.

Get a monthly digest of our best engineering articles, SRE case studies, and Anyshift product updates. No spam, just signal.