Designing AI systems: the model is one component, five days

Week 11 adds a new kind of component to the toolkit, a large language model, and builds reliable products on top of one. AI features in production are distributed systems with new failure modes: a demo against production, the six failure modes, MegaMart Assist and its illustrative numbers, why 900 requests a minute can still hit a rate limit, how the week sits on Weeks 1 to 10, how the questions change, the injected refund, and the five days ahead.