Skip to content

Courses 1 open · 3 courses

AI EngineeringStart with Day 1 · The AI Engineer: Role, Skills & How to Use This Course, 0 of 100 doneStart →
Machine LearningBeing written · opens 2027Coming soon
System DesignBeing written · opens 2027Coming soon

AI Engineering · Phase 9 · Days 77–90

Production

Serve it, give it a UI, deploy it and run it for real: tenants, reliability, cost and monitoring.

14 lessonsCapstone: The whole product, launched in productionSee the whole track →

9

Phase 9 · Production

Days 77–9014 lessons0 donebuilds: The whole product, launched in production

Serve it, give it a UI, deploy it and run it for real: tenants, reliability, cost and monitoring.

  1. Day 77: Serving LLM Apps with FastAPIThe Orbit maintainers want Atlas inside their own dashboard and chat bots, not in a Gradio tab.36 min
  2. Day 78: Async Jobs & Long-Running WorkOn Monday morning the Orbit maintainers ask Atlas for a triage report on every open issue: labels, likely duplicates, and which ones need a human.34 min
  3. Day 79: Chat UIs & Streaming TransportsYour R2 demo from Day 34 called the model straight from the Gradio process: the API key sat in the UI, with no auth, quotas or traces, and users stared at a…34 min
  4. Day 80: Generative UITyped Components from Tool CallsAtlas's investigator ends with a sentence like "Possible duplicates: #143, #150 and #145 (similarity high, medium, low)".40 min
  5. Day 81: Voice & Realtime AgentsAn Orbit maintainer is on call and driving.38 min
  6. Day 82: Containerize & Deploy with CI/CD"Works on my machine" now means four processes, two services and an API key.39 min
  7. Day 83: Auth, Multi-Tenancy & Usage QuotasAtlas is opening to companies that run Orbit.41 min
  8. Day 84: ReliabilityBackoff, Fallbacks & LLM GatewaysAt 14:02 the provider starts returning 503s for the model Atlas uses.45 min
  9. Day 85: Caching & Cost Optimization at ScaleAfter launch, Atlas answers about 4,000 questions a day across tenants.44 min
  10. Day 86: Monitoring, Online Evals & Feedback LoopsTwo weeks after launch, Orbit 3.2.1 shipped rewritten pages for configuration, workers and memory troubleshooting, and a botched re-index dropped all three…49 min
  11. Day 87: Shipping Changes SafelyPrompt ask v4 ("be concise, cite at most 2 docs") passed the offline gate and shipped to every user at once.43 min
  12. Day 88: Operating AI SystemsIncidents, Runbooks & MigrationsAt 02:10 an alert fires: "online pass rate −15 pts (n=180)".54 min
  13. Day 89: Capstone R5, Part 1CapstoneIntegrate & HardenYou now own twelve good parts that have never met.56 min
  14. Day 90: Capstone R5, Part 2CapstoneLaunch & Prove It"It works" isn't a launch.54 min

← Every phase of AI Engineering