Cut the Bill
Initech's support bot costs too much.
Pick three moves. The bot answers 24 tickets you can't see, and the bill and the eval score come from real model runs.
Your plan
Cut the bill 90% and keep the eval score at 95 or higher: the bot can miss one ticket in 24. Pick 3 moves.
0 plans so far
Need a refresher?
- Model Routing
Most requests don't need your biggest model. Route easy ones to a cheap model and hard ones to a strong one, and you keep most of the quality for a fraction of the cost. The catch: hard requests that look easy.
Open the lesson(opens in a new tab) - Prompt Caching & Cost
You pay for every token in and out. Caching makes a repeated prompt start much cheaper, if you build prompts for it.
Open the lesson(opens in a new tab) - Evaluating AI Changes
An eval is a fixed test set plus graders, giving a score you can compare across changes.
Open the lesson(opens in a new tab)
What the bot did
Pick three moves and run the bot. It answers 24 tickets you can't see, and the numbers are from real recorded runs.