Initech is adding an AI assistant to its CRM. Your call: which model settings do you fix before launch, and what will users run into if you get them wrong?
Key idea: An LLM predicts one token at a time inside a fixed context window.
Things to try
- Send the tagline prompt at temperature 0 three times, then at 1. Compare how much the answers vary.
- Set the temperature back to 0.7 and Max output tokens to 40, then ask for the list of 10 fruits. Watch it get cut off.
- Set Max output tokens back to 200, and set the context window to Tiny before your first message. Send the tagline prompt, then the token prompt, then ask what you asked first. Then start a new chat on Large and do the same.
- Type in the box and watch the token chips update. Try emoji, code, or a non-English word.
Try a prompt
Change how it works, then send again
0.7