Testing AI that gives a different answer every time
Canva AI turns a request in plain words into calls to design tools, sometimes chaining several together. Any model or prompt change can quietly break those choices, and pass/fail tests can't see it.
- Eval pipelines
- LLM-as-judge
- Tool descriptions
- YAML + GitHub