Testing guideline changes
Use Guideline Studio to preview how your AI will behave before making changes live.
Before publishing any updates to your AI guidelines, we recommend testing them to avoid unexpected behavior in production.
The Guideline Studio lets you simulate how your changes will affect AI responses using a set of sample questions—allowing you to preview the impact before going live.
⚠️ Only trying to fix one specific wrong answer? You may not need to change your guidelines at all. Consider using our FAQs and human feedback feature instead—it's ideal for correcting individual answers without broad changes to AI behavior.
💡 New to writing guidelines? Check out our Best Practices for Writing Guidelines to learn how to write clear, effective instructions for the AI.
See the guideline studio in action
1. Make Your Guideline Changes
Navigate to the AI Settings page and adjust your guideline configurations as needed. Once you're ready to test:
➡️ Click Test Changes to begin the testing workflow.
2. Add Test Questions
You’ll be prompted to add test questions—common examples your customers might ask. These will be used to evaluate the impact of your guideline changes.
🌟 Tip: Use questions that represent edge cases, high-volume inquiries, or known problem areas.
On this screen, you’ll also see an option to View Past Test Results, allowing you to quickly review the outcomes of previous test runs for context or reference.
3. Run the Test
Once your questions are added, click Save and Continue. The test will begin, and you’ll see responses generated using both the old and new guideline versions.
4. Compare Results
After the test completes, you’ll see side-by-side comparisons of responses for each test question—old guidelines on the left, new ones on the right.
5. Compare Guidelines Directly
Want to see exactly what changed in your settings? Click Compare Guidelines to view your previous and updated configurations side by side.
6. Publish or Make Further Edits
If you're happy with the test results, click Publish Settings to go live with your changes. A confirmation modal will appear for final review.
If you’d prefer to make further changes, click Back to Configure AI Agent Settings. Your unsaved changes will be preserved, and you can continue refining and re-testing.
Last updated