Testing Changes

Use Guideline Studio to preview how your AI will behave before making changes live.

Before publishing any updates to your AI guidelines, we recommend testing them to avoid unexpected behavior in production.

The Guideline Studio lets you simulate how your changes will affect AI responses using a set of sample questions—allowing you to preview the impact before going live.

⚠️ Only trying to fix one specific wrong answer? You may not need to change your guidelines at all. Consider using our FAQs and human feedback feature instead—it's ideal for correcting individual answers without broad changes to AI behavior.

💡 New to writing guidelines? Check out our Best Practices for Writing Guidelines to learn how to write clear, effective instructions for the AI.

See the guideline studio in action

---

1. Make Your Guideline Changes

Navigate to the AI Settings page and adjust your guideline configurations as needed. Once you're ready to test:

➡️ Click Test Changes to begin the testing workflow.

AI guidelines page with the test changes button

---

2. Add Test Questions

You’ll be prompted to add test questions—common examples your customers might ask. These will be used to evaluate the impact of your guideline changes.

Add your questions and view previous evaluations

🌟 Tip: Use questions that represent edge cases, high-volume inquiries, or known problem areas.

On this screen, you’ll also see an option to View Past Test Results, allowing you to quickly review the outcomes of previous test runs for context or reference.

---

3. Run the Test

Once your questions are added, click Save and Continue. The test will begin, and you’ll see responses generated using both the old and new guideline versions.

See the results of your guidelins evaluation

---

4. Compare Results

After the test completes, you’ll see side-by-side comparisons of responses for each test question—old guidelines on the left, new ones on the right.

Compare answers from the new guidelines to the current live guidelines

---

5. Compare Guidelines Directly

Want to see exactly what changed in your settings? Click Compare Guidelines to view your previous and updated configurations side by side.

Compare your new and current live guidelnies

---

6. Publish or Make Further Edits

If you're happy with the test results, click Publish Settings to go live with your changes. A confirmation modal will appear for final review.

Publish the new guidelines to your live AI agent

If you’d prefer to make further changes, click Back to Configure AI Agent Settings. Your unsaved changes will be preserved, and you can continue refining and re-testing.

---