Testing the Chat AI

The Test tab shows what visitors would get from the AI agent before they get it. Try any question, keep the important ones as saved tests, and re-run them all after you change your articles, guidance, knowledge sources, rules or actions.

Go to Inbox, then Messenger settings, then the Test tab.

Try a question

Type a question a visitor would ask, for example "How do I reset my password?", and click Ask. The result shows:

Click Save as a test to keep the question.

Saved questions

Add questions with Add question, or paste a list with Add several (one question per line). Changes to saved questions save by themselves. Each question has an expectation:

ExpectationUse it for
Should answerQuestions your articles cover
Should say it doesn't knowThings your articles deliberately don't cover, so the AI must not guess
Should hand off to a personQuestions that must reach your team, such as those caught by a handoff rule

For questions that should be answered, you can add two optional checks:

Run your tests

Click Run on one question, or Run all to re-check every question. Each is marked:

A summary of passes and failures appears at the top, and each question keeps its last result.

The Test tab with a question box and three saved questions: two marked Pass and one marked Fail with its reason, each showing the answer, sources and what was searched for
Messenger settings, Test tab

What tests do and don't do

When a test fails

For questions real visitors asked that the AI couldn't answer, see Chat Reports. See also Configuring the Chat AI Agent.