PART 1: How to Improve the Performance of Your Sales & Support Agent

Modified on Wed, 15 Jul at 7:17 PM

Before making your Sales Agent or Support Agent live, it's important to thoroughly test their responses. Testing helps you identify missing information, improve response quality, and ensure your agents provide accurate answers to your customers.

Think of it as role-playing with a new employee before their first real shift. A good manager doesn't put a new hire on the phones on day one — they play the customer first: ask the common questions, throw in a tricky one, push back on the price, and see how the new hire handles it. Every stumble in rehearsal is one less stumble in front of a real customer. Testing your AI agent works exactly the same way.



? TipSpend time testing your agents before sending real visitors to them. A well-tested knowledge base leads to better customer interactions and higher-quality responses.

Before You Begin

Make sure you have completed these two setup steps:

  1. Create your Product Knowledge Base in Markdown (.md) format.
  2. Upload the Product Knowledge Base to the Vault and connect it to your Sales or Support Agent.

Once these steps are complete, you're ready to begin testing. (Both steps have their own guides — see Related Articles below.)

Follow These Steps

Step 1: Open the Chat Section

Navigate to the Chat section in your FlexiAgent dashboard and select the AI agent you want to test — for example, your Sales Agent or Support Agent. Then click + New Chat to begin a fresh conversation.

The Chat section in FlexiAgent with the Select agent dropdown and New Chat buttonThe Select agent dropdown open with the Sales and Support agents listed

Step 2: Ask Real Customer Questions

Think about the questions your customers ask most often and use those as your test cases. For example:

  • What are your business hours?
  • What are your pricing plans?
  • Which services do you offer?
  • Do you provide emergency support?
  • Where are you located?
  • How can I book an appointment?

The more realistic your questions, the better you'll understand how your AI agent performs.

Step 3: Test Different Conversation Scenarios

Don't limit yourself to basic questions. Try different customer situations to evaluate how the agent responds:

  • Asking about pricing
  • Requesting discounts
  • Asking for a payment link
  • Requesting to speak with a human representative
  • Comparing services
  • Asking follow-up questions
  • Raising objections

For example, try telling your Sales Agent:

"Your services are too expensive."

Observe how the agent responds and whether it handles the objection naturally.

✅ Why this mattersReal customers rarely ask one polite question and leave. They negotiate, compare you to competitors, change topics mid-conversation, and push back. An agent that answers "What are your prices?" perfectly but crumbles at "That's too expensive" isn't ready for real traffic. Scenario testing shows you how the agent performs in conversations, not just single questions.

Step 4: Test the Agent with Challenging Questions

Ask questions that may not be directly covered in your knowledge base. This helps identify missing information and areas where your Product Knowledge Base needs improvement. For example:

  • Can you explain your warranty policy?
  • Do you offer weekend appointments?
  • What payment methods do you accept?
  • Can I reschedule my booking?

If the agent provides incomplete or incorrect answers, you'll know exactly what information needs to be added.

Step 5: Generate Additional Test Questions with Claude

If you're unsure what to test, you can use the same AI conversation — in Claude, ChatGPT, or Gemini — that you used to create your Product Knowledge Base (with the Vault Knowledge Builder prompts). Since the AI already knows your business details from that conversation, it can create highly relevant test questions.

Simply ask it:

"Generate customer questions to test my Sales Agent."

The AI will create a list of realistic customer queries that you can copy and paste into your FlexiAgent chat. This is an effective way to uncover gaps in your knowledge base before going live.

Review Every Response

As you test, carefully evaluate each response. Ask yourself:

  • Is the answer accurate?
  • Is it complete?
  • Does it sound natural?
  • Would a customer find it helpful?
  • Is the response aligned with your business?

Make note of any responses that need improvement — a simple list of "questions the agent fumbled" becomes your to-do list for the next step.

Step 7: Update Your Product Knowledge Base

If you find missing or inaccurate responses, update your Product Knowledge Base with the necessary information. Common updates include:

  • Missing services
  • Updated pricing
  • Additional FAQs
  • Business policies
  • Contact details
  • Product features

After updating the file, replace the existing knowledge base in the Vault with the latest version. Your AI agent will automatically begin using the updated information.

⚠️ Reminder: Replacing means delete first, then uploadFlexiAgent doesn't support editing an uploaded file directly. To replace your knowledge base: delete the old file from the Vault, then upload the updated .md version, and let the enrichment process complete. See the full walkthrough in the Related Articles below.

Continue Testing

After uploading the updated knowledge base:

  1. Start a New Chat.
  2. Repeat your tests.
  3. Verify that the responses have improved.

Continue this test → update → re-test loop until you're satisfied with the quality and accuracy of your agent's answers. Most knowledge bases get dramatically better after just two or three rounds.

Best Practices

For the best results:

  • Test using real customer questions — your inbox and past support tickets are the best question bank you own.
  • Include both simple and complex scenarios.
  • Challenge the agent with objections and follow-up questions.
  • Test multiple conversation paths — the same question asked different ways.
  • Keep refining your Product Knowledge Base as your business evolves — and after going live, review real conversations in the Sessions tab to keep finding improvement opportunities.

Common Situations & Quick Fixes

❓ "The agent couldn't answer one of my test questions."That's the test working! Add the missing information to your .md knowledge base file, replace the file in the Vault (delete old → upload new), then re-test the same question in a New Chat.
❓ "I updated my knowledge base, but the answers didn't change."Check three things: (1) the old file was deleted before uploading the new one, (2) the enrichment process finished, and (3) you're testing in a New Chat — existing conversations may carry over earlier context.
❓ "I don't know what questions to test with."Two easy sources: your real support inbox (the questions customers already ask), and your AI assistant — return to your Vault Knowledge Builder conversation and ask it to generate test questions for your agent (Step 5).
❓ "The answers are accurate but don't sound right for my business."Response style often mirrors how your knowledge base is written. Reword the relevant sections in your file to match your preferred tone and level of detail — for example, add friendlier FAQ answers or more precise policy language — then replace the file and re-test.
❓ "How do I know when I'm done testing?"A good benchmark: the agent correctly answers your top 10-15 real customer questions, handles at least one pricing objection naturally, and knows what to do when someone asks for a human. When a full "mystery shopper" conversation ends without you wincing, you're ready to go live.

Was this article helpful?

That’s Great!

Thank you for your feedback

Sorry! We couldn't be helpful

Thank you for your feedback

Let us know how can we improve this article!

Select at least one of the reasons
CAPTCHA verification is required.

Feedback sent

We appreciate your effort and will try to fix the article