Voicebot testing

Test voicebots by phone call

gentesty calls your voicebot, holds the conversation like a caller and evaluates it. All you need is your bot's phone number.

Free plan: 1 bot and 10 test minutes per month for chat and phone, CHF/EUR 0.

Transcript of a voicebot test run in gentesty showing what both sides said
Transcript of a test call: the voicebot on the left, the gentesty caller on the right.

What is voicebot testing?

Voicebot testing checks whether a voicebot handles a request over the phone as expected. Unlike a chatbot, this also involves the phone line, speech recognition and speech output. A realistic test therefore calls the bot instead of just feeding text into its logic.

How gentesty tests a voicebot

Step 1

Add the voicebot

You enter the phone number your voicebot can be reached at. No technical integration is needed.

Step 2

Write a test scenario

You describe who is calling, what they want and what the outcome should be.

Step 3

gentesty calls

gentesty dials the number, waits until the voicebot speaks and holds the conversation like a caller.

Step 4

Read the result

You read the transcript, listen to the recording and see the evaluation of each expected statement.

The guide Test voicebots by phone shows every step with screenshots.

What a call test uncovers

Understanding

Do names, numbers and dates come through correctly, or does the conversation already fail at speech recognition?

Conversation flow

Does the bot answer in time, does it let the caller finish, does it get stuck in loops?

Outcome

Did the caller get what they called for, with the right confirmation or handover?

For how to build good test cases for a voicebot, see our article Voicebot testing: how to check a voicebot before go-live.

When voicebot tests pay off

  • Before go-live: The most important requests run as test calls before the first customer calls.
  • Before every release: The same calls show whether a change broke something.
  • After changing the language model, speech recognition or voice: Any of these components can make a conversation fail, even if the bot’s logic is right.
  • Continuously in production: Scheduled test runs call the bot regularly (Business and up).

Are you testing a chatbot? It has its own page: Chatbot testing.

Frequently asked questions about voicebot testing

Does the test need access to the systems behind the voicebot?

No. The test runs from the outside through the phone number. It checks the conversation the way a caller experiences it.

Which voicebot platforms are supported?

Any voicebot that can be reached by phone number. The platform it is built on doesn’t matter for the test.

How much does a voicebot test cost?

The Free plan includes 10 test minutes per month, phone calls included. On the Pay as you go and Business plans, a phone minute costs CHF/EUR 0.04, on top of the other costs of a test run. All details are on the Pricing page.

Which number does gentesty call from?

From a standard gentesty number in Switzerland that several customers share. With Business and Enterprise you can request your own number for your workspace, in Switzerland or the US; the Enterprise plan includes one.

Can I listen to the conversation afterwards?

Yes. Every test run comes with the recording of the call and the transcript.