09-11-2023 ChatBot Load Testing Report

Even chatbots should be load tested - example of what we do

Here are some load testing results from our chatbot testing last September. We generate these using C# and Azure DirectLine

Summary

The goal of this load testing is to demonstrate Chime V5's scalability to handle significant load between support agents and end-users in a large enterprise.

Typically, our Chime customers route, or receive, approximately 1% of the total employee population\user base, as inbound conversations for day. In this example, our load test demonstrates Chime V5 routing approximately 1,000 inbound service desk chats in a brief 4 hour period.

• Outcome: Handled 1,101 chats in 4 hours and 40 minutes.

Overview

• Total Chat Sessions: 1,101

• Load Test Duration: 4 hours and 40 minutes

• First Chat Started: 9/11/2023 08:58:00

• Last Chat Started: 9/11/202313:38:00

Wait Times

• Maximum Wait Time: 1 minute and 53 seconds

• Minimum Wait Time: 3 seconds

• Average Wait Time: 8 seconds

Automated Agent Performance

Chatbots need to perform - so they need load testing - we use C#

Our C# load testing application simulates real user load (chat sessions) and forces the engine to handle many concurrent chats over a long period of time