Testing and iteration in conversation design with ChatGPT

Conversation design is an iterative process. Automated agents are always changing and being improved. In this section, we’ll look at testing and improving our agents with ChatGPT.

Testing with ChatGPT

In the earlier sections, we saw that ChatGPT can be a valuable tool in streamlining the design process by creating dialogue to help us craft our designs. We can carry out a similar approach when we test our agent before deployment.

We often create our agents based on which questions we think they are going to be asked. This is even more likely to be the case if we are starting a conversational AI project from scratch with little or no training data. If this is the case, it’s even more important to test your agent before releasing your agent into the wild.

Even if the conversational AI project has internal testers, or if you can expose friends or family to your agent before alpha or beta releases, it’...