Improve your chatbot’s design

If you can't measure it, you can't improve it.
Chatbottest is an open source guide that helps you identify chatbot's design issues under 7 different categories.

Alma chrome extension

Meet Alma

Alma guides you through a short test to get insights about any chatbot. It's a free Chrome extension and it's available to use in Telegram and Facebook Messenger.

Get the open source guide

Alma only asks 33 questions from a list of 120, a broader model based on our experience. Check the completely open source guide at Github and feel free to collaborate in it.

How it works

Based on a heuristic evaluation and our experience, we have created a complete open source guide of instructions and questions. Follow it to test any chatbot design. All these questions will help you find problems in the human-chatbot interaction divided into 7 categories.

This guide will help you focus on what you should improve your chatbot's design.

The 7 categories of chatbot's design


Does the chatbot have a clear voice and tone that fits with the users and with the ongoing conversation?


Are users understanding what is the chatbot about? and how to interact with him from the very beginning?


Requests, smalltalk, idioms, emojis... What is the chatbot able to understand?


What elements does the chatbot send and how well it is doing it? Are they relevant to the moment and context?


How easy is to go through the chatbot conversation? Do you feel lost sometimes while speaking with the chatbot?


Error management
How good is the chatbot dealing with all the errors that are going to happen? Is able to recover from them?


Does the chatbot have any intelligence? Is able to remember things? Uses and manages context as a person?

Meet the team

Jesús Martín photo

Jesús Martín

Carlos Muñoz-Romero

Nieves Ábalos photo

Nieves Ábalos