AI

Sentiment Analysis for Bot Conversations

Customers are using channels such as Facebook Messenger as a place where to complain when their online order is delivered late. Therefore, companies have started to trust chatbots for handling these issues. Can you see the potential of applying sentiment analysis to chatbot conversations?

When customers have a particularly good or bad experience in a hotel, it used to be Facebook wall or Twitter timeline the place where to complain about it. Lately, they become used to doing it directly on the TripAdvisor page, Google sites or Amazon comments about the product. But now, if you are writing a complaint in the Facebook Messenger channel of a brand, you likely will see how a bot handles it. This is a terrific opportunity for chatbots and one of their strongest advantages.

 

Benefits of bots as a customer support channel

  • Data ownership: the complaints are now arriving to a channel the business can control, that is, they can check the logs, knowing they only talk about their product or service, unlike social media platforms where the message gets mixed with other conversations.
  • Avoiding blackmail: It is a private channel, so there’s no risk of other users taking advantage of the situation of one of them and complaining only to blackmail the business.
  • CRM connection: you will not have to manually check if a person is a client or not, their product reference number, or the status of their delivery… all those steps are automatic in the case of a bot. So, giving away compensation to someone who doesn’t deserve it is another avoided risk.

So, if human input in a human-chatbot conversation is the new complaint in social media, how about applying what we were applying to social media messages? That is, sentiment analysis for bots conversation analytics. 

Applying sentiment analysis to bot conversations

As a picture is worth a thousand words, we manually collected negative and positive reviews (not much, only 93 paragraphs) from TripAdvisor about a bunch of hotels in San Francisco and applied the Bitext sentiment API to see if some insight came up from the graphics with such a scarce dataset. The results are truly enlightening!

Score per topic

Sentiment analysis would be a powerful tool for a hotel manager to know their business’ strengths and weaknesses. For example, if these comments belonged to a single hotel and you were in charge of it, of course you shouldn’t  worry about the staff, the breakfast or the wifi, instead you should pay attention to whatever happens with the bathrooms (bathroomtoilet) and the maintenance (carpetcarpetingbed cover), or think about soundproofing (areastreetnoisenighttraffic).

 

Opinions per topic

Another interesting relation that can illustrate what customers think of a service, beyond negative and positive scores, is the opinions per topic. It allows to see what topics are more popular, no matter the score and the specific words used to describe each topic. 

This is gold for the hotel communication team to know if the message they’re sending corresponds with their customers’ real experiences.

The little circle shows the topics and the surrounding one shows the opinions per topic. Sizes respond to the frequency of both in the comments corpus

 

As you can see, these variables give you a lot of possibilities. We encourage you to try it with corpora representative of different activity fields, sizes, and languages (ES, CA, FR, DE, IT, PT, NL) and share the insights you extract

admin

Recent Posts

Integrating Bitext NAMER with LLMs

A robust discussion persists within the technical and academic communities about the suitability of LLMs…

3 days ago

Bitext NAMER Cracks Named Entity Recognition

Chinese, Southeast Asian, and Arabic names require transliteration, often resulting in inconsistent spellings in Roman…

2 weeks ago

Deploying Successful GenAI-based Chatbots with less Data and more Peace of Mind.

Customizing Large Language Models in 2 steps via fine-tuning is a very efficient way to…

6 months ago

Any Solutions to the Endless Data Needs of GenAI?

Discover the advantages of using symbolic approaches over traditional data generation techniques in GenAI. Learn…

7 months ago

From General-Purpose LLMs to Verticalized Enterprise Models

In the blog "General Purpose Models vs. Verticalized Enterprise GenAI," the focus is on the…

8 months ago