Creating machine-learning topic detection models
Version:
Efficiently connect your customers with the right consultant by providing training data to a topic detection model.
The machine learning topic detection model teaches itself based on training data provided to it, and then starts analyzing text on its own. The training data contains sample messages from customers with an assigned topic category. For example, the model assigns the message I want to book a ticket from New York to Warsaw to the Booking a flight category.
If you do not have enough training data for the machine learning model to start operating efficiently, consider creating a keyword-based topic detection model as a temporary substitute. For more information about the differences between topic detection model types, see Comparing keyword-based and machine-learning topic detection.
- Ensure that the system locale language settings are set to UTF-8.
- Specify a repository for text analytics models. For more information, see Specifying a database for Prediction Studio records.
To create a topic detection model based on machine learning, perform the following procedures:
- Setting up a machine-learning topic detection model
Start the build process of a keyword-based topic detection model by specifying the model name, language, and corresponding ruleset.
- Defining a taxonomy for machine learning topic detection
Define the taxonomy that you want to use for topic detection. You can use an existing taxonomy, upload your own taxonomy file, or create a new taxonomy.
- Uploading data for training and testing of the topic detection model
Upload sample records to train the model and to test whether the model assigns the topics correctly.
- Defining the training and testing samples for topic detection
Split the uploaded data into a set for training the model and a set for testing the model accuracy.
- Training and testing the topic detection model
Select the algorithms that Prediction Studio uses to build the model, and then start the building process.
- Reviewing the topic detection model
Review the created model by analyzing the results of testing against the provided training data.
- Saving the topic detection model
Save the model to use it as part of the Pega Platform text analytics feature. You can also download a file that contains the model that you created.
- Analyzing natural language
Effortlessly analyze and extract meaningful information from large volumes of text with the use of text analytics. Based on your findings, you can further improve business performance and customer experience.
- Text analytics accuracy measures
Models predict an outcome, which might or might not match the actual outcome. The following measures are used to examine the performance of text analytics models. When you create a sentiment or classification model, you can analyze the results by using the performance measures that are described below.
- Testing text analytics models
You can perform ad-hoc testing of text analytics models that you created and analyze their performance in real-time, on real-life data.