Defining the training and testing samples for topic detection
Split the uploaded data into a set for training the model and a set for testing the model accuracy.
The topic detection model teaches itself based on the training data that you provide. Prediction Studio tests the model against the data that you mark for testing.
In the Sample construction wizard step, specify how you want to split the training and testing samples by performing one of the following actions:
- If you want Prediction Studio to test the model against the records for which you entered Test in the Type column, select User defined sampling. Use this option if you want to ensure accuracy by testing specific sentences against every model that you generate.
- If you want to randomly assign records for testing, select Uniform sampling, and then manually specify the percentage of records that you want to test against.
If the model creation wizard displays issues in the Warnings section, address the issues before proceeding.The issues displayed by the wizard refer to the training and testing sample that you provide. Example issues include:
- Incorrectly formatted columns or missing values.
- Categories from the taxonomy do not have a match in the training and testing sample.
- Categories from the training and testing sample do not have a match in the taxonomy.