Connect to large streams of real-time event and customer data to make your strategies and models more accurate.
To process decision management data in real-time, create Kafka and Kinesis data sets.
- Creating a Stream data set
Process a continuous data stream of events (records) by creating a Stream data set.
- Creating a Kafka data set
You can create an instance of a Kafka data set in the Pega Platform to connect to a topic in the Kafka cluster. Topics are categories where the Kafka cluster stores streams of records. Each record in a topic consists of a key, value, and a time stamp. You can also create a new topic in the Kafka cluster from the Pega Platform and then connect to that topic.
- Creating a Kinesis data set
You can create an instance of a Kinesis data set in Pega Platform to connect to an instance of Amazon Kinesis Data Streams. Amazon Kinesis Data Streams ingests a large amount of data in real time, durably stores it, and makes it available for lightweight processing. For Pega Cloud applications, you can use a Pega-provided Kinesis data stream or connect to your own Kinesis data stream.