Run-time data

Connect to large streams of real-time event and customer data to make your strategies and models more accurate.

To process decision management data in real-time, create Kafka and Kinesis data sets.

• Creating a Stream data set

  Process a continuous data stream of events (records) by creating a Stream data set.

• Creating a Kafka data set

  You can create an instance of a Kafka data set in the Pega Platform to connect to a topic in the Kafka cluster. Topics are categories where the Kafka cluster stores streams of records. Each record in a topic consists of a key, value, and a time stamp. You can also create a new topic in the Kafka cluster from the Pega Platform and then connect to that topic.

• Creating a Kinesis data set

  You can create an instance of a Kinesis data set in Pega Platform to connect to an instance of Amazon Kinesis Data Streams. Amazon Kinesis Data Streams ingests a large amount of data in real time, durably stores it, and makes it available for lightweight processing. For Pega Cloud applications, you can use a Pega-provided Kinesis data stream or connect to your own Kinesis data stream.