Combining data from two sources
Combine data from two sources into a page or page list to have all the necessary data in one record. To combine data, you need to identify a property that is a match between the two sources. The data from the secondary source is appended to the incoming data record as an embedded data page. When you use multiple Compose shapes, the incoming data is appended with multiple embedded data pages.
In a data flow, click the Plus icon on a shape, and select Compose.
Double-click the secondary Source shape to configure it. For example, Subscriptions data set.When you select a data set, it must be a data set that you can browse by keys, for example, Database Table, Decision Data Store, Event Store, HBase, or Interaction History data set.
Double-click the Compose shape to configure it.
In the Name field, enter a name for the shape.
Select a property in which you want compose data from your sources. For example, .Subscriptions.
Click Add condition and select a property that needs to match between two sources. You can add more than one condition. For example, When .CustomerID is equal to .CustomerID.
The Compose shape outputs one record for every incoming data record after it is enhanced with additional data. This data is mapped to an embedded page or a page list of the incoming record. The input and output class of the data record remain the same.
For example, to create a record that contains the full customer profile for a call center interaction, your compose conditions can look like this:
Compose Customer with data from Subscription into
When CustomerID is equal to .CustomerID
The Customers data set contains basic information about the customer that needs to be combined with data in the Subscriptions data set.
- Creating a data flow
Create a data flow to process and move data between data sources. Customize your data flow by adding data flow shapes and by referencing other business rules to do more complex data operations. For example, a simple data flow can move data from a single data set, apply a filter, and save the results in a different data set. More complex data flows can be sourced by other data flows, can apply strategies for data processing, and open a case or trigger an activity as the final outcome of the data flow.
- Types of data flows
Data flows are scalable data pipelines that you can build to sequence and combine data based on various data sources. Each data flow consists of components that transform data and enrich data processing with business rules.
- Types of Data Set rules
Learn about the types of data set rules that you can create in Pega Platform.