Types of data flows

Data flows are scalable data pipelines that you can build to sequence and combine data based on various data sources. Each data flow consists of components that transform data and enrich data processing with business rules.

You can create data flows that process data in different ways:

Batch data flows

Go over a finite set of data and eventually complete processing. Batch data flows are mainly used for processing large volumes of data.

Real-time data flows

Go over an infinite set of data. Real-time data flows are always active and continue to process incoming stream data and requests.

Single case data flows

Executed on request with the data flow source set to abstract. Single case data flows are mostly used to process inbound data.

• Creating a data flow

  Create a data flow to process and move data between data sources. Customize your data flow by adding data flow shapes and by referencing other business rules to do more complex data operations. For example, a simple data flow can move data from a single data set, apply a filter, and save the results in a different data set. More complex data flows can be sourced by other data flows, can apply strategies for data processing, and open a case or trigger an activity as the final outcome of the data flow.

• Data Flows landing page

  This landing page provides facilities for managing data flows in your application. Data flows allow you to sequence and combine data based on various sources, and write the results to a destination. Data flow runs that are initiated through this landing page run in the access group context. They always use the checked-in instance of the Data Flow rule and the referenced rules.