Types of data flows
Data flows are scalable data pipelines that you can build to sequence and combine data based on various data sources. Each data flow consists of components that transform data and enrich data processing with business rules.
You can create data flows that process data in different ways:
- Batch data flows
- Go over a finite set of data and eventually complete processing. Batch data flows are mainly used for processing large volumes of data.
- Real-time data flows
- Go over an infinite set of data. Real-time data flows are always active and continue to process incoming stream data and requests.
- Single case data flows
- Executed on request with the data flow source set to abstract. Single case data flows are mostly used to process inbound data.
Data flow runs that are initiated through the Data Flows landing page run in the access
group context. These data flows always use the checked-in instance of the data flow rule and
the referenced rules. You can use a checked-out instance of the data flow rule if you do a
test run.