SA-30913

Summary

As a data flow user, user wants to batch data flow runs to behave in the same way as real-time runs and not to fail on the first error.
This is so the major part of the batch run can finish up even with the presence of a small number of errors.

Error Messages

Not applicable

Steps to Reproduce

1) Include a data flow run on a large set of data (Source >Strategy >Destination).
2) Make sure some input data makes strategy fail (several records).
3) Run the data flow in batch.

Root Cause

Data flow batch runs fail after the first error. This is currently a product limitation.

Resolution

Install HFix-30648 to allow configurable failure threshold (dataflow/batch/failureThreshold=<number>).

Additional Installation Instructions

Use dataflow/batch or failureThreshold=<number> DSS to configure failure threshold.
​
Note that this configuration is per thread. The data flow will be marked as failed only when one of the processing threads reaches the threshold.