Review the lifecycle events of data flow runs (8.2)

Limit data flow run downtime and troubleshoot issues effectively by generating and reviewing a report on the lifecycle of data flow runs. If a run fails, you can generate an extensive lifecycle report with a single click and analyze the details of the failure event to quickly pinpoint the cause and restore the run. For example:

Sample data flow run report 

The following example is a JSON document that constitutes one of the Event details sections of the report:

{"type":".PartitionStatusTransitionMessage",
"senderNodeId":"prpc",
"timestamp":1546597138260,
"runId":"DF-1",
"originator":"MultiplePartitionExecution",
"reason":"Encountered error while processing run: Severe exception in stage: Three Dropped Calls",
"oldStatus":"IN_PROGRESS",
"newStatus":"FAILED",
"partitionIds":["19"]}

In the report, filter and summarize the records to highlight relevant data and transform the report into a clearer and more digestible form. If you require assistance with debugging an issue, you can export the report to a .pdf or .xls file and share it with Global Customer Support (GCS).

For more information about accessing event details, see Creating a real-time run for data flows and Creating a batch run for data flows.