Table of Contents

Review the lifecycle events of data flow runs (8.2)

Limit data flow run downtime and troubleshoot issues effectively by generating and reviewing a report on the lifecycle of data flow runs. If a run fails, you can generate an extensive lifecycle report with a single click and analyze the details of the failure event to quickly pinpoint the cause and restore the run. For example:


Sample data flow run report 

The following example is a JSON document that constitutes one of the Event details sections of the report:

 {"type":".PartitionStatusTransitionMessage", "senderNodeId":"prpc", "timestamp":1546597138260, "runId":"DF-1", "originator":"MultiplePartitionExecution", "reason":"Encountered error while processing run: Severe exception in stage: Three Dropped Calls", "oldStatus":"IN_PROGRESS", "newStatus":"FAILED", "partitionIds":["19"]}

In the report, filter and summarize the records to highlight relevant data and transform the report into a clearer and more digestible form. If you require assistance with debugging an issue, you can export the report to a .pdf or .xls file and share it with Global Customer Support (GCS).

For more information about accessing event details, see Creating a real-time run for data flows and Creating a batch run for data flows.


100% found this useful

Have a question? Get answers now.

Visit the Collaboration Center to ask questions, engage in discussions, share ideas, and help others.