Summary

User performs a test with the real time dataflow. The user pauses and performs a rolling restart of the nodes on which it is configured and resumes the dataflow. However, the lag counts do not refresh though all the incoming events are processed.

Error Messages

Not Applicable

Steps to Reproduce

1. Have an instance of the RealTime dataflow running 
2. Have a stream of continuous events, to be processed by a dataflow
3. Pause the dataflow before restart
4. Capture the processed counts and lag
5. Let the stream of events that is flowing in 
6. Restart the nodes on which the dataflow is configured one by one (Rolling restart)
7. Resume the dataflow post restart
8. Observe if the processed records count increases as there are a few records in the queue to the stream during the Pause state
9. Observe that if the lag builds up as the processing rate becomes lesser than the incoming events. The lag decreases by a few counts
10. Stop the stream of events to the queue
11. Observe if the processed records counts become static
12. Observe if the lag remains as it is when the processed records counts remains static and if no events are coming in (even after reopening the data flow)

Root Cause

Resolution