Skip to main content

This content has been archived and is no longer being updated. Links may not function; however, this content may be relevant to outdated versions of the product.

Support Article

NPE executing Data Flow batch run with HDFS data set



Data Flow batch execution run fails with errors. The Data Flow has HDFS dataset as source.

Error Messages

Error on node [some node id] 
com.pega.dsm.dnode.api.dataflow.StageException: Exception in stage: <some stage>
at com.pega.dsm.dnode.api.dataflow.DataFlowStage$StageOutputSubscriber.onError( 
at com.pega.dsm.dnode.api.dataflow.DataFlowStage$StageInputSubscriber.onError( 
at com.pega.dsm.dnode.api.dataflow.DataFlow$ 
at java.util.concurrent.ThreadPoolExecutor.runWorker( 
at java.util.concurrent.ThreadPoolExecutor$ 
at com.pega.dsm.dnode.impl.prpc.PrpcThreadFactory$ 
Caused by: java.lang.NullPointerException 
at com.pega.decision.util.csv.CSVTokenizer.nextToken( 
at com.pega.bigdata.dataset.hdfs.parsers.CSVToClipboardPageParser.parse( 
at com.pega.bigdata.dataset.hdfs.parsers.CSVToClipboardPageParser.parse( 
at com.pega.bigdata.dataset.hdfs.HDFSFileClient$ 
at com.pega.bigdata.dataset.hdfs.HDFSBrowseAllOperation.propagateResultsToSubscriber( 
at com.pega.bigdata.dataset.hdfs.HDFSBrowseByPartitionOperation$1.emit( 
... 5 more 

Steps to Reproduce

  1. Create a data flow with HDFS data set as source.
  2. Use CSV option for the HDFS file.
  3. Designer Studio - Decisioning- Decisions - DataFlows - Actions - Run.

Root Cause

A defect in Pegasystems’ code or rules, multithreading and concurrency issues with CSVTokenizer api.


Apply HFix-30260.


Published November 24, 2016 - Updated October 8, 2020

Was this useful?

0% found this useful

Have a question? Get answers now.

Visit the Collaboration Center to ask questions, engage in discussions, share ideas, and help others.

Did you find this content helpful?

Want to help us improve this content?

We'd prefer it if you saw us at our best.

Pega Community has detected you are using a browser which may prevent you from experiencing the site as intended. To improve your experience, please update your browser.

Close Deprecation Notice
Contact us