Support Article
NullPointerException on running data flow which writes JSON file
SA-62352
Summary
While running a data flow which writes a JSON file to an Amazon S3 bucket, NullPointerException occur in the Pega logs.
Error Messages
com.pega.dsm.dnode.api.dataflow.StageException: Exception in stage: StageNameat com.pega.dsm.dnode.api.dataflow.StageException.create(StageException.java:39) at com.pega.dsm.dnode.api.dataflow.DataFlowStage$StageInputSubscriber.onCompleted(DataFlowStage.java:402) at com.pega.dsm.dnode.api.dataflow.DataFlowExecutor$QueueBasedDataFlowExecutor$5.process(DataFlowExecutor.java:347) at com.pega.dsm.dnode.api.dataflow.DataFlowExecutor$QueueBasedDataFlowExecutor.runEventLoop(DataFlowExecutor.java:197) at com.pega.dsm.dnode.api.dataflow.DataFlow$2.emit(DataFlow.java:309) at
com.pega.dsm.dnode.impl.dataflow.task.PickupRunTask$ExecutePartitionsRunnable$1.run(PickupRunTask.java:171) at com.pega.dsm.dnode.impl.dataflow.task.PickupRunTask$ExecutePartitionsRunnable$1.run(PickupRunTask.java:168) at com.pega.dsm.dnode.util.PrpcRunnable.execute(PrpcRunnable.java:52) at com.pega.dsm.dnode.impl.prpc.service.ServiceHelper.executeInPrpcContextInternal(ServiceHelper.java:229) at com.pega.dsm.dnode.impl.prpc.service.ServiceHelper.executeInPrpcContext(ServiceHelper.java:104) at com.pega.dsm.dnode.impl.dataflow.task.PickupRunTask$ExecutePartitionsRunnable.run(PickupRunTask.java:168) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:108) at com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:41) at com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:77) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at com.pega.dsm.dnode.util.PrpcRunnable$1.run(PrpcRunnable.java:44) at com.pega.dsm.dnode.util.PrpcRunnable$1.run(PrpcRunnable.java:41) at com.pega.dsm.dnode.util.PrpcRunnable.execute(PrpcRunnable.java:52) at com.pega.dsm.dnode.impl.prpc.PrpcThreadFactory$PrpcThread.run(PrpcThreadFactory.java:109)
Caused by: java.lang.NullPointerException at java.util.Calendar.setTime(Calendar.java:1770) at java.text.SimpleDateFormat.format(SimpleDateFormat.java:943) at java.text.SimpleDateFormat.format(SimpleDateFormat.java:936) at java.text.DateFormat.format(DateFormat.java:345) at com.pega.dsm.dnode.util.ClipboardPageJsonConverter.handleDateType(ClipboardPageJsonConverter.java:605) at com.pega.dsm.dnode.util.ClipboardPageJsonConverter.asJson(ClipboardPageJsonConverter.java:545) at com.pega.dsm.dnode.util.ClipboardPageJsonConverter.serialize(ClipboardPageJsonConverter.java:482) at com.pega.dsm.dnode.util.ClipboardPageJsonConverter.asJson(ClipboardPageJsonConverter.java:451) at com.pega.dsm.dnode.util.ClipboardPageJsonConverter.asJsonBytes(ClipboardPageJsonConverter.java:155) at com.pega.dsm.dnode.util.ClipboardPageJsonConverter.asJson(ClipboardPageJsonConverter.java:139) at com.pega.bigdata.dataset.parsers.ClipboardPageToJsonSerializer.serialize(ClipboardPageToJsonSerializer.java:46)
Steps to Reproduce
- Configure a data flow which reads from a C* data set
- Configure an output to write to a JSON file
- Run the data flow
Root Cause
A defect in Pegasystems’ code or rules.
Resolution
Apply HFix-45817.
Published September 12, 2018 - Updated December 2, 2021
Have a question? Get answers now.
Visit the Collaboration Center to ask questions, engage in discussions, share ideas, and help others.