SA-19373

Summary

Elastic Search - Work Indexing fails with the following exceptions and errors in the Pega rules log. 

Error Messages

2016-01-28 07:00:51,433 [pcWorkManager : 2259] [  STANDARD] [                    ] [ustomerRequest:04.02] (ernal.async.BatchRequestorTask) ERROR   - Batch activity "System-Queue-FTSIncrementalIndexer.pzFTSIncrementalIndexer" threw:
java.lang.NoClassDefFoundError: com.pega.apache.poi.openxml4j.opc.internal.marshallers.ZipPackagePropertiesMarshaller (initialization failure)
    at java.lang.J9VMInternals.initialize(J9VMInternals.java:139)
    at com.pega.apache.poi.openxml4j.opc.OPCPackage.init(OPCPackage.java:161)
    at com.pega.apache.poi.openxml4j.opc.OPCPackage.<init>(OPCPackage.java:141)
    at com.pega.apache.poi.openxml4j.opc.ZipPackage.<init>(ZipPackage.java:87)
    at com.pega.apache.poi.openxml4j.opc.OPCPackage.open(OPCPackage.java:272)
    at com.pega.apache.tika.parser.microsoft.ooxml.OOXMLExtractorFactory.parse(OOXMLExtractorFactory.java:73)
    at com.pega.apache.tika.parser.microsoft.ooxml.OOXMLParser.parse(OOXMLParser.java:82)
    at com.pega.apache.tika.parser.CompositeParser.parse(CompositeParser.java:244)
    at com.pega.apache.tika.parser.CompositeParser.parse(CompositeParser.java:244)
    at com.pega.apache.tika.parser.AutoDetectParser.parse(AutoDetectParser.java:121)
    at com.pega.pegarules.search.internal.es.AttachmentHandler.parseAttachment(AttachmentHandler.java:190)
    at com.pega.pegarules.search.internal.es.WorkDocument.processAttachments(WorkDocument.java:188)
    at com.pega.pegarules.search.internal.es.WorkDocument.processSpecialFields(WorkDocument.java:117)
    at com.pega.pegarules.search.internal.es.AbstractDocument.getDocument(AbstractDocument.java:136)
    at com.pega.pegarules.search.internal.es.AbstractIndexer.addDocuments(AbstractIndexer.java:1174)
    at com.pega.pegarules.search.internal.es.AbstractIndexer.updateIndex(AbstractIndexer.java:265)
    at com.pega.pegarules.search.internal.es.DistributedIndexerAgent.performIndexing(DistributedIndexerAgent.java:174)
    at com.pega.pegarules.session.internal.mgmt.Executable.runIncrementalIndexer(Executable.java:11062)
    at com.pegarules.generated.activity.ra_action_pzftsincrementalindexer_6c413ed7b726c8df447392fddb53a9d8.step1_circum0(ra_action_pzftsincrementalindexer_6c413ed7b726c8df447392fddb53a9d8.java:161)
    at com.pegarules.generated.activity.ra_action_pzftsincrementalindexer_6c413ed7b726c8df447392fddb53a9d8.perform(ra_action_pzftsincrementalindexer_6c413ed7b726c8df447392fddb53a9d8.java:69)
    at com.pega.pegarules.session.internal.mgmt.Executable.doActivity(Executable.java:3500)
    at com.pega.pegarules.session.internal.async.agent.QueueProcessor.runActivity(QueueProcessor.java:721)
    at com.pega.pegarules.session.internal.async.agent.QueueProcessor.execute(QueueProcessor.java:602)
    at com.pega.pegarules.session.internal.async.BatchRequestorTask.run(BatchRequestorTask.java:945)
    at com.pega.pegarules.session.internal.PRSessionProviderImpl.performTargetActionWithLock(PRSessionProviderImpl.java:1259)
    at com.pega.pegarules.session.internal.PRSessionProviderImpl.doWithRequestorLocked(PRSessionProviderImpl.java:1008)
    at com.pega.pegarules.session.internal.PRSessionProviderImpl.doWithRequestorLocked(PRSessionProviderImpl.java:901)
    at com.pega.pegarules.session.internal.async.BatchRequestorTask.run(BatchRequestorTask.java:670)
    at com.pega.pegarules.session.internal.async.Agent.queueBatchActivityForAgent(Agent.java:1504)
    at com.pega.pegarules.session.internal.async.Agent.queueBatchActivityForAgent(Agent.java:1293)
    at com.pega.pegarules.session.internal.async.AgentQueue.run(AgentQueue.java:792)
    at com.pega.pegarules.session.internal.async.Agent.runAgentTask(Agent.java:936)
    at com.pega.pegarules.session.internal.engineinterface.etier.impl.AsyncServant.processAsyncTask(AsyncServant.java:221)
        ..........
   

2016-01-28 06:51:20,313 [pcWorkManager : 2245] [  STANDARD] [                    ] [ustomerRequest:04.02] (     internal.async.AgentQueue) ERROR   - Agent Pega-SearchEngine #0: System-Queue-FTSIncrementalIndexer.pzFTSIncrementalIndexer encountered an execution error. Restarting after delay.
java.lang.NoClassDefFoundError: com.pega.apache.poi.openxml4j.opc.internal.marshallers.ZipPackagePropertiesMarshaller (initialization failure)
    at java.lang.J9VMInternals.initialize(J9VMInternals.java:139)
    at com.pega.apache.poi.openxml4j.opc.OPCPackage.init(OPCPackage.java:161)
    at com.pega.apache.poi.openxml4j.opc.OPCPackage.<init>(OPCPackage.java:141)
    at com.pega.apache.poi.openxml4j.opc.ZipPackage.<init>(ZipPackage.java:87)
    at com.pega.apache.poi.openxml4j.opc.OPCPackage.open(OPCPackage.java:272)
    at com.pega.apache.tika.parser.microsoft.ooxml.OOXMLExtractorFactory.parse(OOXMLExtractorFactory.java:73)
    at com.pega.apache.tika.parser.microsoft.ooxml.OOXMLParser.parse(OOXMLParser.java:82)
    at com.pega.apache.tika.parser.CompositeParser.parse(CompositeParser.java:244)
    at com.pega.apache.tika.parser.CompositeParser.parse(CompositeParser.java:244)
    at com.pega.apache.tika.parser.AutoDetectParser.parse(AutoDetectParser.java:121)
    at com.pega.pegarules.search.internal.es.AttachmentHandler.parseAttachment(AttachmentHandler.java:190)
    at com.pega.pegarules.search.internal.es.WorkDocument.processAttachments(WorkDocument.java:188)
    at com.pega.pegarules.search.internal.es.WorkDocument.processSpecialFields(WorkDocument.java:117)
    at com.pega.pegarules.search.internal.es.AbstractDocument.getDocument(AbstractDocument.java:136)
    at com.pega.pegarules.search.internal.es.AbstractIndexer.addDocuments(AbstractIndexer.java:1174)
    at com.pega.pegarules.search.internal.es.AbstractIndexer.updateIndex(AbstractIndexer.java:265)
    at com.pega.pegarules.search.internal.es.DistributedIndexerAgent.performIndexing(DistributedIndexerAgent.java:174)
    at com.pega.pegarules.session.internal.mgmt.Executable.runIncrementalIndexer(Executable.java:11062)
    at com.pegarules.generated.activity.ra_action_pzftsincrementalindexer_6c413ed7b726c8df447392fddb53a9d8.step1_circum0(ra_action_pzftsincrementalindexer_6c413ed7b726c8df447392fddb53a9d8.java:161)
    at com.pegarules.generated.activity.ra_action_pzftsincrementalindexer_6c413ed7b726c8df447392fddb53a9d8.perform(ra_action_pzftsincrementalindexer_6c413ed7b726c8df447392fddb53a9d8.java:69)
    at com.pega.pegarules.session.internal.mgmt.Executable.doActivity(Executable.java:3500)
    at com.pega.pegarules.session.internal.async.agent.QueueProcessor.runActivity(QueueProcessor.java:721)
    at com.pega.pegarules.session.internal.async.agent.QueueProcessor.execute(QueueProcessor.java:602)
    at com.pega.pegarules.session.internal.async.BatchRequestorTask.run(BatchRequestorTask.java:945)
    at com.pega.pegarules.session.internal.PRSessionProviderImpl.performTargetActionWithLock(PRSessionProviderImpl.java:1259)
    at com.pega.pegarules.session.internal.PRSessionProviderImpl.doWithRequestorLocked(PRSessionProviderImpl.java:1008)
    at com.pega.pegarules.session.internal.PRSessionProviderImpl.doWithRequestorLocked(PRSessionProviderImpl.java:901)
    at com.pega.pegarules.session.internal.async.BatchRequestorTask.run(BatchRequestorTask.java:670)
    at com.pega.pegarules.session.internal.async.Agent.queueBatchActivityForAgent(Agent.java:1504)
    at com.pega.pegarules.session.internal.async.Agent.queueBatchActivityForAgent(Agent.java:1293)
    at com.pega.pegarules.session.internal.async.AgentQueue.run(AgentQueue.java:792)
        ..............
    

Steps to Reproduce

1. Go to System > Settings > Search

 

2. Enable indexing for Work and Index Attachments.

3. Try searching for work class and the above mentioned exception occurs.

Root Cause

The root cause of this problem is defect or misconfiguration in the environment.

1.    Work attachment indexing was enabled.

2.    Also, IBM Java 6 is used and it does not provide certain XML functionality that it should have according to the Java Spec, IBM JDK 7 seems to work fine.

Resolution

In order to resolve the reported behaviour one of the following local changes was suggested : 

1. Disable the attachment indexing. This is because the exception is generated from Apache POI which is used only for attachment indexing as seen in the Stack trace. Thus disabling attachment indexing solves the issue.

2. Upgrade from IBM Java 6 to IBM Java 7 or Oracle Java 1.6.0_18 as mentioned in the following link:

https://mail-archives.apache.org/mod_mbox/poi-dev/201501.mbox/%3CFB8F943CCE197F4A8C65545509CA885B0180A25DD6B2@MSGRTPCCRF2WIN.DMN1.FMR.COM%3E