Support Article
IBM JAVACore Dumps getting generated
Summary
After User upgraded to Pega 7.2.2, the Systest Servers Server1 and Server2 are generating multiple IBM JAVACore Dumps.
Multiple IBM JavaCore dumps generate in Systest server1 and server2 after upgrading to Pega 7.2.2.
Error Messages
[6/1/17 17:49:00:367 HST] 00000065 ThreadMonitor W WSVR0605W: Thread "WorkManager.PRPCWorkManager : 20" (00001ab2) has been active for 609738 milliseconds and may be hung. There is/are 1 thread(s) in total in the server that may be hung.
at com.pega.pegarules.session.internal.authorization.Authorization.validateState(Authorization.java:1352)
at com.pega.pegarules.session.internal.authorization.Authorization.getRuleSets(Authorization.java:441)
at com.pega.pegarules.data.internal.dictionary.PropertyInfoConclusionImpl.findMatch(PropertyInfoConclusionImpl.java:442)
at com.pega.pegarules.data.internal.dictionary.PropertyInfoConclusionImpl.getPropertyInfoDatum(PropertyInfoConclusionImpl.java:712)
at com.pega.pegarules.data.internal.dictionary.DictionaryImpl.getPropertyInfoDatum(DictionaryImpl.java:1735)
at com.pega.pegarules.data.internal.dictionary.ClassInfoImpl.getPropertyInfoDatum(ClassInfoImpl.java:915)
at com.pega.pegarules.data.internal.dictionary.ClassInfoImpl.getImmutablePropertyInfo(ClassInfoImpl.java:906)
at com.pega.pegarules.data.internal.dictionary.ClassInfoImpl.getImmutablePropertyInfo(ClassInfoImpl.java:880)
at com.pega.pegarules.data.internal.clipboard.ClipboardPropertyImpl.getPropertyInfoFromDictionary(ClipboardPropertyImpl.java:4859)
at com.pega.pegarules.data.internal.clipboard.ClipboardPropertyImpl.lookupDictionaryDefinition(ClipboardPropertyImpl.java:3436)
at com.pega.pegarules.data.internal.clipboard.ClipboardPropertyImpl.lookupDictionaryDefinition(ClipboardPropertyImpl.java:3373)
at com.pega.pegarules.data.internal.clipboard.ClipboardPropertyImpl.lookupDictionaryDefinition(ClipboardPropertyImpl.java:3369)
at com.pega.pegarules.data.internal.clipboard.ClipboardPropertyImpl.lookupDictionaryDefinition(ClipboardPropertyImpl.java:3251)
at com.pega.pegarules.data.internal.clipboard.ClipboardPropertyImpl.extendsEmbedJava(ClipboardPropertyImpl.java:2417)
at com.pega.pegarules.data.internal.clipboard.ClipboardPropertyImpl.expandStream(ClipboardPropertyImpl.java:2446)
at com.pega.pegarules.data.internal.clipboard.ClipboardPropertyImpl.expandStream(ClipboardPropertyImpl.java:2412)
at com.pega.pegarules.data.internal.clipboard.ClipboardPropertyImpl.addToList(ClipboardPropertyImpl.java:1309)
at com.pega.pegarules.data.internal.clipboard.ClipboardPropertyBase.getPropertyValue(ClipboardPropertyBase.java:2571)
at com.pega.pegarules.data.internal.clipboard.PropertyReferenceImpl.getListElement(PropertyReferenceImpl.java:1301)
at com.pega.pegarules.data.internal.clipboard.PropertyReferenceImpl.doGet(PropertyReferenceImpl.java:1408)
at com.pega.pegarules.data.internal.clipboard.PropertyReferenceImpl.doGet(PropertyReferenceImpl.java:1355)
at com.pega.pegarules.data.internal.clipboard.PropertyReferenceImpl.get(PropertyReferenceImpl.java:784)
at com.pega.pegarules.data.internal.clipboard.PropertyReferenceImpl.get(PropertyReferenceImpl.java:768)
at com.pega.pegarules.data.internal.clipboard.PropertyReferenceImpl.get(PropertyReferenceImpl.java:755)
at com.pega.pegarules.data.internal.clipboard.ClipboardPageImpl.getProperty(ClipboardPageImpl.java:1062)
at com.pega.pegarules.data.internal.clipboard.ClipboardPageImpl.getProperty(ClipboardPageImpl.java:1033)
at com.pega.pegarules.data.internal.clipboard.ClipboardPageImpl.getProperty(ClipboardPageImpl.java:1019)
at com.pega.pegarules.data.internal.clipboard.ClipboardPageImpl.getPage(ClipboardPageImpl.java:1943)
at com.pega.pegarules.data.internal.clipboard.StorageStreamCommonImpl.addLinkSerializationProperties(StorageStreamCommonImpl.java:1091)
at com.pega.pegarules.data.internal.clipboard.DirectStreamEncoder$PageSection.addPage(DirectStreamEncoder.java:554)
at com.pega.pegarules.data.internal.clipboard.DirectStreamEncoder.encode(DirectStreamEncoder.java:300)
at com.pega.pegarules.data.internal.clipboard.StorageStreamCommonImpl.encode(StorageStreamCommonImpl.java:867)
at com.pega.pegarules.data.internal.clipboard.StorageStreamCommonImpl.encode(StorageStreamCommonImpl.java:835)
at com.pega.pegarules.data.internal.clipboard.ClipboardPageImpl.getStreamForm(ClipboardPageImpl.java:3933)
at com.pega.pegarules.data.internal.access.UpdateProcessor.queueToIncrementalIndexerAsync(UpdateProcessor.java:1911)
at com.pega.pegarules.data.internal.access.UpdateProcessor.addToIndexerQueue(UpdateProcessor.java:1882)
at com.pega.pegarules.data.internal.access.UpdateProcessor.noteChange(UpdateProcessor.java:1121)
at com.pega.pegarules.data.internal.access.UpdateProcessor.notifyOtherSystemsAfterUpdates(UpdateProcessor.java:883)
at com.pega.pegarules.data.internal.access.UpdateProcessor.notifyEverybodyOfChanges(UpdateProcessor.java:431)
at com.pega.pegarules.data.internal.access.UpdateProcessor.after(UpdateProcessor.java:279)
at com.pega.pegarules.data.internal.store.DataStoreManager.doInTransaction(DataStoreManager.java:252)
at com.pega.pegarules.data.internal.access.UpdateProcessor.processUpdates(UpdateProcessor.java:178)
at com.pega.pegarules.data.internal.access.DatabaseImpl.commit(DatabaseImpl.java:2066)
at com.pegarules.generated.activity.ra_action_commitwitherrorhandling_6c6c3f21ead5ea2a97cdc30349237e37.step4_circum0(ra_action_commitwitherrorhandling_6c6c3f21ead5ea2a97cdc30349237e37.java:493)
at com.pegarules.generated.activity.ra_action_commitwitherrorhandling_6c6c3f21ead5ea2a97cdc30349237e37.perform(ra_action_commitwitherrorhandling_6c6c3f21ead5ea2a97cdc30349237e37.java:121)
at com.pega.pegarules.session.internal.mgmt.Executable.doActivity(Executable.java:3553)
at com.pega.pegarules.session.internal.mgmt.Executable.invokeActivity(Executable.java:10711)
at com.pegarules.generated.activity.ra_action_processcirfresults_fb582d6d45bb85679cece4888eedbbb2.step8_circum0(ra_action_processcirfresults_fb582d6d45bb85679cece4888eedbbb2.java:1268)
at com.pegarules.generated.activity.ra_action_processcirfresults_fb582d6d45bb85679cece4888eedbbb2.perform(ra_action_processcirfresults_fb582d6d45bb85679cece4888eedbbb2.java:221)
at com.pega.pegarules.session.internal.mgmt.Executable.doActivity(Executable.java:3553)
at com.pega.pegarules.session.internal.mgmt.Executable.invokeActivity(Executable.java:10711)
at com.pegarules.generated.activity.ra_action_manageopencirf_1d4edc8d6f691852b781b059e6885774.step10_circum0(ra_action_manageopencirf_1d4edc8d6f691852b781b059e6885774.java:1176)
at com.pegarules.generated.activity.ra_action_manageopencirf_1d4edc8d6f691852b781b059e6885774.perform(ra_action_manageopencirf_1d4edc8d6f691852b781b059e6885774.java:255)
at com.pega.pegarules.session.internal.mgmt.Executable.doActivity(Executable.java:3553)
at com.pega.pegarules.session.internal.async.agent.QueueProcessor.runActivity(QueueProcessor.java:749)
at com.pega.pegarules.session.internal.async.agent.QueueProcessor.execute(QueueProcessor.java:618)
at com.pega.pegarules.session.internal.async.BatchRequestorTask.run(BatchRequestorTask.java:1000)
at com.pega.pegarules.session.internal.PRSessionProviderImpl.performTargetActionWithLock(PRSessionProviderImpl.java:1286)
at com.pega.pegarules.session.internal.PRSessionProviderImpl.doWithRequestorLocked(PRSessionProviderImpl.java:1034)
at com.pega.pegarules.session.internal.PRSessionProviderImpl.doWithRequestorLocked(PRSessionProviderImpl.java:916)
at com.pega.pegarules.session.internal.async.BatchRequestorTask.run(BatchRequestorTask.java:707)
[6/1/17 18:10:28:359 HST] 00001ab2 ThreadMonitor W WSVR0606W: Thread "WorkManager.PRPCWorkManager : 20" (00001ab2) was previously reported to be hung but has completed. It was active for approximately 1897730 milliseconds. There is/are 0 thread(s) in total in the server that still may be hung.
Steps to Reproduce
Start servers.
Root Cause
A defect or configuration issue in the operating environment.
Users' environment have the IBM Websphere Application server Thread monitor's java.dump custom property enabled. This is generating the JavaCore dumps.
With this custom property set to “true” will cause JavaCore dumps to be generated for every long running thread beyond the default threshold of 10 minutes.
Resolution
Make the following change to the operating environment:
Disable / turn off the IBM Websphere AS Threadmonitor’s Custom property as below.
This will cause IBM Websphere application server’s Threadmonitor to stop generating JavaCore dumps for long running threads.
Set the com.ibm.websphere.threadmonitor.dump.java property to false.
Application Servers:
1. From the administrative console, click Servers > Application Servers > server_name.
2. Under Server Infrastructure, click Administration > Custom Properties.
3. Click New and add the following property:
Name: com.ibm.websphere.threadmonitor.dump.java
Value: false
Published December 11, 2017 - Updated October 8, 2020
Have a question? Get answers now.
Visit the Collaboration Center to ask questions, engage in discussions, share ideas, and help others.