Support Article

Frequent hung threads and PEGA0028 getting generated

SA-26598

Summary



As part of the Production configuration, there are two servers allocated for Pega which contains total 6 nodes. These 6 nodes are split down across the 2 servers and from last 2 weeks, users have seen that one of the Pega node is going to hung state/not responding. 

Error Messages



2016-07-21 03:01:36,623 [ WebContainer : 17] [TABTHREAD2] [ AppName:03.07.01] (ActivityName.ClassName.Action) ERROR ServerName|ServerIPAddress UserID - Error in RDB-List
com.pega.pegarules.pub.database.DatabaseException: There was a problem getting a list: code: -302 SQLState: 22001 Message: The value of a host variable in the EXECUTE or OPEN statement is out of range for its corresponding use.. SQLCODE=-302, SQLSTATE=22001, DRIVER=3.62.56 From: (H89C8781768C7FC53833A4112DABA0246:
ServerIPAddress)
SQL: { CALL CustomerSchemaName.STORED_PROCEDURE( ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ? ) }
SQL Inserts: <125> <15> <123> <123> <456> <000000111> <0000> <0000> <221100> <221100> <(OUTPUT PARAMETER)> <(OUTPUT PARAMETER)> <(OUTPUT PARAMETER)> <(OUTPUT PARAMETER)> <(OUTPUT PARAMETER)> <(OUTPUT PARAMETER)> <(OUTPUT PARAMETER)> <(OUTPUT PARAMETER)> <(OUTPUT PARAMETER)> <(OUTPUT PARAMETER)> <(OUTPUT PARAMETER)> <(OUTPUT PARAMETER)> <(OUTPUT PARAMETER)> <(OUTPUT PARAMETER)> <(OUTPUT PARAMETER)> <(OUTPUT PARAMETER)>
Caused by SQL Problems.
Problem #1, SQLState 22001, Error code -302: com.ibm.db2.jcc.am.SqlDataException: The value of a host variable in the EXECUTE or OPEN statement is out of range for its corresponding use.. SQLCODE=-302, SQLSTATE=22001, DRIVER=3.62.56......................................................................................................................................
2016-07-21 07:56:02,275 [ WebContainer : 18] [TABTHREAD2] [AppName:03.07.01] (ActivityName.ClassName.Action) ERROR ServerName|ServerIPAddress UserID - DB Call failed !! Error Code: Error Message:
2016-07-21 07:56:05,260 [ WebContainer : 5] [TABTHREAD2] [AppName:03.07.01] (ActivityName.ClassName.Action) ERROR ServerName|ServerIPAddress UserID - DB Call failed !! Error Code: Error Message:


Steps to Reproduce



Multiple hung threads are observed in the Pega JVM node.

Root Cause



From alert log, multiple PEGA0028 (Memory Pool Collection) alerts indicate exceeded threshold values.
 
Collection usage threshold exceeded for class storage memory pool (PS Perm Gen) INFO:MemoryPool=PS Perm Gen;PoolType=class storage;Event=java.management.memory.collection.threshold.exceeded;TimeStamp=2016-07-21 23:35:27,469 GMT;Count=322;NotificationSequenceNo=322;Threshold=483183820;Used=498333776;Max=536870912;Committed=499122176;Init=67108864;
 
User has custom activity in their Application and this makes a call the stored procedures which are captured in the error traces in the log files. These stored procedures are used to get the data from a table which contains lot of corrupted data and which is taking much time. This was causing PEGA0028 (Memory Pool Collection) and memory leakages.

Resolution



Truncate the corrupted data and optimize the activity.
 

 

Published August 9, 2016 - Updated August 13, 2016

Have a question? Get answers now.

Visit the Collaboration Center to ask questions, engage in discussions, share ideas, and help others.