How to detect when total BLOB column sizes in an a single HTTP interaction exceed a threshold (PEGA0004 alert) How to detect when total BLOB column sizes in an a single HTTP interaction exceed a threshold (PEGA0004 alert)Values of the Storage Stream column (pzPVStream) may require a large number of bytes of storage, and extracting or updating a property value from this column requires that the entire value be transmitted from the PegaRULES database to the server. A PEGA0004 alert is triggered when, in a single HTTP interaction, the total size of BLOBs queried or written to the PegaRULES database exceed a per-interaction size threshold. The alert can take the form of a warning or an error. Monitoring this database activity helps you recognize when interactions are inefficiently designed or when data is being loaded indiscriminately.
Note that the alert monitors the total size at the interaction level, not at the query level. The threshold is cumulative across all reads and writes for one interaction. For example, if one interaction has one query that returns a BLOB of 60MB (assuming a 50MB threshold), it triggers an alert. The alert is also triggered if the interaction has 60 queries that each return 1MB.
The PEGA0039 alert, on the other hand, monitors the size of a single BLOB for one query. For instance, if a query with a BLOB size is 4MB (greater than the 3MB threshold), it triggers the PEGA0039 alert but not the PEGA0004 alert. Therefore, if one interaction contains ten 4MB queries, ten PEGA0004 alerts are triggered but there is no PEGA0039 alert. An interaction with one query of 60 MB will trigger both alerts. In general, PEGA0004 alerts indicate systemic issues, whereas PEGA0039 alerts point to individual database transactions that are inefficient or poorly designed.
Alert message description
Here is an example of a PEGA0004 alert warning.
The number of database bytes input for this interaction has exceeded the "warning" level for Requestor HF940FD8761E5A3A67F32F892CD68954B, operator the [email protected], Maximum bytes: 100 Actual bytes: 600
Two interactionByteThreshold settings can appear in the prconfig.xml file or Dynamic System Settings, WarnMB and ErrorMB, that either convey a warning, or halt processing when the thresholds are exceeded.
To disable this alert for a single interaction, add this first Java step to the activity: tools.getRequestor().setIgnoreDBByteGovernor(true);
Data returned from columns other than the pzPVStream column does not count towards the threshold limits.
During upload of a ZIP archive, this alert setting is bypassed by design.
Building initial indexes for the full-text search facility naturally requires reading every rule, data instance, or work item. In some cases, a PEGA0004 alert threshold (alerts/database/interactionByteThreshold/errorMB) can cause the indexing process to fail before completing. Before building initial indexes on a new installation, make sure no value is set for the errorMB setting.
prconfig.xml file as follows:<env name="alerts/database/interactionByteThreshold/enabled" value="true"/>
Toggles the alert on ("true") or off ("false").
<env name="alerts/database/interactionByteThreshold/warnMB"
value="50"/>
When WarnMB is exceeded, the system generates an alert to the Alert log file. Processing does not stop. Set value="0" for the errorMB element or warnMB to indicate no limit. If you omit the warnMB line, the default value for warnMB is 50MB.
<env name="alerts/database/interactionByteThreshold/errorMB"
value="-1"/>
When ErrorMB is exceeded, the query stops the service requestor and displays an error message and a stack trace in the user interface and writes them to the Alert log.
By default, this entry is disabled with a value of -1 MB. As a best practice, enable this setting during testing and troubleshooting to prevent runaway, unbounded queries from consuming all available memory and crashing the system.
env name="alerts/database/interactionbytethreshold/warntraceback" value="false" />
Displays stack trace information in the log file when the warnMB threshold is exceeded. Set to "true" to enable the setting.
prconfig.xml file changes effective.
As an alternative to the prconfig.xml file, you can use Dynamic System Settings to configure your application.
See How to create or update a prconfig setting.
Monitor the Alert log for PEGA0004 alerts. Each PEGA004 alert line contains values for three performance statistics, identified by a property name (in the Log-Usage class). These may aid in
Monitor the Pega log for stack trace exceptions from the class:
com.pega.pegarules.engine.database.DatabaseImpl
If the amount of data returned from Storage Stream elements (after any needed decompression of the Storage Stream) exceeds the warnMB limit, the entry has an ALERT severity and appears in the Alert log, with a Java stack trace.
If the errorMB limit is exceeded, the entry has an ERROR severity, and the activity containing the database request ends.
Each log entry identifies the Requestor ID, the operator, and the currently executing activity.
Where possible, research reported exceptions and modify the application rules to eliminate them. These strategies may be appropriate, depending on the situation:
Using the alert in development and production
errorMB setting terminates the activity, which can affect application results.For additional examples and explanation of these facilities, consult the PDN articles:
SysAdmin category