"Queue Full" error attempting to start Facebook connector
User is observing an outage causing multiple Social Media connectors to fail.
Connectors have been restarted successfully, with posts and tweets being harvested correctly, with the exception of one.
When attempting to restart from the Dataflow landing page in the Designer Studio, the status moves to 'Pending Activation' and then after about 20 seconds moves to Completed.
No errors have been observed, either in in the Dataflow landing page, in the rule form, or using the tracer.
However, the PegaRULES Application log file reports the following:
poll.AbstractPollingConnecter) ERROR <Environment Details Redacted> - Queue full
Steps to Reproduce
- Login to the production environment
- Navigate to the Dataset rule in Data-Social-Facebook.
- Go to Actions > Run and select operation as browse.
- Search for 5 records in a window of 2 minutes.
- After approximately 20 seconds the results page will flash up with no records.
A defect in Pegasystems’ code or rules
On investigating where the issue is commencing, it appears to be at the Dataset level.
Opening the Dataset and running it directly from the ruleform returns no records.
Root cause is an internal buffer limit (fixed size) of 1,000 messages on the Facebook Connector functionality.
When there are more than 1,000 messages/posts to be processed, the buffer is filled and processing terminates with a "Queue Full" error message.