From June 11 2025, 9:35 UTC - June 11 2025 22:10 UTC, customers using Social and Mail products with compliance features enabled experienced delays in seeing their approved suggested content appear in the Suggested Content Library. This was due to a temporary slowdown in our system that was caused by a backed up queue.
Timeline:
Start Time: June 11, 2025 9:35 UTC
End Time: June 11 2025 22:11 UTC
Customer Impact:
- All Social and Mail customers with Compliance enabled were affected by this issue. These customers experienced delays in approved suggested content being posted to their Suggested Content Library due to a backed-up queue.
- There was no data loss or corruption. All content remained intact, and the delayed items were successfully delivered once the queue was processed.
Root Cause:
- The issue was caused by a backlog in the processing queue, which temporarily slowed down the flow of suggested content into the library.
Resolution:
- Additional infrastructure components were added temporarily to process the queue and resolve the backlog.
Future Improvements:
- We are implementing additional monitoring on SQS queue around age and volume of messages in queues.
- Monitor tasks running in high-priority queues for timely completion.