Between October 3 and October 5, Pipefy experienced delays in delivering notification emails, including assignment updates, mentions, comments, phase changes, and overdue reminders.
The platform remained available. Other outbound emails, including emails sent through automation templates and card or inbox flows, were not affected.
The service responsible for processing notification emails had insufficient memory allocated for its workload. This caused repeated restarts, significantly reducing processing capacity while incoming notifications continued to accumulate.
Our team increased memory allocation and processing capacity, stabilizing the notification service and allowing the accumulated backlog to be processed.
The backlog was fully cleared on October 5, and normal notification processing resumed.
We have increased processing resources and saved the updated configuration.
Additional follow-up work includes:
Adding dedicated notification alerts to detect growing backlogs earlier.
We apologize for the disruption and the delays in receiving notifications.