Write-up published
Resolved
Root Cause
The database health check failed, prompting an automatic failover that unfortunately did not execute as anticipated. As a result, an unplanned service downtime occurred.
Resolution
To resolve the issue, system adjustments were made to manage database connections and ensure a smooth transition to a new master node.
Action Plan
Improve system monitoring with additional metrics for better oversight.Adjusted the health check and failover parameters.
Resolved
This incident has been resolved.
Monitoring
A fix has been applied to resolve the outage and Pipefy is now available to all users.
Identified
The technical team is still working to restore full access to all users as quickly as possible. Some user might still experience degraded performance.
Identified
The technical team is still working to restore full access to all users as quickly as possible.
Identified
The technical team is still working to restore full access to all users as quickly as possible.
Identified
The technical team has identified the causes of the system unavailability and is currently working to restore full access to all users as quickly as possible.
Investigating
We are continuing to investigate this issue.
Investigating
We are currently investigating this issue.