Root Cause

The data source used by our apps (reports and filters) became out of sync with the database due to a weekend process required for compliance coupled with database connection issues.

Resolution

We adjusted the syncronization to skip changes from the compliance process and increased its throughput. Subsequently, a manual synchronization of all updated cards was performed to ensure everything was up to date.

Action Plan

Improve alerts to also encompass issues found on the incident, document the changes made for future reference, and improve and streamline the internal process that loads the application during weekends.