Write-up published
Resolved
Root Cause
A technical issue was identified within the cache cluster of the authenticator provider, stemming from previosuly established infrastructure limitations. These constraints hindered the system’s ability to effectively manage cached data, resulting in some users being unable to sign in
Resolution
The system was stabilized by restarting the entire cluster. Once stability was confirmed, further adjustments were made by increasing allocated infra to prevent future issues.
Action Plan
To enhance system reliability, allocated infra limitations were increased. Future steps include enhancing alerts to quickly identify and address potential problems.
Resolved
After this rollout, logins are all good now. We'll post more details about this episode in the post-mortem.
Monitoring
After a rollout in our infra, the login seems to be more stable. We're now monitoring the next login events.
Identified
After a rollout in our infra, the login seems to be more stable. We're now monitoring.
Identified
Our authentication tool is unstable, and this instability led to login issues. It works every now and then, but we're investigating more details on what could have caused this issue.
Investigating
We are continuing to investigate this issue.
Investigating
Users that are already logged in will not be affected, but users that are trying to login now may face difficulties. We're investigating the root cause, and we'll send updates as we progress.