Microsoft SQL Database issue in East US
Incident
Report for Optimizely Service
Resolved
This incident has been resolved.
Update
All alerts have been cleared and all services are reporting full functionality restored. If the situation changes, we will provide a new update.
A Post Mortem will be available once we have received the RCA from Microsoft.
A Post Mortem will be available once we have received the RCA from Microsoft.
Update
Microsoft is continuing their restoration efforts and they are manually rebooting affected instances. We are starting to see some initial signs of recovery.
Monitoring
Microsoft has noted service recovery is progressing. The earlier affected compute nodes have started to recover and we should start to see the databases come back online.
Update
During continued investigation Microsoft also identified some unhealthy compute nodes impacting the service health in the East US region. They are now focusing all their efforts to bring the affected nodes back to operational state.
More updates will be provided as soon as they become available.
More updates will be provided as soon as they become available.
Update
Latest update is that Microsoft engineering team is still working to find the most suitable mitigation steps to recover the service.
We sincerely apologize for the inconvenience and will share more information once they become available.
We sincerely apologize for the inconvenience and will share more information once they become available.
Update
We are continuing to experience a supplier issue that is impacting the availability and will continue to actively monitor the situation as Microsoft work on mitigation to alleviate the impact.
Update
Our supplier has identified an underlying network infrastructure power issue impacting SQL Databases in the East US region. Microsoft are working diligently to mitigate the problem and we will continue to provide updates when we have more information available.
Identified
We have identified that a limited subset of DXP and B2B clients in the East US Microsoft Datacenter are currently experiencing an issue with their service due to an underlying SQL fault. Microsoft is investigating the issue and we will post additional updates once we obtain more information from our supplier.
Thank you for your patience.
Thank you for your patience.
This incident affected: Digital Experience Cloud Service - NA Region (East US).