Microsoft Azure App Service Intermittent Error (Australia East)

Incident Report for Optimizely Service

Resolved

This incident has been resolved as the Microsoft service health page shows all clear and no further impacts have occurred. We will continue to communicate directly with a very small subset of clients which are taking longer to fully recover. We are waiting for Microsoft to provide an RCA for this outage.
Posted Sep 01, 2023 - 20:28 UTC

Update

Microsoft service health page shows all clear but we are continuing to monitor a subset of customers that still have not fully recovered. For those impacted clients we will be communicating directly with them until everything works as expected.
No further updates will follow unless new impacts emerge.
Posted Sep 01, 2023 - 07:33 UTC

Update

As Microsoft is reporting restoration of services on https://azure.status.microsoft/en-us/status We remain vigilant while we continue to monitor the health of the previously impacted services- with no further interruption noted at this time.
Posted Aug 31, 2023 - 20:49 UTC

Update

We are continuing to closely monitor the health of the services while Microsoft is working on full restoration. More updates will be provided as soon as they become available.

More details can be found on the Azure status page: https://azure.status.microsoft/en-us/status
Posted Aug 31, 2023 - 14:25 UTC

Update

The site unavailability issue with Search&Navigation in APAC regions (APAC04) has been mitigated.

We will continue to monitor our services while Microsoft is working on full restoration. More details can be found on the Azure status page: https://azure.status.microsoft/en-us/status

Thank you for your patience.
Posted Aug 31, 2023 - 03:42 UTC

Update

While the majority of customers and the majority of services are already mitigated. We are still observing a subset of clients using Search&Navigation service in APAC region (APAC04) being reported site unavailability.

Microsoft are continuing with their mitigation efforts and we will share an update once we have more information. Thank you for you patience.
Posted Aug 31, 2023 - 02:30 UTC

Monitoring

A fix has been implemented and we will continue to monitor the health of the Microsoft services
Posted Aug 30, 2023 - 21:13 UTC

Update

Microsofts's latest updates notes they are in the final phases of restoring services and almost all storage services and VM's are back online with just a small subset of clients still impacted. They are continuing to work to get all affected clients back up.
Posted Aug 30, 2023 - 20:54 UTC

Update

Microsoft is continuing their restoration efforts and have provided an eta of 1-2 hour for all services to be restored
Posted Aug 30, 2023 - 20:05 UTC

Update

Microsoft are continuing with their mitigation efforts and continue to see improvements with more storage services and VM's coming back online. They are expecting to have full restoration within the next 2-3 hours. Should this timeframe change, we will post an update here. More details can be found on the Azure status page: https://azure.status.microsoft/en-us/status
Posted Aug 30, 2023 - 19:00 UTC

Update

Microsoft has noted service recovery is progressing and we are starting to see some initial signs of recovery.
Posted Aug 30, 2023 - 17:44 UTC

Update

Microsoft is continuing to apply mitigation actions and we are continuing to closely monitor the recovery
Posted Aug 30, 2023 - 16:39 UTC

Update

We are continuing to monitor Microsoft's mitigation progress. Details can be seen here: https://azure.status.microsoft/en-gb/status
Posted Aug 30, 2023 - 14:36 UTC

Identified

The issue has been identified and a fix is being implemented. We will post additional updates hourly or when we have information available. Thank you for your patience.
Posted Aug 30, 2023 - 12:48 UTC

Investigating

Investigations are continuing. We will post additional updates hourly or when we have information available. Thank you for your patience.

For more information: https://azure.status.microsoft/en-us/status
Posted Aug 30, 2023 - 12:06 UTC

Identified

The issue has been identified and a fix is being implemented.
Posted Aug 30, 2023 - 11:53 UTC

Update

We are continuing to investigate this issue.
Posted Aug 30, 2023 - 11:44 UTC

Investigating

We are investigating reports of intermittent errors and application unavailability in Australia East region. We will post additional updates hourly or when we have information available. Thank you for your patience.
Posted Aug 30, 2023 - 11:00 UTC
This incident affected: Digital Experience Cloud Service - APAC Region (Australia East), Content Recommendations - APAC Region (Content Recommendations API, Content Recommendations Management Interface), and Search and Navigation - APAC Region (Australia East).