Cloudflare issue causing service disruption

Incident Report for Optimizely Service

Resolved

This incident has been resolved.
Posted Nov 06, 2023 - 01:34 UTC

Update

Optimizely service remains available, all services shall have been restored to operational status and we are closely continuing monitoring the results.
Posted Nov 05, 2023 - 09:01 UTC

Update

Optimizely service remains available, with degraded performance on Digital Experience Cloud Service Management Portal, for activities that involve changes in the CDN (ie. migrations between projects or adding new hostnames).

Cloudflare continues working to restore impacted services and we will continue to monitor the health of the services.
Posted Nov 03, 2023 - 20:37 UTC

Update

Optimizely service remains available, with degraded performance on Digital Experience Cloud Service Management Portal, for activities that involve changes in the CDN (ie. migrations between projects or adding new hostnames). Please contact Optimizely Technical Support Services, https://support.optimizely.com/hc/en-us for support.

Cloudflare continues working to restore impacted services.

We will continue to monitor and will update here accordingly. Thank you for your patience!
Posted Nov 03, 2023 - 12:29 UTC

Update

While Cloudflare partner continues their effort to apply a full scope resolution, the Optimizely service remains available to the majority of users. We will continue to monitor and will update here accordingly.
Thank you for your patience.
Posted Nov 03, 2023 - 07:03 UTC

Monitoring

Cloudflare are continuing their progress towards full service restoration but there should be little to no impact to customer-facing services at this time. We will continue to monitor and will update here accordingly.
Posted Nov 02, 2023 - 21:07 UTC

Update

Cloudflare reported they are still seeing gradual improvements and they are working to restore full functionality
Posted Nov 02, 2023 - 20:04 UTC

Update

Per Cloudflare's status page, they are applying mitigation which has partially restored services and mitigated the overall impact. They are continuing to work on restoring the remaining affected services
Posted Nov 02, 2023 - 17:17 UTC

Identified

Cloudflare identified the issue and continue working on a fix.

We recommend you to not start any new deployments at this time. Please contact Managed Services, https://support.optimizely.com/hc/en-us if you need to re-schedule.

We will provide more updates as soon as they become available. Thank you for your patience!
Posted Nov 02, 2023 - 14:40 UTC

Investigating

We are currently aware of an active incident with Cloudflare that is affecting our products and services. Cloudflare is assessing a loss of power impacting data centres while simultaneously failing over services and are continuing to work on a fix for this issue.

We recommend you to not start any new deployments at this time. Please contact Managed Services, https://support.optimizely.com/hc/en-us if you need to re-schedule.

We will provide more updates as soon as they become available. Thank you for your patience!
Posted Nov 02, 2023 - 14:12 UTC
This incident affected: Optimizely Support (E-mail, Telephone, Support Portal - optimizely.com/support), Digital Experience Cloud Service - APAC Region (Australia East, Australia Southeast, Japan East, Southeast Asia), Digital Experience Cloud Service - EMEA Region (North Europe, West Europe, Norway East, Sweden Central, UK South, UAE North), Digital Experience Cloud Service - NA Region (Canada East, Canada Central, East US, East US 2, North Central US, West US, West US 2), Optimizely Data Platform - NA Region (ODP Application, Event Collection, Data Ingestion and Processing, Campaigns, Core App Experiences), and Digital Experience Cloud Service - Management Portal.