Configured Commerce - Degradation of sandbox environments in US region
Incident
Report for Optimizely Service
Resolved
We are resolving this issue as it has been successfully mitigated for the vast majority of clients. While we are seeing the normal background rate for sporadic DNS resolution failures, it is still possible for a very limited subset of clients to experience occasional impacts in the sandbox environment until we fully implement necessary infrastructure configuration changes. In the meantime, we have a workaround in place, and we are also working with our third-party supplier to obtain an RCA for additional context surrounding this incident.
Update
We are continuing to make positive progress with our third party supplier and we thank you for your patience during this time. We will continue to provide additional updates as they become available.
Update
We remain engaged with our third party provider who are continuing to works towards a root cause identification and a full resolution
Update
The issue remains ongoing with no additional updates at this time
Update
Efforts with our third party provider remain ongoing and positive in driving towards a resolution and root cause analysis
Identified
We have identified the mechanism of failure and we are continuing to work with our third party supplier to work towards a full mitigation.
Update
We are continuing to make positive progress with our third party supplier and we thank you for your patience during this time. We will continue to provide additional updates as they become available.
Update
We have applied a mitigation that addresses the impact on production and we are continuing to work on mitigation measures with our third party supplier for the impact on the sandbox environments.
Update
The ongoing incident has escalated in severity over time. Unfortunately, we have identified a limited subset of clients whose production environments are now being directly impacted. Our teams are continuing to actively work to resolve the issue as quickly as possible and we are committed to minimizing further disruptions.
Update
This issue remains under investigation by our third party supplier and we are continuing to push for a resolution
Update
We are continuing to work closely with our third party supplier to drive towards a resolution. Positive progress is being made but there is no eta on resolution at this time.
Update
Our third party supplier is continuing to investigate this issue as a priority and progress is being made. Additional updates will be provided once they are available. Thank you for your patience as we work towards a resolution.
Update
This issue remains under active investigation and is being treated as a high priority by our third party supplier. We are continuing to push for a timely resolution and thank you for your patience.
Update
The investigation remains ongoing with our third party provider as a high priority issue and we will continue to provide updates as they become available. Thank you for your patience.
Update
Our third-party supplier continues to investigate the matter. While we don’t have new details to share at this time, we’ll keep this space updated with any developments as soon as they become available.
Update
The investigation by our third party supplier remains ongoing. We will post updates here as they become available.
Update
This issue remains under investigation by our third party supplier. Thank you for your patience while we push for a timely resolution.
Investigating
We are currently aware of an active incident with a third party supplier that is impacting Configured Commerce sandbox environments in the US region. We are continuing to work with our third party supplier to get this resolved as soon as possible. Updates will be posted here as soon as they become available.
This incident affected: Configured Commerce – NA Region.