Resolved -
This incident has been resolved. All data is current and up to date.
Apr 9, 22:38 PDT
Update -
We are continuing to monitor the health of the system. Data recovery is progressing as expected.
Apr 9, 09:28 PDT
Monitoring -
A fix has been implemented and we are monitoring the results. The results page and statistics are no longer utilizing stale data. In a subset of customers, events exports jobs have not completed, so feeds will continue to have latency while the system recovers.
Apr 8, 10:25 PDT
Update -
Performance across the application and API endpoints is recovered and in monitoring. The results page is loading however data continues to be stale as we continue to recover. No data has been lost during this incident, and experiments are continuing to accrue results. When the stats jobs complete, results will be brought to current, including statistical significance.
Apr 7, 21:45 PDT
Update -
Performance across the application is improving. The results page is loading however data is stale as we continue to recover.
Apr 7, 13:16 PDT
Update -
We are continuing with remediation steps to restore full product functionality.
Apr 7, 09:57 PDT
Identified -
The issue has been identified and remediation steps are being taken to restore full product functionality.
Apr 7, 06:47 PDT
Update -
The issue has been identified and remediation steps are being taken to restore full product functionality.
Apr 6, 19:34 PDT
Update -
We are continuing to actively investigate this issue.
Apr 6, 15:11 PDT
Update -
We are continuing to actively investigate this issue.
Apr 6, 11:32 PDT
Update -
This issue is also affecting performance across the application. We are actively investigating the issue.
Apr 6, 08:20 PDT
Update -
We are continuing to actively investigate this issue.
Apr 6, 07:44 PDT
Investigating -
We're currently experiencing an issue that is affecting all customers ability to load the results page. We are actively investigating this issue.
Apr 6, 06:22 PDT