No components marked as affected
Resolved
Cognite Engineering has closed this incident, as we have not had additional requests from customers to restore configurations since the last update.
Monitoring
The last extraction pipeline configurations were restored at 18:00 UTC, on December 13th. Cognite engineering has confirmed that configs for all pipelines without active configurations now have had their old configurations restored. Customers are still advised to verify that their extraction pipelines are working and that there are valid configurations for all of them.
Identified
Cognite Engineering has deployed a fix that prevents further deletes of the extraction pipeline configurations. The engineering team has established that the undesired deletes happened on December 8th, between 15 and 16 GMT. Customers can determine if they are impacted by checking their extraction pipelines. Customers can see that one of the following has happened: (1) all configuration revisions are removed, (2) only the oldest revisions are deleted, or (3) nothing is deleted.Cognite is preparing to restore revisions from backup for the customers that find that their extraction pipelines are not working. Customers should notify support@cognite.com in case they see that they are impacted by this problem. Cognite will restore the configurations that we already have found to be deleted, but customers should notify Support to be on the safe side.
Investigating
Cognite engineering is currently investigating an issue where the configurations used by extraction pipelines are missing from the EUR-W3 cluster. The problem seens to have started on December 8th, at around 15:30 UTC, and Cognite is now trying to recover the information.
The impact of this problem is that data will become stale in CDF. New data from extractors will not be fed to customer's CDF instances.