The issue affecting Data Modeling Storage (DMS) services on the az-eastus-1 cluster has been resolved. All services are now operating normally.

Cognite has deployed a fix for the issue causing intermittent 5xx errors on the Data Modeling Service (DMS) in the az-eastus-1 cluster. All related SLO alerts have cleared and background tasks have resumed normal operation. We are continuing to observe the cluster closely before resolving the incident.

We will post a further update once monitoring confirms full stability.

Cognite has reviewed deployment history, logs, and network dependencies. An internal process was found to be blocking operations. Cognite has stopped that process. The rates on the 500 errors has dropped, and the responsible engineering teams will resume investigation tomorrow.

Engineers have identified a mitigation action and are working on a temporary solution, as well as monitoring the situation.

The engineers have identified the root cause and are working on a solution.

Problem: The datamodelstorage service in az-eastus-1 is experiencing periodic spikes to 100% 5xx error rates, resulting in major outages for users.

Impact: Multiple customers are receiving repeated 503 errors. All users on this cluster are likely affected.

Sev A declared.