Live
Cloudflare Images Analytics Dashboard Adds 30‑Day Delivery VisibilityAmazon ECS Adds Native Blue/Green, Canary, and Linear Deployments for Safer Container RolloutsGemini agentic tools add LLM‑driven automation to Partner Marketing StudioGitHub Actions makes RHEL 9/10 runner images generally available for larger workloadsIntegrating Decider Models to Reduce Latency and Cost in AI Agent WorkflowsAWS Emulator Enables Local Testing of 200+ Services, but Lacks IAM ValidationSageMaker AI monitoring adds automatic latency drift, idle GPU, and configuration gap detection for inference endpointsEmbedding Proactive Governance into Enterprise‑Scale Agentic AICloudflare Images Analytics Dashboard Adds 30‑Day Delivery VisibilityAmazon ECS Adds Native Blue/Green, Canary, and Linear Deployments for Safer Container RolloutsGemini agentic tools add LLM‑driven automation to Partner Marketing StudioGitHub Actions makes RHEL 9/10 runner images generally available for larger workloadsIntegrating Decider Models to Reduce Latency and Cost in AI Agent WorkflowsAWS Emulator Enables Local Testing of 200+ Services, but Lacks IAM ValidationSageMaker AI monitoring adds automatic latency drift, idle GPU, and configuration gap detection for inference endpointsEmbedding Proactive Governance into Enterprise‑Scale Agentic AI
Cloudflare

Durable Object Storage Improves Runtime Update Resilience by Pre‑emptive Node Eviction

AI SummaryPowered by AI

Cloudflare now removes a Durable Object machine from its write‑majority group before the machine restarts, allowing a replacement to take over during runtime updates. This reduces the window where writes can miss a majority, decreasing the frequency of storage‑reset errors that drop WebSocket connections.

Cloudflare has changed the way Durable Object storage handles node restarts during runtime updates: a machine that is about to restart now proactively removes itself from the write‑majority quorum, letting a fresh instance join before the restart completes. The change shortens the period where a write might fail to achieve a majority, which previously could cause the object to reset and drop any attached WebSocket sessions.

What Changed in the Consensus Mechanism

Each write to a Durable Object must be acknowledged by a majority of machines in its replication group. The new behavior forces the restarting machine to step out of that group early, so the remaining nodes can maintain a full majority without waiting for the restart to finish. Previously, the node stayed in the group until the restart completed, which could take a few minutes and leave the quorum short‑of‑majority.

Effect on WebSocket‑Based Durable Objects

When the quorum drops, writes may be rejected and the runtime emits the error Internal error in Durable Object storage caused object to be reset. That error forces the Durable Object to reset and closes any open WebSocket connections. By reducing the quorum‑loss window, the update is expected to lower the incidence of such resets, especially for SQLite‑backed objects that write infrequently, such as those using WebSocket hibernation. Actual impact will vary with traffic patterns and write frequency.

Operational Implications

  • No configuration changes are required; the improvement is live in all regions.
  • Monitoring for WebSocket disconnects should continue, as occasional resets can still occur during runtime updates.
  • Teams that rely on long‑lived WebSocket connections may see fewer unexpected closures, simplifying client‑side reconnection logic.
  • Workloads with frequent storage writes may observe a modest reduction in write latency spikes caused by quorum re‑formation.

Related CloudNinjas coverage: hands-on guides.

What This Means For Practitioners

Expect a smoother experience during runtime updates of Durable Objects, with fewer storage‑reset errors and less disruption to WebSocket clients. Continue to implement robust reconnection handling, and monitor error metrics to confirm the improvement aligns with your workload characteristics.

Originally published atCloudflare Developer Platform