Live
GitHub secret scanning adds SpaceX partner and refines false‑positive filtersOpen‑Source Nemotron LLMs: What Engineers Need to Know for Self‑Hosted DeploymentRunning Stateful AI Agents on GKE with Agent SubstrateDocker Hardened Images now pull curated packages from ActiveStateBigQuery’s AI.AGG brings native semantic aggregation to petabyte‑scale queriesFull‑Stack Memory Codesign Reduces AI Inference Footprint and Boosts ThroughputDocusign Model Context Protocol hits GA: practical impact on AI‑agent integration and securityA Kubernetes‑Native Pattern for Open‑Weight Model Serving, Fine‑Tuning, and Secure Agent ExecutionGitHub secret scanning adds SpaceX partner and refines false‑positive filtersOpen‑Source Nemotron LLMs: What Engineers Need to Know for Self‑Hosted DeploymentRunning Stateful AI Agents on GKE with Agent SubstrateDocker Hardened Images now pull curated packages from ActiveStateBigQuery’s AI.AGG brings native semantic aggregation to petabyte‑scale queriesFull‑Stack Memory Codesign Reduces AI Inference Footprint and Boosts ThroughputDocusign Model Context Protocol hits GA: practical impact on AI‑agent integration and securityA Kubernetes‑Native Pattern for Open‑Weight Model Serving, Fine‑Tuning, and Secure Agent Execution
Google Cloud

Running Stateful AI Agents on GKE with Agent Substrate

AI SummaryPowered by AI

Google announced that Agent Substrate has reached GA on GKE and, together with gVisor and OpenRL, has been donated to the CNCF Sandbox. This provides engineers a cloud‑native stack for scaling isolated, stateful agent workloads while reducing idle compute overhead and adding sandboxed execution.

Google has moved three internal projects—Agent Substrate, gVisor, and OpenRL—into the CNCF Sandbox and released Agent Substrate version 1.0 as a generally available offering on GKE. The change replaces ad‑hoc container patterns for autonomous agents with an open, CNCF‑governed stack that promises higher density, faster resume times, and built‑in isolation.

Agent Substrate 1.0 on GKE

The new GA release decouples an agent’s identity and state from the compute that runs it. When an agent pauses—waiting for model inference, external API responses, or human input—the runtime snapshots the idle environment to storage and can restore it in under 500 milliseconds. This approach eliminates the need to keep a dedicated container alive during idle periods, allowing operators to run millions of sandboxes at roughly ten times the density of traditional containers. The stack is advertised as compatible with any Kubernetes cluster, any cloud, and CPU, GPU, or TPU nodes.

Secure Execution with gVisor

Agents frequently generate and execute code that has not been reviewed. Running such code in standard containers shares the host Linux kernel, which the source flags as a security risk. gVisor addresses this by providing a lightweight userspace application kernel that isolates generated code while preserving container packing density on any Linux node. The isolation is presented as a sandboxing layer rather than a full VM, keeping the performance profile suitable for high‑density workloads.

Reinforcement‑Learning Loops with OpenRL

Training agents with reinforcement learning requires massive parallel rollouts. OpenRL orchestrates these rollouts as plain Python processes on Kubernetes, enabling self‑hosted post‑training loops without proprietary services. The project is positioned as an open‑source alternative for distributing RL training and serving workloads across the same Kubernetes infrastructure used for inference.

Related CloudNinjas coverage: Google Cloud.

What This Means For Practitioners

Practitioners should evaluate whether their agent pipelines can benefit from the snapshot‑restore model of Agent Substrate. If idle‑time dominates workload cost, adopting the stack could reduce memory footprints and increase overall throughput. Security‑focused teams need to assess the sandbox guarantees of gVisor against their threat model, especially when executing untrusted code. Teams already using Kubernetes for RL workloads can experiment with OpenRL to consolidate training and serving on a single platform. Because the projects are now in the CNCF Sandbox, organizations should monitor the onboarding progress and consider contributing to the governance process to influence future direction. A phased rollout—starting with non‑production workloads—will allow teams to validate restore latency, density claims, and isolation behavior before committing to production workloads.

Originally published atGoogle Cloud Blog