KubernetesScaling LLM Inference on Kubernetes with llm-d, WebAssembly, and TornadoVM2 min read·11d ago·via InfoQ AI/ML/Data
GCPReplacing Round‑Robin Load Balancing with GKE Inference Gateway to Quadruple Batch Inference Throughput4 min read·29d ago·via Google Cloud Blog
GCPDay‑0 support for Beam inference optimization on Google Cloud with llm‑d and NVIDIA Dynamo4 min read·1mo ago·via Google Cloud Blog