PD-Disaggregated Inference Deployment with sgl-project/rbg
Use RoleBasedGroup to run SGLang Prefill/Decode disaggregation as one operable unit: routing, startup dependencies, multi-node tensor parallelism, KV transfer, and coordinated rollouts.
CFN Cloud
Kubernetes, GPU, and AI Infrastructure Guides
Practical tools
Use the tools while you read
Browse by topic
Popular topics
Editors' picks
Featured reads
Kubernetes Probes: Liveness, Readiness, and Startup
Use better Kubernetes probes by choosing the right signal, tuning thresholds, and avoiding false restarts, traffic drops, and noisy rollouts.
Linux Memory Allocation: malloc, brk, mmap, and RSS
Use a reproducible program, /proc, and strace to inspect how glibc malloc uses brk, mmap, and madvise, and why RSS may stay high after free.
Kubernetes Ephemeral Containers: Safe Production Debugging
Safely inspect a live Pod without baking debugging tools into production images.
Kubernetes NetworkPolicy: Default Deny, DNS, and Safe Rollout
A concrete rollout path for Kubernetes NetworkPolicy: start with default deny, whitelist DNS and key dependencies, and avoid breaking production traffic.
Startup GPU Costs: Serverless, Dedicated, and Hybrid Capacity
Calculate Serverless versus dedicated GPU break-even using effective GPU hours, cold starts, idle capacity, operations, and SLOs, then plan hybrid capacity.
Read by topic
Topic guides
Kubernetes
A curated reading track for Kubernetes.
Systems
A curated reading track for Systems.
GPU
A curated reading track for GPU.
Latest posts
Recent writing
Kubernetes StorageClass: Provisioning, Defaults, and Debugging
Understand how StorageClass enables dynamic provisioning in Kubernetes, how default classes work, and how to choose the right storage policy.
Kubernetes PV and PVC: Binding, Reclaim Policy, and Storage Debugging
Learn how PersistentVolumes and PersistentVolumeClaims work in Kubernetes, how binding happens, and how to troubleshoot storage lifecycle issues.
Kubernetes Ephemeral Volumes: emptyDir, Caches, and Scratch Data
Use emptyDir, memory-backed volumes, and generic ephemeral volumes for caches, build spaces, and sidecar data while managing scheduling, eviction, and cleanup.
Kubernetes Volumes: Temporary Data, Mounts, and Storage Choices
Learn the core Kubernetes volume types, what data survives Pod restarts, and how to choose between temporary and persistent storage.
Kubernetes ConfigMaps and Secrets: Safe Configuration Patterns
Understand when to use ConfigMap or Secret in Kubernetes, how they reach Pods, and which practices reduce config drift and secret exposure.
Running MySQL on Kubernetes: Storage, Access, and Backup Boundaries
Learn the essentials of running MySQL on Kubernetes, including StatefulSets, persistent storage, Services, and operational tradeoffs.
Stateful Apps on Kubernetes: Storage, Identity, and Upgrade Pace
A concrete guide to stateful applications on Kubernetes, covering storage choices, stable identities, rollout concerns, and failure handling.
Kubernetes Canary Releases: Rollout, Signals, and Rollback
Learn practical canary release patterns in Kubernetes, how to reduce rollout risk, and which signals to watch before promoting traffic.
Kubernetes Declarative Config: apply, diff, and Review
Understand declarative configuration in Kubernetes, why desired state matters, and how apply, diff, and reconciliation shape safe operations.
Kubernetes Namespace: Isolation Boundaries, Naming, and Access Control
Learn how Kubernetes Namespaces organize resources, scope policies and quotas, and support safer multi-team or multi-environment clusters.
Kubernetes Service: Stable Entry Points, Endpoints, and Traffic Paths
Learn how Kubernetes Services provide stable networking for Pods, how service types differ, and how to troubleshoot selectors, endpoints, and traffic flow.
Kubernetes Deployment and ReplicaSet: Replicas, Rollouts, and Rollback
Learn how Deployments and ReplicaSets work together in Kubernetes, how rolling updates happen, and how to debug rollout and selector problems.
Kubernetes Pod: Lifecycle, Scheduling, and Debugging Entry Point
Understand what a Pod really is in Kubernetes, how Pods are scheduled and restarted, and which commands help you debug them.
K3s Quick Start: Installation, Edge Use, and Host Checks
Learn when to use K3s, how to install it quickly, and how to run core Kubernetes workloads on a lightweight cluster for labs and edge environments.
Minikube Local Cluster: Setup, Networking Boundaries, and Reset
Build a repeatable local Kubernetes cluster with Minikube, then verify networking, image loading, and reset workflows.
Kubernetes Introduction: What It Solves and What It Does Not
A concrete introduction to Kubernetes: what problems it solves, what it does not solve, and how desired state and controllers work in real clusters.
Kubernetes Architecture: Control Plane, Nodes, and Reconciliation
Understand Kubernetes architecture from the control plane to worker nodes, including the API server, scheduler, controllers, kubelet, and reconciliation loops.
Kubernetes Learning Path: What to Learn First and What to Defer
A step-by-step Kubernetes learning path covering core concepts, workloads, networking, storage, and troubleshooting so you can study in the right order.
Kubernetes Basics: Objects, YAML, and Failure Handling
Understand Pods, Deployments, Services, and Namespaces through the way Kubernetes actually reconciles and fails, then verify changes with real commands.