DevConf.US 2026

Stop Wasting GPU Workloads in K8
2026-09-24 , 106 (Capacity 45)

gpu-pruner is a Kubernetes idle-GPU culler for vanilla k8. It watches NVIDIA DCGM metrics via Prometheus, finds pods with little or no GPU utilization over a configured time window, and safely scales their respective resources (Deployments, StatefulSets, Notebooks, InferenceServices, and Leaderworkersets) to zero, so users can scale them back up when needed.