Your Own Private LLM Farm: Bare-Metal K8s With GPU Autoscaling
I wanted my own LLM inference setup on bare metal — GPU-backed K8s, autoscaling that actually works with vLLM metrics, and auth so random internet people can’t drain my GPU credits. Here’s how it went.