Intro Welcome back to the terraform vLLM Production Stack series! After covering AWS EKS and Azure AKS, today we’re deploying vLLM production-stack on Google Cloud GKE with the same Terraform approach. This guide shows you how to deploy a production-ready LLM serving environment on Google Cloud, with GCP-specific optimizations including Dataplane V2 (Cilium eBPF), VPC-native …
Read more “vLLM Production Stack on GCP GKE with Terraform🧑🏼🚀”
Intro The vLLM Production Stack is designed to work across any cloud provider with Kubernetes. After covering AWS EKS, today we’re deploying vLLM production-stack on Azure AKS with the same Terraform approach. This guide shows you how to deploy the same production-ready LLM serving environment on Azure, with azure-specific optimizations. We’ll cover network architecture, certificate …
Read more “vLLM Production Stack on Azure AKS with Terraform🧑🏼🚀”
Intro Deploying vLLM manually is fine for a lab, but running it in production means dealing with Kubernetes, autoscaling, GPU orchestration, and observability. That’s where the vLLM Production Stack comes in – a Terraform-based blueprint that delivers production-ready LLM serving with enterprise-grade foundations. In this post, we’ll deploy it on Amazon EKS, covering everything from …
Read more “vLLM Production Stack on Amazon EKS with Terraform🧑🏼🚀”
Intro This is part three of our Vault for Dummies series. After Part 2 where we set up Vault with Transit Auto-unseal, it’s time to tackle Kubernetes authentication, from outside the cluster. In this post, we’ll walk through setting up Kubernetes auth with an external Vault, so your K8s workloads can securely authenticate and pull …
Read more “HashiCorp Vault for Dummies: K8s Auth setup in an External Vault (WSL)”
Intro The GitHub Actions Certification is a go-to credential for developers and DevOps engineers looking to validate their CI/CD skills with GitHub. Launched in 2024, the GitHub Certification program was a welcome move—especially after they slashed their prices from $200 to $99. This exam focuses on practical knowledge—building, consuming, and securing workflows at scale. In …
Read more “How to pass the GitHub Actions certification (cheat-sheet)”