Intro In Part 1, we explored what zrok is, its key features, and how it compares conceptually to ngrok as a self-hostable alternative. Now, it’s time to put the spotlight on Ngrok . In this post, weโll walk through Ngrok installation, setup, and real-world usageโstarting by a head-to-head feature comparison to see how these two …
Read more “Turn Your Localhost into a FREE Public URL with Ngrok & Zrok -part 2”
Intro Welcome back to the terraform vLLM Production Stack series! After covering AWS EKS and Azure AKS, today we’re deploying vLLM production-stack on Google Cloud GKE with the same Terraform approach. This guide shows you how to deploy a production-ready LLM serving environment on Google Cloud, with GCP-specific optimizations including Dataplane V2 (Cilium eBPF), VPC-native …
Read more “vLLM Production Stack on GCP GKE with Terraform๐ง๐ผโ๐”
Intro The vLLM Production Stack is designed to work across any cloud provider with Kubernetes. After covering AWS EKS, today we’re deploying vLLM production-stack on Azure AKS with the same Terraform approach. This guide shows you how to deploy the same production-ready LLM serving environment on Azure, with azure-specific optimizations. We’ll cover network architecture, certificate …
Read more “vLLM Production Stack on Azure AKS with Terraform๐ง๐ผโ๐”
Intro Deploying vLLM manually is fine for a lab, but running it in production means dealing with Kubernetes, autoscaling, GPU orchestration, and observability. Thatโs where the vLLM Production Stack comes in – a Terraform-based blueprint that delivers production-ready LLM serving with enterprise-grade foundations. In this post, we’ll deploy it on Amazon EKS, covering everything from …
Read more “vLLM Production Stack on Amazon EKS with Terraform๐ง๐ผโ๐”
Intro This is part three of our Vault for Dummies series. After Part 2 where we set up Vault with Transit Auto-unseal, itโs time to tackle Kubernetes authentication, from outside the cluster. In this post, weโll walk through setting up Kubernetes auth with an external Vault, so your K8s workloads can securely authenticate and pull …
Read more “HashiCorp Vault for Dummies: K8s Auth setup in an External Vault (WSL)”