vLLM Production Stack on Azure AKS with Terraform🧑🏼‍🚀

by CloudDudeAI, Azure, Devops, kubernetes, LLM, MultiCloud, terraform, VllmPosted on Comments are Disabled

Intro The vLLM Production Stack is designed to work across any cloud provider with Kubernetes. After covering AWS EKS, today we’re deploying vLLM production-stack on Azure AKS with the same Terraform approach. This guide shows you how to deploy the same production-ready LLM serving environment on Azure, with azure-specific optimizations. We’ll cover network architecture, certificate …

Read more “vLLM Production Stack on Azure AKS with Terraform🧑🏼‍🚀”

vLLM Production Stack on Amazon EKS with Terraform🧑🏼‍🚀

by CloudDudeAI, AWS, Devops, kubernetes, LLM, MultiCloud, terraform, VllmPosted on Comments are Disabled

Intro Deploying vLLM manually is fine for a lab, but running it in production means dealing with Kubernetes, autoscaling, GPU orchestration, and observability. That’s where the vLLM Production Stack comes in – a Terraform-based blueprint that delivers production-ready LLM serving with enterprise-grade foundations. In this post, we’ll deploy it on Amazon EKS, covering everything from …

Read more “vLLM Production Stack on Amazon EKS with Terraform🧑🏼‍🚀”

Zero to Civo: Deploy Talos Kubernetes with Terraform (incl Grafana & Prometheus)

by CloudDudeDevops, kubernetes, MultiCloud, terraformPosted on Comments are Disabled

Intro If you’re looking to spin up a modern, secure Kubernetes cluster in Civo Cloud with full observability—this guide is for you. We’ll walk through deploying a Civo Talos K8s cluster using Terraform, and layer in Letsncrypt TLS certs, Prometheus and Grafana for monitoring. Whether you’re building a quick lab, testing a workload, or setting …

Read more “Zero to Civo: Deploy Talos Kubernetes with Terraform (incl Grafana & Prometheus)”

Terraform Pipelines for Dummies Part3: GitHub Actions Azure Deploy with OIDC

by CloudDudeAzure, CI/CD, Devops, GitHubPosted on Comments are Disabled

Intro Did you know that over 23 millions secrets were publicly exposed in GitHub in 2024 alone? and even 70% of the secrets leaked in 2022 are still valid? This is additional evidence that leaked secrets are still the number one biggest threat to your business. The worst thing to do is make it easy …

Read more “Terraform Pipelines for Dummies Part3: GitHub Actions Azure Deploy with OIDC”

Ollama deployment on Civo K8s Cluster with terraform

by CloudDudeAI, kubernetes, LLM, Ollama, terraformPosted on Comments are Disabled

Intro Tired of sharing your IP & sensitive data to OpenAI ? What if you could run your own private AI chatbot powered by Local Inference & LLMs, with 100% data privacy—all inside a Kubernetes cluster?Today we’ll show you how to deploy an end-to-end LLM inference setup on a Civo Cloud Talos K8s cluster with …

Read more “Ollama deployment on Civo K8s Cluster with terraform”