vLLM Production Stack on Azure AKS with Terraform🧑🏼‍🚀

by CloudDudeAI, Azure, Devops, kubernetes, LLM, MultiCloud, terraform, VllmPosted on Comments are Disabled

Intro The vLLM Production Stack is designed to work across any cloud provider with Kubernetes. After covering AWS EKS, today we’re deploying vLLM production-stack on Azure AKS with the same Terraform approach. This guide shows you how to deploy the same production-ready LLM serving environment on Azure, with azure-specific optimizations. We’ll cover network architecture, certificate …

Read more “vLLM Production Stack on Azure AKS with Terraform🧑🏼‍🚀”

Meet Nebius: The Cloud Built for the AI Era

by CloudDudeAI, LLM, MultiCloud, NeoCloudsPosted on Comments are Disabled

Intro Every once in a while, a new cloud platform shows up that doesn’t just offer “more compute” . It rethinks what the cloud should look like in an AI-first world. That’s what caught my attention with Nebius, a European-born cloud designed from the ground up for high-performance, AI-centric workloads. One that just closed a …

Read more “Meet Nebius: The Cloud Built for the AI Era”

vLLM Production Stack on Amazon EKS with Terraform🧑🏼‍🚀

by CloudDudeAI, AWS, Devops, kubernetes, LLM, MultiCloud, terraform, VllmPosted on Comments are Disabled

Intro Deploying vLLM manually is fine for a lab, but running it in production means dealing with Kubernetes, autoscaling, GPU orchestration, and observability. That’s where the vLLM Production Stack comes in – a Terraform-based blueprint that delivers production-ready LLM serving with enterprise-grade foundations. In this post, we’ll deploy it on Amazon EKS, covering everything from …

Read more “vLLM Production Stack on Amazon EKS with Terraform🧑🏼‍🚀”

Zero to Civo: Deploy Talos Kubernetes with Terraform (incl Grafana & Prometheus)

by CloudDudeDevops, kubernetes, MultiCloud, terraformPosted on Comments are Disabled

Intro If you’re looking to spin up a modern, secure Kubernetes cluster in Civo Cloud with full observability—this guide is for you. We’ll walk through deploying a Civo Talos K8s cluster using Terraform, and layer in Letsncrypt TLS certs, Prometheus and Grafana for monitoring. Whether you’re building a quick lab, testing a workload, or setting …

Read more “Zero to Civo: Deploy Talos Kubernetes with Terraform (incl Grafana & Prometheus)”

Ollama deployment on Civo K8s Cluster with terraform

by CloudDudeAI, kubernetes, LLM, Ollama, terraformPosted on Comments are Disabled

Intro Tired of sharing your IP & sensitive data to OpenAI ? What if you could run your own private AI chatbot powered by Local Inference & LLMs, with 100% data privacy—all inside a Kubernetes cluster?Today we’ll show you how to deploy an end-to-end LLM inference setup on a Civo Cloud Talos K8s cluster with …

Read more “Ollama deployment on Civo K8s Cluster with terraform”