Intro Every once in a while, a new cloud platform shows up that doesn’t just offer “more compute” . It rethinks what the cloud should look like in an AI-first world. That’s what caught my attention with Nebius, a European-born cloud designed from the ground up for high-performance, AI-centric workloads. One that just closed a …
Intro Deploying vLLM manually is fine for a lab, but running it in production means dealing with Kubernetes, autoscaling, GPU orchestration, and observability. That’s where the vLLM Production Stack comes in – a Terraform-based blueprint that delivers production-ready LLM serving with enterprise-grade foundations. In this post, we’ll deploy it on Amazon EKS, covering everything from …
Read more “vLLM Production Stack on Amazon EKS with Terraform🧑🏼🚀”
Intro If you’re looking to spin up a modern, secure Kubernetes cluster in Civo Cloud with full observability—this guide is for you. We’ll walk through deploying a Civo Talos K8s cluster using Terraform, and layer in Letsncrypt TLS certs, Prometheus and Grafana for monitoring. Whether you’re building a quick lab, testing a workload, or setting …
Read more “Zero to Civo: Deploy Talos Kubernetes with Terraform (incl Grafana & Prometheus)”
Intro Tired of sharing your IP & sensitive data to OpenAI ? What if you could run your own private AI chatbot powered by Local Inference & LLMs, with 100% data privacy—all inside a Kubernetes cluster?Today we’ll show you how to deploy an end-to-end LLM inference setup on a Civo Cloud Talos K8s cluster with …
Read more “Ollama deployment on Civo K8s Cluster with terraform”
Intro If you’ve ever set up Kubernetes clusters on Oracle Cloud with Terraform or Resource Manager, you’ve probably tried the OKE Quickstart modules. Sure, they’re a solid starting point—streamlined, efficient. But after diving deeper into them, I realized the stack wasn’t exactly easy to use and felt more readable to their builders than to us …
Read more “My moded OCI-OKE Terraform Module & why you should try it!”