AI Archives - Cloudthrill

vLLM Production Stack on Nebius K8s with Terraform🧑🏼‍🚀

by CloudDudeAI, Devops, kubernetes, LLM, Nebius, NeoClouds, terraform, Vllm January 20, 2026January 20, 2026Comments are Disabled

Intro The vLLM Production Stack is designed to work across any cloud provider with Kubernetes. After covering AWS EKS, Azure AKS, and Google Cloud GKE implementations, today we’re deploying vLLM production-stack on Nebius Managed Kubernetes (MK8s) with the same Terraform approach. Nebius AI Cloud is purpose-built for AI/ML workloads, offering cutting-edge GPU options from NVIDIA …

vLLM Production Stack on GCP GKE with Terraform🧑🏼‍🚀

by CloudDudeAI, Devops, GCP, kubernetes, LLM, terraform, Vllm December 16, 2025December 16, 2025Comments are Disabled

Intro Welcome back to the terraform vLLM Production Stack series! After covering AWS EKS and Azure AKS, today we’re deploying vLLM production-stack on Google Cloud GKE with the same Terraform approach. This guide shows you how to deploy a production-ready LLM serving environment on Google Cloud, with GCP-specific optimizations including Dataplane V2 (Cilium eBPF), VPC-native …

The link That Never Was: Intel Optane PMem + LLM KV Cache Offload

by CloudDudeAI, LLM, Vllm December 9, 2025January 25, 2026Comments are Disabled

Intro The world of LLMs is dominated by one expensive bottleneck: GPU memory. This directly impacts how many models can fit and how fast can they generate text, especially in multi-turn conversations or for processing long contexts. The solution is KV Cache Offloading (i.e with LMCache). One technology was perfectly suited to supercharge it, Intel …

vLLM Production Stack on Azure AKS with Terraform🧑🏼‍🚀

by CloudDudeAI, Azure, Devops, kubernetes, LLM, MultiCloud, terraform, Vllm December 2, 2025December 2, 2025Comments are Disabled

Intro The vLLM Production Stack is designed to work across any cloud provider with Kubernetes. After covering AWS EKS, today we’re deploying vLLM production-stack on Azure AKS with the same Terraform approach. This guide shows you how to deploy the same production-ready LLM serving environment on Azure, with azure-specific optimizations. We’ll cover network architecture, certificate …

Meet Nebius: The Cloud Built for the AI Era

by CloudDudeAI, LLM, MultiCloud, NeoClouds November 25, 2025November 25, 2025Comments are Disabled

Intro Every once in a while, a new cloud platform shows up that doesn’t just offer “more compute” . It rethinks what the cloud should look like in an AI-first world. That’s what caught my attention with Nebius, a European-born cloud designed from the ground up for high-performance, AI-centric workloads. One that just closed a …

Latest Podcasts

Category: AI

vLLM Production Stack on Nebius K8s with Terraform🧑🏼‍🚀

vLLM Production Stack on GCP GKE with Terraform🧑🏼‍🚀

The link That Never Was: Intel Optane PMem + LLM KV Cache Offload

vLLM Production Stack on Azure AKS with Terraform🧑🏼‍🚀

Meet Nebius: The Cloud Built for the AI Era