CloudDude, Author at Cloudthrill

vLLM Production Stack on Amazon EKS with Terraform🧑🏼‍🚀

by CloudDudeAI, AWS, Devops, kubernetes, LLM, MultiCloud, terraform, Vllm November 18, 2025November 18, 2025Comments are Disabled

Intro Deploying vLLM manually is fine for a lab, but running it in production means dealing with Kubernetes, autoscaling, GPU orchestration, and observability. That’s where the vLLM Production Stack comes in – a Terraform-based blueprint that delivers production-ready LLM serving with enterprise-grade foundations. In this post, we’ll deploy it on Amazon EKS, covering everything from …

LLM Embeddings Explained Like I’m 5

by CloudDudeAI, LLM, Vllm October 21, 2025October 23, 2025Comments are Disabled

Intro We often hear about RAG (Retrieval-Augmented Generation) and vector databases that store embeddings, but we fail to remember what exactly are embeddings used for and how they work. In this post, we’ll break down how embeddings work – in the simplest way possible (yes, like you’re 5 🧠📎). I. What is an Embedding? Embeddings …

vLLM production-stack: LLM inference for Enterprises (part1)

by CloudDudeAI, LLM, Vllm September 23, 2025October 23, 2025Comments are Disabled

Intro If you’ve played with vLLM locally you already know how fast it can crank out tokens. But the minute you try to serve real traffic with multiple models, thousands of chats, you hit the same pain points the community kept reporting: ⚠️ Pain point What you really want High GPU bill Smarter routing + …

Safety Detectives Interview with CloudThrill CEO Kosseila Hd

by CloudDudePress September 13, 2025September 13, 2025Comments are Disabled

Our Founder & CEO, Kosseila Hd, recently sat down with SafetyDetectives to share CloudThrill’s vision on why the real AI revolution lies in infrastructure rather than just apps, and what that means for organizations building and owning their private, scalable AI.

Recursive `.𝑔𝑖𝑡𝑖𝑔𝑛𝑜𝑟𝑒`: When Ignoring Goes Too Far

by CloudDudeCI/CD, GitHub August 26, 2025August 26, 2025Comments are Disabled

intro You might have heard of the “recursive .gitignore symptom”, or maybe you haven’t—but if you work with Git long enough, there’s a good chance you’ll run into it. It’s one of those sneaky issues that can cause unexpected behavior in your repositories, making files disappear from Git tracking when you least expect it. Imagine …

Latest Podcasts

Author: CloudDude

vLLM Production Stack on Amazon EKS with Terraform🧑🏼‍🚀

LLM Embeddings Explained Like I’m 5

vLLM production-stack: LLM inference for Enterprises (part1)

Safety Detectives Interview with CloudThrill CEO Kosseila Hd

Recursive `.𝑔𝑖𝑡𝑖𝑔𝑛𝑜𝑟𝑒`: When Ignoring Goes Too Far