vLLM for beginners: Deployment Options (PartIII)

by CloudDudeAI, LLM, VllmPosted on Comments are Disabled

Intro In Part 2 of our vLLM for beginners Series, we explored performance features like PagedAttention, attention backends, and prefill/decode optimization. In this final part, we’ll shift from theory to practice, covering how to deploy vLLM across different environments, from source builds to docker containers (K8s deployment will be covered separately). 💡In this series, we aim to provide …

Read more “vLLM for beginners: Deployment Options (PartIII)”

Zero to Civo: Deploy Talos Kubernetes with Terraform (incl Grafana & Prometheus)

by CloudDudeDevops, kubernetes, MultiCloud, terraformPosted on Comments are Disabled

Intro If you’re looking to spin up a modern, secure Kubernetes cluster in Civo Cloud with full observability—this guide is for you. We’ll walk through deploying a Civo Talos K8s cluster using Terraform, and layer in Letsncrypt TLS certs, Prometheus and Grafana for monitoring. Whether you’re building a quick lab, testing a workload, or setting …

Read more “Zero to Civo: Deploy Talos Kubernetes with Terraform (incl Grafana & Prometheus)”

HashiCorp Vault for Dummies: Transit Auto-Unseal Across 2 WSL Nodes

by CloudDudeAuth, Devops, DevSecOps, HashiCorp, VaultPosted on Comments are Disabled

Intro This is part two of our Vault for Dummies series. After setting up a Vault server with Raft and TLS in part1, we’ll now configure it to auto-unseal at startup using another Vault server as a Transit engine. Perfect if you want to simulate a cluster across nodes in WSL. This guide walks you …

Read more “HashiCorp Vault for Dummies: Transit Auto-Unseal Across 2 WSL Nodes”

vLLM for beginners: Key Features & Performance Optimization(PartII)

by CloudDudeAI, LLM, VllmPosted on Comments are Disabled

Intro In Part 1 of our vLLM for beginners Series, we covered the fundamentals—core concepts and terminology behind vLLM’s architecture. In Part 2, we go deeper into what makes vLLM excel at performance: features like PagedAttention, attention backends, prefill & decode management, and more. 💡This series is about building a strong foundation in vLLM—understanding how …

Read more “vLLM for beginners: Key Features & Performance Optimization(PartII)”

Terraform Pipelines for Dummies Part3: GitHub Actions Azure Deploy with OIDC

by CloudDudeAzure, CI/CD, Devops, GitHubPosted on Comments are Disabled

Intro Did you know that over 23 millions secrets were publicly exposed in GitHub in 2024 alone? and even 70% of the secrets leaked in 2022 are still valid? This is additional evidence that leaked secrets are still the number one biggest threat to your business. The worst thing to do is make it easy …

Read more “Terraform Pipelines for Dummies Part3: GitHub Actions Azure Deploy with OIDC”