vLLM Production Stack on GCP GKE with Terraform๐Ÿง‘๐Ÿผโ€๐Ÿš€

by CloudDudeAI, Devops, GCP, kubernetes, LLM, terraform, VllmPosted on Comments are Disabled

Intro Welcome back to the terraform vLLM Production Stack series! After covering AWS EKS and Azure AKS, today we’re deploying vLLM production-stack on Google Cloud GKE with the same Terraform approach. This guide shows you how to deploy a production-ready LLM serving environment on Google Cloud, with GCP-specific optimizations including Dataplane V2 (Cilium eBPF), VPC-native …

Read more “vLLM Production Stack on GCP GKE with Terraform๐Ÿง‘๐Ÿผโ€๐Ÿš€”

Terraform for dummies part 4: Launch an vm with a static website on GCP

by CloudDudeUncategorizedPosted on Comments are Disabled

Intro After AWS,Oracle Cloud, and Azure, GCP is the 4th cloud platform in our terraform tutorial series, we will describe what it takes to authenticate and provision a compute engine using their terraform provider. The instance will also have an nginx website linked to its public IP. If you want to know about the differences …

Read more “Terraform for dummies part 4: Launch an vm with a static website on GCP”

Google SDK (CLI for GCP) installation and few CLI examples

by CloudDudeUncategorizedPosted on Comments are Disabled

Intro Google as most of the cloud providers today, offers a simple Cloud shell solution with all required tools to connect to their platform securely using APIs. However, If you still want to have it in your laptop along with other development tools, you can always install Google Cloud SDK (especially if itโ€™s for educational …

Read more “Google SDK (CLI for GCP) installation and few CLI examples”

GCP Short lab: launch an instance, Startup script & test logging via CloudShell

by CloudDudeUncategorizedPosted on Comments are Disabled

                                         Intro GCP Cloud Shell not only allows to execute and automate tasks around your Cloud resources, but It can help you understand what happens behind the scene when a vm is provisioned for example. Thatโ€™s also a good way to prepare for the GCP Cloud engineer certification. Although it normally takes a subscription to …

Read more “GCP Short lab: launch an instance, Startup script & test logging via CloudShell”

GCP Associate Cloud engineer certification takeaways

by CloudDudeUncategorizedPosted on Comments are Disabled

Intro I have been asked lately to share some prep tips after I passed the GCP Associate Cloud Engineer Certification.  Although there are tons of articles online describing the exam content and many resource materials to help prepare for the exam, I decided to share my thoughts around the preparation journey along with my feedback …

Read more “GCP Associate Cloud engineer certification takeaways”