Category: AI

Intro Every generation from an LLM is shaped by parameters under the hood. Knowing how to tune is important so that you can produce sharp and more controlled outputs. Here are the 7 levers that matter most. Make sure to try the interactive playground at the bottom to visualize and play with each parameter. 1) …

Read more “7 LLM output Parameters (Top-K & Friends)”

Intro Today, most of us have used nano banana, Midjourney, Kling AI, Luma, or Sora to generate silly videos or catchy images on socials. But what do they share in common? They all rely on Diffusion Models as their core engine, even the brand new Seedance. While many of these are proprietary, the open-source world …

Read more “Diffusion Models explained: From Noise to Pixels”

Intro A few weeks ago I wrote about why Intel Optane Persistent Memory was the ideal technology for LLM KV-cache offloading with a near-DRAM latency, and natively non-volatile. In other words, it behaved like memory but survived reboots. I also explained why CXL wasn’t quite the performance equivalent, due to higher latency and non persistence. But recently …

Read more “NVIDIA’s 𝗖𝗼𝗻𝘁𝗲𝘅𝘁 𝗠𝗲𝗺𝗼𝗿𝘆 𝗦𝘁𝗼𝗿𝗮𝗴𝗲 (CMX): The KV Cache War”