Alexa Griffith

KubeCon NA 2026

Alexa Griffith ● Red Hat AI

Salt Lake City · slides, repos and everything from my talks

My talks
⚡ Cache Me If You Can: LLM Inference with llm-dWed Nov 11 · 11:00 · Hyatt Regency, Ballroom C view slides ☁ Cloud Native With a Chance of TokensTip Talk · Tue Nov 10 · 11:00 view slides
Try it yourself
▦ Flow control benchmarksllm-d flow control experiments and results → ⌥ Benchmark repoconfigs, data and how to reproduce → ▶ Flow Control Flight Recorderinspect traffic, queues and engine activity over time → ▶ Interactive flow control explainerexplore admission, queues and scheduling → ✎ llm-d courseshort animated lessons on llm-d → ⚙ Shared inference learnermany teams, one GPU pool: how the pieces fit →
Upstream projects
d llm-dKubernetes-native distributed inference → ⌥ llm-d routerthe Endpoint Picker, flow control and scorers → v vLLMthe model server under it all →
Connect
in LinkedIn@alexa-griffith → ⌥ GitHub@alexagriffith → 🎙 Alexa's Input (AI)my podcast → ✦ All my linkspodcasts, writing, socials →