Saltar para o conteúdo
Radio Logo
PodcastsEnsinoCode With Wilson

Code With Wilson

Wilson Wu
Último episódio

45 episódios

  • Code With Wilson

    The Launch Tax: How CUDA Graphs Keep Your GPU From Sitting Idle

    20/07/2026 | 18min
    Running one token through a language model isn't one big GPU operation. It's hundreds to thousands of tiny ones, and each of those has to be launched by the CPU first. During decode, those little operations finish so fast the GPU starves waiting for the CPU to queue the next one. CUDA Graphs fix this by recording the whole repeating sequence once and replaying it with a single launch, so the GPU stays fed. Same math, same result, far less idle time.
  • Code With Wilson

    The Model Is a Commodity: What an AI Engineer Actually Builds

    20/07/2026 | 18min
    The single idea the entire craft rests on is this: the model is a commodity, and the system around it is the job. A raw frontier model is a brilliant intern with amnesia, no hands, and no way to check its own work. The AI engineer gives it hands through tools, a memory across runs, a way to verify itself through evals, and a loop that keeps working until the task is done. That wrapper — not the model weights — is the thing you get paid to build. Learn to build it and you're employable.
  • Code With Wilson

    Attention Is Just Four Operations: How Every LLM Decides What to Read

    20/07/2026 | 18min
    Scaled dot-product attention is not a mysterious black box. It's four elementary operations — matrix multiplication, transpose, scaling by a constant, and softmax — plus three learned projections that produce queries, keys, and values. You can write it in about a hundred lines of plain C with no autograd and no libraries. Once you see it as loops instead of magic, you reason about cost, memory, and failure modes from first principles rather than treating the model as a sealed device.
  • Code With Wilson

    Serving Is a Separate Problem: How vLLM Runs LLMs Fast and Cheap

    20/07/2026 | 18min
    An LLM engine like vLLM exists because serving a model well is its own systems problem, distinct from training it. Text generation is autoregressive and memory-bound, and the key-value cache is the real capacity limit on how many users fit on a GPU. vLLM answers three questions: which requests run next, how a batch executes, and where each request's cache lives. Its headline move is treating GPU memory like virtual memory, which slashes waste and unlocks bigger batches.
  • Code With Wilson

    Learn to Drive Before You Study the Engine: The fast.ai Bet on Top-Down Deep Learning

    20/07/2026 | 18min
    Most technical courses go bottom-up: math, then theory, then maybe you build something months later, by which point your motivation is gone. fast.ai flips it. You train a real, state-of-the-art model in lesson one, and only then peel back the layers to see how it learned. The engine that makes this possible for beginners is transfer learning, and that same "inherit capability instead of building it from scratch" move is the single most important pattern in modern AI engineering.
Mais podcasts de Ensino
Sobre Code With Wilson
I'm using AI to learn AI, and I'm publishing the journey as I go. Each episode is a NotebookLM-generated audio overview of a study brief I wrote — Chip Huyen chapters, LeetCode problem walkthroughs, AI Engineering interview topics. Built for myself, useful for anyone studying AI engineering for Google Cloud, Anthropic, OpenAI, or similar roles. Made transparently with NotebookLM (audio) and Claude (briefs). — Wilson Wu
Sítio Web de podcast

Ouve Code With Wilson, Somos Infinitos e muitos outros podcasts de todo o mundo com a aplicação radio.pt

Obtenha a aplicação gratuita radio.pt

  • Guardar rádios e podcasts favoritos
  • Transmissão via Wi-Fi ou Bluetooth
  • Carplay & Android Audo compatìvel
  • E ainda mais funções