llmdeepdive
PT

Type to search

    Learning track

    Hardware & Infrastructure

    Understand the silicon beneath Qwen3.8-27B — NVIDIA, AMD, Apple, Qualcomm, and Cerebras — and the bandwidth, roofline, and cost arithmetic that decides what runs where, and for how much.

    10

    frontier · 10 available lessons

    Hardware & Infrastructure

    Understand the silicon beneath Qwen3.8-27B — NVIDIA, AMD, Apple, Qualcomm, and Cerebras — and the bandwidth, roofline, and cost arithmetic that decides what runs where, and for how much.

    1. 10.01Memory bandwidth vs FLOPs
    2. 10.02The roofline model
    3. 10.03KV cache sizing and memory budgets
    4. 10.04NVIDIA, CUDA, Hopper and Blackwell
    5. 10.05AMD, ROCm and the MI3xx line
    6. 10.06Apple silicon and unified memory
    7. 10.07Qualcomm Hexagon and the edge
    8. 10.08Cerebras and wafer scale
    9. 10.09Interconnects and clusters
    10. 10.10Cost per token