Keyboard shortcuts

Press ← or → to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Wiki structure

How this mdBook is organized — for editors adding or moving pages.

Directory layout

src/
  intro.md                 # Landing page (WIP banner)
  SUMMARY.md               # Sidebar navigation — edit this when adding pages

  choose-a-stack.md        # llama.cpp vs vLLM, what fits on a V620

  setup/                   # Hardware and ROCm install (getting-started first)
    getting-started.md
    hardware.md
    installing-rocm.md
    hsa-override.md
    host-firmware.md       # MMIO High / SR-IOV / large-BAR POST (only if the host will not POST)

  tuning/                  # V620-specific host tuning
    power.md
    ecc.md                 # Optional Pro-card ECC disable (~2 GB)
    p2p.md

  vllm/                    # vLLM serving on RDNA
    overview.md            # Section hub — start here
    onboarding.md          # Simple V620 happy path (Docker + fork launcher)
    running.md             # Images, docker run, quick start
    recipes.md             # Hub -extras and recipe-container presets
    flash-next.md          # Flash-Next status, card counts, AutoRound
    flash-next-serve.md    # Flash-Next serve lines (FULL_AND_PIECEWISE, #17, PP3)
    configuration.md       # Env vars, CUDA graphs, compose
    quantization.md        # GPTQ/AWQ, KV, MTP, INT4
    fork.md                # rdna_extras kernels + chronicle
    fork-progress.md       # Hub vs HEAD vs backlog snapshot
    host-venv.md           # Host uv venv (ROCm 7.2.0 / 7.14.0)
    serve-scripts.md       # tools/rdna/serve_rdna.sh recipes (fork checkout)
    images.md              # Building Docker images

  llama-cpp/               # llama.cpp and RDNA2 fork
    overview.md            # Section hub (points at choose-a-stack.md)
    building.md            # Stock llama.cpp build
    rdna2-overview.md      # Fork intro, build, requirements
    rdna2-benchmarks.md    # Author-reported numbers
    rdna2-speculative.md   # DFlash2, MTP, ngram
    rdna2-serving.md       # Launch, Docker, limits

  reference/               # Lookup tables
    env-vars.md            # Environment variable cheat-sheet
    verification.md        # What's verified vs community-reported

  troubleshooting/         # Problem → fix, by stack
    index.md               # Hub
    general.md
    vllm.md
    vllm-flash-next.md
    llama-cpp.md

  meta/                    # Wiki maintenance
    resources.md           # External links
    contributing.md
    structure.md           # This page

Conventions

RuleExample
One topic per file — split when a page exceeds ~200 lines or mixes concernsvllm/configuration.md vs vllm/quantization.md
Section overview.md — first page in each major folder links to sub-pagesvllm/overview.md, llama-cpp/overview.md
kebab-case filenamesgetting-started.md, not getting_started.md
Relative links — use ../ to cross foldersFrom vllm/running.md to setup: ../setup/hsa-override.md
WIP banner — on pages with Discord/community claimsSee vllm/overview.md
Verification row — add/update in reference/verification.md for new benchmarksStatus: solid / fork-source / community / needs verify

Adding a new page

  1. Pick the folder (or create one if it’s a new major topic).
  2. Create src/<folder>/<topic>.md with a # title and optional WIP banner.
  3. Add an entry to src/SUMMARY.md under the right section.
  4. Link from the section overview.md if one exists.
  5. Add verification rows if the page contains benchmarks or unconfirmed claims.
  6. Run mdbook build — fix broken links before merging.

Splitting an existing page

  1. Move shared intro to overview.md or trim the original.
  2. Create focused sub-pages; link between them at the bottom (“Next steps”).
  3. Update SUMMARY.md to nest sub-pages under the section.
  4. Grep for old filename links: rg 'old-name\.md' src/
  5. Update reference/verification.md section headers to match new paths.

What goes where?

Content typeLocation
Install ROCm, hardware listsetup/
BIOS / MMIO High / SR-IOV so 4× V620 POSTssetup/host-firmware.md
Power cap, P2P enablement, Pro ECCtuning/
docker run, compose, env vars for vLLMvllm/
First V620 vLLM serve (Docker or fork)vllm/onboarding.md
Which image / model / card-count recipevllm/recipes.md (Flash-Next serve lines: vllm/flash-next-serve.md; MonoKernel: #flash-next-monokernel)
Fork tools/rdna/serve_rdna.sh recipesvllm/serve-scripts.md
llama.cpp vs vLLMchoose-a-stack.md
Kernel source, fork branchesvllm/fork.md
Hub vs HEAD vs backlog progressvllm/fork-progress.md
Docker image build (vllm-rdna-docker)vllm/images.md
Stock llama.cpp cmake buildllama-cpp/building.md
Fork benchmarks, DFlash2, TP servellama-cpp/rdna2-*.md
Env var tablesreference/env-vars.md
Claim audit / WIP statusreference/verification.md
Error messages and fixestroubleshooting/ (Flash-Next symptoms: troubleshooting/vllm-flash-next.md)
External links (official / Docker / upstream / community)meta/resources.md