Keyboard shortcuts

Press or to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Introduction

Work in progress: This wiki is being actively expanded from Discord research and fork release notes. Many tuning recipes and throughput numbers are community-reported and have not been independently reproduced here. See Verification status for what is solid vs what still needs checking on your hardware.

Welcome to the GFX1030 Wiki — a focused, hands-on knowledge base for running LLM inference on AMD gfx1030 (RDNA2 / Navi 21) GPUs, with a strong bias toward the Radeon PRO V620 and the purpose-built tooling collected here.

gfx1030 is the LLVM/ROCm target for the Navi 21 “Sienna Cichlid” die. It powers the consumer Radeon RX 6800 / 6800 XT / 6900 XT / 6950 XT and the workstation/data-center PRO W6800 and PRO V620. These cards are officially supported by ROCm on Linux, which makes them a cost-effective platform for modern LLMs — but getting the most out of them (power tuning, multi-GPU P2P, and RDNA-tuned kernels) takes a bit of extra work. That’s what this wiki documents.

What this wiki focuses on

  • Tuning — the v620_toolbox recipes: lowering the V620’s VBIOS-locked 250 W floor to 120 W, enabling GPU↔GPU PCIe Peer-to-Peer between multiple V620s (Fedora + AMD hosts; power tuning also on Ubuntu 26.04; Intel Ice Lake often sees no P2P win — A/B it), and optionally disabling Pro-card ECC for ~2 GB extra VRAM.
  • llama.cpp — stock builds plus the RDNA2 fork (tensor parallel, MTP / DFlash). Usually the easiest first stack on V620.
  • vLLM on RDNA — ready-to-run Docker images; recipes for Hub vs recipe container vs Flash-Next (blivioniag/vllm-rdna on a blivioniag/rocm-rdna PyTorch base), how they are built with vllm-rdna-docker, and the official vLLM extras fork opengfx1030/vllm-rdna (rdna_extras) plus the separate Flash-Next fork (better for multi-stream / agentic loads once llama.cpp is working).

New here? Start with Supported Hardware and Getting Started.

Community Discord

Much of this wiki is distilled from the gfx1030 club Discord — live tuning tips, fork releases, and multi-GPU benches land there first.

  • Server: gfx1030 club
  • Join: https://discord.gg/mESex2aBp
  • Useful channels: #vllm-rdna, #llamacpp, #general, #benchmarks, #harnesses, #lmcache

When turning Discord threads into docs, follow the privacy rules in Contributing.

Disclaimer: This is a community wiki, not affiliated with or endorsed by AMD. Kernel patches and power-cap changes are done at your own risk. Always cross-check against the official ROCm documentation. Contributions welcome — see Contributing.