Kalsa
Hardware / AMD

Engines for AMD

13 engines run on AMD.

achyudh/llama.cppby achyudh

Speeds up decoding in llama.cpp on AMD GPUs.

Fork of ggml-org/llama.cpp
AMDForkMIT
Faster decode
+8% faster decoding than llama.cpp on AMD GPU
Aristo94/EngramHalo.cppby Aristo94

Speeds up Qwen 3.8 Flash-Next decoding on AMD Strix Halo with MTP, in a llama.cpp fork.

Fork of ggml-org/llama.cpp
AMDForkMIT
Faster decode
+61% faster decoding than without it on AMD GPU
DwarfStar 4by antirez

Runs large models such as DeepSeek V4 Flash and GLM 5.3 Flash on Apple Silicon, NVIDIA and AMD.

Apple M1–M6NVIDIAAMDEngineMIT
Bigger modelsMultiple machinesNew hardware
No benchmarks yet
llama.cppby ggml-org

Serves as the reference upstream and runs on Apple Silicon, NVIDIA, AMD, Intel and CPU.

Apple M1–M5NVIDIAAMDIntelCPUReferenceMIT
The reference engine
llama.cpp adaptive spec decoding + Strix Halo Vulkanby LaurentZuijdwijk

Speeds up prompt reading in llama.cpp on AMD Strix Halo, using adaptive speculative decoding.

Fork of ggml-org/llama.cpp
AMDForkMIT
Faster prefill
+89% faster prompt reading than llama.cpp on AMD GPU
Ollamaby ollama

Serves as the reference upstream: a UX wrapper with a model library.

Apple M1–M5NVIDIAAMDCPUReferenceMIT
The reference engine
QVAC Fabricby tetherto

Offloads work to Core ML on Apple Silicon and to the XDNA NPU on AMD, in a llama.cpp fork.

Fork of ggml-org/llama.cpp
Apple M1–M6AMDForkMIT
Faster decodeFaster prefill
3.1× faster decoding than without it on AMD GPU
ROCmForgeby oldnordic

Decodes Qwen2.5-0.5B faster than llama.cpp on AMD GPUs.

AMDEngineGPL-3.0
Faster decode
+42% faster decoding on AMD GPU
SelfRef/llama.cpp-rdnaby SelfRef

Shrinks Qwen3.8-27B with the ROCmFPX format and decodes it faster, in a llama.cpp fork for AMD GPUs.

Fork of ggml-org/llama.cpp
AMDForkMIT
Faster decodeLess memory
+7% faster decoding on AMD GPU
spiritbuun/buun-llama-cppby spiritbuun

Adds a trellis-coded 3-bit KV cache codec to llama.cpp for NVIDIA and AMD GPUs.

Fork of ggml-org/llama.cpp
NVIDIAAMDForkMIT
Quality
No benchmarks yet
stew675/llama-cpp-rdna-boostsby stew675

Speeds up decoding in llama.cpp on AMD GPUs with RDNA patches and a speculative-decoding clamp.

Fork of ggml-org/llama.cpp
AMDForkMIT
Faster decode
2.3× faster decoding than without it on AMD GPU
Strataby Niko1221

Serves as the reference upstream for Strata forks on NVIDIA, AMD and Apple Silicon.

Apple M1–M6NVIDIAAMDReferenceMIT
The reference engine
vLLMby vllm-project

Serves as the reference upstream for NVIDIA, AMD and Intel GPUs and CPU.

NVIDIAAMDIntelCPUReferenceApache-2.0
The reference engine