
achyudh/llama.cpp
Speeds up decoding in llama.cpp on AMD GPUs. It is a fork of ggml-org/llama.cpp.
Benchmarks
- On RX 9070 XT (gfx1201, 16GB) with Qwen3.8-27B (IQ4_XS), it decodes at 36.83 tok/s, against 34.07 tok/s for llama.cpp (+8%). Source
Listing
Listed: Passed all seven checks.
Security review
Not reviewed yet.
Install
To install it, follow the project's own instructions on GitHub. The engine runs with your user's permissions. macOS doesn't sandbox it, so install only engines you trust.
Something wrong or out of date? Write to help@kalsa.io, or ask us to remove this page.