Engines for NVIDIA
16 engines run on NVIDIA.

Speeds up prompt processing in Strata on NVIDIA GPUs.
Fork of Niko1221/Strata
Runs large models such as DeepSeek V4 Flash and GLM 5.3 Flash on Apple Silicon, NVIDIA and AMD.

Changes how llama.cpp places its cache on NVIDIA GPUs, and decodes Qwen3.6 35B faster than stock.
Fork of ggml-org/llama.cpp
Adds an expert cache with GPU and RAM tiers to llama.cpp on NVIDIA GPUs.
Fork of ggml-org/llama.cpp
Serves as the reference upstream and runs on Apple Silicon, NVIDIA, AMD, Intel and CPU.

Streams the KV cache between host RAM and VRAM in a llama.cpp fork for NVIDIA GPUs.
Fork of ggml-org/llama.cpp
Keeps MoE experts in a VRAM-resident cache in a llama.cpp fork for NVIDIA GPUs.
Fork of ggml-org/llama.cpp
Runs models in Rust with ISQ and UQFF quantization on Apple Silicon and NVIDIA GPUs.

Streams experts from SSD or RAM into GPU passes, which speeds up prompt processing in llama.cpp on NVIDIA GPUs.
Fork of ggml-org/llama.cpp
Adds batch prefill for GLM models to ds4 on NVIDIA GPUs.
Fork of antirez/ds4
Serves as the reference upstream: a UX wrapper with a model library.

Adds a trellis-coded 3-bit KV cache codec to llama.cpp for NVIDIA and AMD GPUs.
Fork of ggml-org/llama.cpp
Serves as the reference upstream for Strata forks on NVIDIA, AMD and Apple Silicon.

Stores MoE experts in RAM tiers for models running on NVIDIA GPUs.

Adds TQ3 weight formats to llama.cpp and an FP4 prompt path on Blackwell GPUs.
Fork of ggml-org/llama.cpp
Serves as the reference upstream for NVIDIA, AMD and Intel GPUs and CPU.