Engines for Apple M2 Pro
16 engines run on Apple M2 Pro.

Decodes faster and starts answering sooner on Apple Silicon, using an MTP drafter.

Runs large models such as DeepSeek V4 Flash and GLM 5.3 Flash on Apple Silicon, NVIDIA and AMD.

Loads GGUF models in pure Rust, with quantized Metal kernels and lossless speculative decoding.

Serves as the reference upstream and runs on Apple Silicon, NVIDIA, AMD, Intel and CPU.

Serves many requests at the same time on Apple M2 with higher total throughput.

Runs models in Rust with ISQ and UQFF quantization on Apple Silicon and NVIDIA GPUs.

Serves as the reference upstream for Apple Silicon, built on MLX.

Runs on Apple Silicon and is the upstream of the MTPLX M1-family build.

Serves as the reference upstream: a UX wrapper with a model library.

Speeds up prompt reading on Apple Silicon by pairing a second Mac.

Runs Splash on M1 and M2 Macs, where the upstream needs an M3 or newer.
Fork of incoai/splash
Offloads work to Core ML on Apple Silicon and to the XDNA NPU on AMD, in a llama.cpp fork.
Fork of ggml-org/llama.cpp
Builds on mlx-lm to decode Qwen3.5-9B faster than oMLX on Apple Silicon.
Built on ml-explore/mlx-lm
Serves as the reference upstream for Strata forks on NVIDIA, AMD and Apple Silicon.

Streams experts from the SSD to cut GPU memory use on Apple Silicon Macs.

Cuts memory use on Apple Silicon by loading only some of each MoE model's experts.