Tooling
ik_llama.cpp delivers 22% speedup on Qwen 35B with 12GB VRAM
A developer benchmarked ik_llama.cpp against llama.cpp on an RTX 4070 Super and achieved 110 tokens/sec with Qwen3.6-35B, a 22% improvement over the official implementation's 90.6 tok/s.
1 min read
Sourcer/localllama
A developer running an RTX 4070 Super with 12GB VRAM achieved 110 tokens per second using ik_llama.cpp to run Qwen3.6-35B-A3B with multi-token prediction (MTP), compared to 90.6 tok/s with the official llama.cpp implementation on the same hardware and model. ...
Sign in to read the full analysis
Free — just an email. Get full analysis on LLM unit economics, plus the weekly Cost-of-Inference column.
Method & sources
- Source type
- Primary publication (lab/vendor blog) — our analysis + implication
- Source link
- r/localllama
- Published
- UTC
- Byline
- By the gotcontext.ai team (editorial standards)
- Correction?
- corrections@gotcontext.ai