Tooling
DeepSeek v4 Flash reaches 132 tokens per second on consumer RTX 4090
A consumer hardware enthusiast benchmarked DeepSeek v4 Flash on an RTX 4090 with DDR5 RAM, achieving 132.5 tokens per second for prompt processing and 10.9 tokens per second for generation using llama.cpp.
1 min read
Sourcer/localllama
Ask AI about this articleDeepSeek v4 Flash reaches 132 tokens per second on a consumer RTX 4090 paired with 128 GB DDR5 memory and an Intel Core Ultra 7 processor, according to a detailed benchmark posted by a local inference practitioner running the latest llama.cpp build on Ubuntu 26.04.
The user achieved these speeds wi...
Sign in to read the full analysis
Free account. Full analysis on LLM unit economics, plus the weekly Cost-of-Inference column.
Try it on your own context
You just read the writeup. Now run the thing. Paste a doc or some verbose tool output and watch it shrink — free, no signup.
2,912/12,000 chars
Compressed
Compressed text will appear here…
Method & sources
- Source type
- Primary publication (lab/vendor blog) — our analysis + implication
- Source link
- r/localllama
- Published
- UTC
- Byline
- By the gotcontext.ai team (editorial standards)
- Correction?
- corrections@gotcontext.ai