Skip to main content
●Measured savings across 11 LLMs, from Claude Opus 4.7 to Gemini Flash.→ See per-model data
Connect your client
Tooling

DeepSeek v4 Flash reaches 132 tokens per second on consumer RTX 4090

A consumer hardware enthusiast benchmarked DeepSeek v4 Flash on an RTX 4090 with DDR5 RAM, achieving 132.5 tokens per second for prompt processing and 10.9 tokens per second for generation using llama.cpp.

1 min read
Ask AI about this article

DeepSeek v4 Flash reaches 132 tokens per second on a consumer RTX 4090 paired with 128 GB DDR5 memory and an Intel Core Ultra 7 processor, according to a detailed benchmark posted by a local inference practitioner running the latest llama.cpp build on Ubuntu 26.04.

The user achieved these speeds wi...

Sign in to read the full analysis

Free account. Full analysis on LLM unit economics, plus the weekly Cost-of-Inference column.

Try it on your own context

You just read the writeup. Now run the thing. Paste a doc or some verbose tool output and watch it shrink — free, no signup.

2,912/12,000 chars
Compressed
Compressed text will appear here…
Method & sources
Source type
Primary publication (lab/vendor blog) — our analysis + implication
Source link
r/localllama
Published
UTC
Byline
By the gotcontext.ai team (editorial standards)
Correction?
corrections@gotcontext.ai

Related