Gemma 12B runs on Google Pixel 10 Pro under 10 watts
A developer ran Google's Gemma 12B model on a mobile phone using Termux and llama.cpp, achieving 6.5 tokens per second during prompt processing and 1.3 tokens per second during generation while consuming less than 10
Google's Gemma 12B language model is now running on a Google Pixel 10 Pro smartphone with power consumption under 10 watts, according to a recent benchmark shared on the LocalLLaMA community. The setup uses Termux, llama.cpp version 9639, and speculative decoding with draft model acceleration to ach...
Sign in to read the full analysis
Free account. Full analysis on LLM unit economics, plus the weekly Cost-of-Inference column.
Try it on your own context
You just read the writeup. Now run the thing. Paste a doc or some verbose tool output and watch it shrink — free, no signup.
- Source type
- Primary publication (lab/vendor blog) — our analysis + implication
- Source link
- r/localllama
- Published
- UTC
- Byline
- By the gotcontext.ai team (editorial standards)
- Correction?
- corrections@gotcontext.ai