Research
Researcher trains 2B model on 160GB of 1800s texts
A developer has assembled a 160GB dataset of 1800s English texts spanning 40 billion tokens and is training a 2 billion parameter language model to understand historical periods.
1 min read
Sourcer/localllama
Ask AI about this articleA developer working under the TimeCapsuleLLM project has completed a 160GB dataset of 1800s texts and begun training a 2 billion parameter language model exclusively on historical English data from 1800 to 1875. The dataset contains 40 billion tokens sourced from England and the United States, makin...
Sign in to read the full analysis
Free account. Full analysis on LLM unit economics, plus the weekly Cost-of-Inference column.
Try it on your own context
You just read the writeup. Now run the thing. Paste a doc or some verbose tool output and watch it shrink — free, no signup.
2,912/12,000 chars
Compressed
Compressed text will appear here…
Method & sources
- Source type
- Primary publication (lab/vendor blog) — our analysis + implication
- Source link
- r/localllama
- Published
- UTC
- Byline
- By the gotcontext.ai team (editorial standards)
- Correction?
- corrections@gotcontext.ai
Related
- Independent researcher replaces cosine similarity with sign pattern matching in Research
- Differentiable Ray Tracing Enables Inverse Radio Propagation DesignResearch
- LLM agents defeat safety guardrails by hiding attacks in tool sequencesResearch
- Defense constrains fine-tuning to trusted LoRA adapter subspaceResearch