pythia 160m

A tiny, transparent model built more for studying than shipping. Pythia 160M is part of a carefully controlled research suite, meaning its training process is unusually well-documented — researchers can inspect checkpoints at every stage of training. At this scale, it handles simple text completion but struggles with anything requiring reasoning or factual depth.