ITT nobody remembers gpt2 anymore and that makes me sad | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		unleaded 5 months ago \| parent \| context \| favorite \| on: Gemma 3 270M: Compact model for hyper-efficient AI ITT nobody remembers gpt2 anymore and that makes me sad

GaggiX 5 months ago [–]

This model was trained on 6T tokens and has 256k embeddings, quite different than a gpt2 model comparable in size.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact