SemiAnalysis estimates their profit margin to be 70%. To be losing money on infe... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		bryanlarsen 6 days ago \| parent \| context \| favorite \| on: Formalizing Fermat's Last Theorem SemiAnalysis estimates their profit margin to be 70%. To be losing money on inference implies that their costs are almost 4X higher than SemiAnalysis has calculated. That's not credible.
		help

p-e-w 6 days ago [–]

I don’t see how they could credibly estimate inference costs without knowing the model size.

FuckButtons 6 days ago | | [–]

But we do have a reasonable estimate of model size.

nbardy 5 days ago | | [–]

You can estimate the model size by looking at tokens per second and comparing to open source models

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact