A hosted instance serves multiple customers at a time. A local model only one. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

andsoitis 45 days ago | parent | context | favorite | on: GLM-5.3: Frontier coding with emergent cyber capab...

A hosted instance serves multiple customers at a time. A local model only one.

toasty228 45 days ago [–]

How many though? At 1m context you quickly fill a full gb300's 280gb of memory

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact