I can't imagine using CPU... Oh I did twice. If you are work from home and do di... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

whatsThisBtn4 48 days ago | parent | context | favorite | on: My local model setup on an M4 Pro Mac Mini

I can't imagine using CPU... Oh I did twice.

If you are work from home and do dishes between prompts you can get a gpt3-like result.

I found it useful when I was... Well I didn't find it useful. But an Nvidia 3060 let me ask unethical questions pretty fast.

ramgine 48 days ago | [–]

With which model. I have a 3060 with a bunch of system ram

whatsThisBtn4 48 days ago | | [–]

Old school Berkeley Sterling or an abliterared model.

pjmlp 48 days ago | [–]

That is a lot of dishes.

Consider applying for YC's Winter 2027 batch! Applications are open till November 2.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact