I'n on a Ryzen 4900HS laptop with a RTX 2060. Like I said, very modest | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		brucethemoose2 on June 6, 2023 \| parent \| context \| favorite \| on: GGML – AI at the Edge I'n on a Ryzen 4900HS laptop with a RTX 2060. Like I said, very modest

smiley1437 on June 6, 2023 [–]

Are you offloading layers to the RTX2060?

brucethemoose2 on June 7, 2023 | [–]

Some of them, yeah. 17 layers iirc.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact