Wow, I guess I wouldn’t have thought there would be GPU support. What’s the mech... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

awongh on Jan 25, 2024 | parent | context | favorite | on: Ollama releases Python and JavaScript Libraries

Wow, I guess I wouldn’t have thought there would be GPU support. What’s the mechanism for this?

brucethemoose2 on Jan 25, 2024 [–]

Via llama.cpp's GPU support.

Consider applying for YC's Fall 2026 batch! Applications are open till July 27.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact