Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Isnt Strix Halo and apple's m series a bit different. Iirc you need to choose how much ram will be allocated to the igpu, whereas on mac it is all handled dynamically.


On the Mac it's all dynamically handled.

With Strix Halo there's two ways of going about it; either set how much memory you want allocated to GPU in BIOS (Less desirable), or set the memory allocation to the GPU to 512MB in the BIOS, and the driver will do it all dynamically much like on a Mac.


You can also change it manually on macOS [0], though yes by default it’s automatic but has a much lower limit (I think 2/3 is total RAM or something).

[0]: https://github.com/ggml-org/llama.cpp/discussions/2182#discu...


strix also does it dynamically, just with a limit (which is generally set to ~75% of your total RAM)




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: