What is unified ram? RAM and VRAM as one thing?

Big ole pool of very fast ram that can be accessed by the CPU and GPU. Lets you run larger models. AMD does the same thing with Strix Halo. I have a 128gb machine at home, and have had difficulties running 120b models, but 70b and below run pretty well.

> Big ole pool of very fast ram

It’s more that it’s a very parallel architecture than fast.

The LPDDR5X under the hood is slower than what you’d find in a graphics card vram of years ago

That’s why you get consumer macs with 512gb while GPU makers are reluctant to give you more than 16gb unless you pay dearly. It’s not the same kind of mem

AMD Strix Halo unified memory still requires allocating X to GPU, x to CPU at UEFI.

So not as flexible as apple's unified memory.

Not in Linux! See setting GTT: https://rocm.docs.amd.com/en/docs-7.2.0/how-to/system-optimi...

Yep, exactly. It's just one shared pool of RAM with zero-copies necessary.

In best case its also on-chip high speed ram.

Yes