Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

As long as the models run best on Nvidia hardware. What will happen if models are faster on Apple or AMD hardware?


Nvidia being making it clear that other hardware models will permanently not become second class citizens in any way would be a great start.


For the last few months, I’ve been working on a vendor-agnostic inference library. Have 3 backends so far: legacy D3D11 for compatibility, D3D12, and Vulkan 1.3. I have reasons to believe nVidia deliberately crippling Vulkan API for their consumer GPUs. Couple examples to be specific.

nVidia driver sets quite low number for VkPhysicalDeviceLimits::maxTexelBufferElements. I don’t think that’s a hardware limit because I have D3D12 backend doing the same thing on the same hardware.

Vulkan performance is not great on nVidia. On all AMD cards I am testing, Vulkan 1.3 is the fastest backend. On nVidia however, D3D12 is faster despite tensor cores (WMMA / wave matrix multiply accumulate / cooperative matrices) are only available through Vulkan, D3D12 is using shader cores exclusively.


Talk is cheap, so no need to claim that in the first place. Of course they could make it legally binding but they won't do it.

They will be as free as the Washington Post after the aquisition by Bezos.

Wait and see is the only thing we can do.


You haven’t been paying attention to Washington Post isn’t free to do anything they want under Jeff Bezos…


How could they control other hardware models?

This is just one company. If other hardware is better and they don’t provide access to it, won’t people just leave HF??

Is this somehow more of a monopoly than I am imagining?


Yes, they could just say they're taking it towards prioritizing models that only run on one kind of equipment and making it harder to find, support or list models that run on different hardware.

The acquisition sets up corporate interests to be able to increasingly drive it.

I hope better for Nvidia and hopefully it can be cleared up, and maintained.


Exactly. Just tweaking the order of suggested models for a search query could already have a huge impact on model popularity.


HF CEO keeps posting about how great local models are running in his Mac, it would be funny to see if he replaces his MacBook with a 500W Nvidia laptop after the deal gets through.

But more importantly for business, if HF fails to use the upcoming ASIC inference chips for their ZeroGPU after the acquisition, their competitors using them might have an advantage.


Prediction Apple will find the exit…




Consider applying for YC's Winter 2027 batch! Applications are open till November 2.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: