Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Depends. ROCm is pretty well-supported for example.

Non-NVIDIA backends tend to get less support and new features land slower, or features that are expected to improve performance wind up hurting it instead. That sort of thing.

For basic “token in/token out” workloads without fine tuning, it’s probably fine ??



Consider applying for YC's Winter 2027 batch! Applications are open till November 2.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: