is graph execution used for training only or inference also? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		boywitharupee on June 6, 2023 \| parent \| context \| favorite \| on: GGML – AI at the Edge is graph execution used for training only or inference also?

LoganDark on June 6, 2023 [–]

Inference. It's a big bottleneck for RWKV.cpp, second only to the matrix multiplies.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact