Writing custom WMMA/MFMA kernels for an exact integer matrix multiplication library that uses RNS & CRT + Int8 GEMM to get ~90% of the theoretical i64 TOPS output from a 7900XTX (3.9 TOPS vs the 0.5 or so you get with naive hip-direct usage)
I'm not sure if you think that's a lot, but that was barely even 8 hours. I've had 200B+ months lol
I'm not sure if you think that's a lot, but that was barely even 8 hours. I've had 200B+ months lol