Maybe if we have some breakthrough in how to get equivalent ai capacity out of less compute it’ll seem crazy in retrospect.
But the magnitude of flops per token on SOTA models is mind boggling huge.
Maybe if we have some breakthrough in how to get equivalent ai capacity out of less compute it’ll seem crazy in retrospect.
But the magnitude of flops per token on SOTA models is mind boggling huge.