Fascinating! So each GPU is partnered with disk and NICs such that theres no oversubscription for bandwidth within its 'slice'? (idk what the word is) And each of these 8 slices wire up to NVLink back to the host?
Feels like theres some amount of (software) orchestration for making data sit on the right drives or traverse the right NICs, guess I never really thought about the complexity of this kind of scale.
I googled GB200, its cool that Nvidia sells you a unit rather than expecting you to DIY PC yourself.
Feels like theres some amount of (software) orchestration for making data sit on the right drives or traverse the right NICs, guess I never really thought about the complexity of this kind of scale.
I googled GB200, its cool that Nvidia sells you a unit rather than expecting you to DIY PC yourself.