Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Yep, this is exactly why I'm looking to colo. I have eight or so RTX a5000 gpu's and although colo is expensive, it's an absolute slam dunk in comparison to renting from AWS or even "dedicated" companies that only rent out GPU hardware at slightly better rates. I will say, power and efficiency become a bigger issue when colocating - if our scaling requirements and credit were slightly different we'd likely have preferred a greater up front cost and purchased V100 gpus instead of RTX a5000's.


I'd recommend Colovore for power - they are specialized for this use case and do a great job for us.

We started in the same situation where we had 10x RTX 8000 cards. We've since added tons of A6000 and A100 cards in our cabinet and have had no power issues.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: