Somehow I never got the hype around Groq. They served models with fast inference speed - that sounded great in theory - and as a user I was looking forward to use them. But, when I did try, I discovered that they are quantizing the models underneath. And they dont even disclose it. So I stopped using them.
The whole thing never made any sense to me - but I guess AI hype is a thing.
I believe despite quantisation they were still extremely fast, which is still incredibly useful if you don't need high precision/accuracy (which is good enough for many use cases)
Seems to me that the only difference between Anthropic and OpenAI is that Anthropic was for-profit from day one and OpenAI is from day yesterday. I pay for both, and pretty sure they will do everything they can to take as much money from me that they can get away with.
The for profit from the start is true, but also, Sam's shenanigans really irks me as a customer, the slights of hand etc. I get the sense he would mislead the public on threats and risks of AI to benefit OpenAI and the government, to centralize and monopolize powerful models.
The US is unique in how many public services it has. Other countries have private firefighter services; that just means the city has a contract with them. It doesn't mean they burn your house down and charge you for it.
People set up and fund a public bus system that has coverage for all neighborhoods, rich or poor, distant or close.
And then after the bus system is up and running, the bus system manager decides transportation is important! He IPOs the bus system, and changes all the routes to money-making routes with cost optimized (higher) fares.
See, one reason it doesn't matter if the public directly owns a bus system is that you can just pass laws telling them what routes they have to run.
But also, a money-making bus system would mean people actually use it. Nobody uses most American bus systems because they don't go anywhere, and they're slower when they do because they aren't popular enough to replace car traffic.
The whole thing never made any sense to me - but I guess AI hype is a thing.