it’s kinda crazy but i do think we’re seeing a turn
my company was easily spending $1m/month on tokens
sonnet 5.5 drops - we barely cracked half this month
it has to go down too, carbon is interesting, china has qwen 4 soon
coding isn’t sustainable growth - RLRVF is really effective for software development - labs are cracking the code, these models will have to get better at other things to be worth it
haiku maybe a little, i don’t think it had much usage, my company there aren’t many power users, they use the default which is sonnet 5.5 on medium with autocompact at 300k
most people probably still by hand or using it to review code usually
most of the spending was actually coming from a minority of power users
true, but it's also super easy to switch models via Bedrock (my harness switches subagents between A\, OAI, Kimi, Grok, etc... GLM 5.3 is locked behind some dumb request system which I personally believe is because Amazon is heavily invested in A\) and you're not locked in with the Claude Enterprise features (i swear to god if someone sends another claude artifact instead of publishing to git...)
i think SOC2 is about audibility more than anything - my guess - and i’m not an internal auditor or anything - is soc2 needs auditing for human changes, but a machine is just a “system behaving on its own”
autoresearch can solve a lot of these issues and i am sure people are usually heavily heavily subsidized subscriptions
article seems very salty and im not sure why
also the economics is you open source something and its saves every one money and opens up more cross compile support, i bet this will scare companies to support linux more properly before linux users just start getting very good at cloning
LLMs could’ve been developed a lot slower without capsizing the entire supply chain and been seen a lot more positively, China is building a lot of good AI with a minuscule of the compute power and it’s fine
there was never a need to rush other than for capitals self interest to control
if frontier labs wanna pace the frontier, they should be honest and return the compute back to the people
China is building good AI by distilling American models. I think that's a great thing, but Chinese progress is currently dependent on American progress, because China lacks the compute to train the largest models (as stated by DeepSeek's founder[1])
i knew about the compute already (he was very public about i believe huawei under delivering the amount of chips he requested), but nowhere in that transcript does he say he's dependent on US progress for his own progress or he's distilling the US to make progress
i don't really think distilling is even that fundamental anymore (nor was the evidence ever that strong - https://msukhareva.substack.com/p/is-kimi-k3-really-distille...), the game is all RL now, and you don't need american progress for that at all (just compute and data, and the data brokers will sell to anyone no problem)
i do think there are black market proxies from china to the US trying to sell "claude" and "deepseek" access mixed together, and i do think that prompt distribution is probably going to be very nice datasets
my company was easily spending $1m/month on tokens
sonnet 5.5 drops - we barely cracked half this month
it has to go down too, carbon is interesting, china has qwen 4 soon
coding isn’t sustainable growth - RLRVF is really effective for software development - labs are cracking the code, these models will have to get better at other things to be worth it
reply