At least Anand has been in the business for like 30 years. I didn't know anything about him but I assumed he was a 25 year old from Stanford that VCs decided to shower money on
The classification performance remains to be seen, but presumably we'll soon start to see classification benchmarks.
For other tasks like summaries (another suggested usage) it's good to see Haiku and Luna now competing against each other on cost.
I'd love to know how the business automation market breaks down by volume of call type though - hard to imagine that decision making (e.g. branching, triage) isn't a very large part of it, greater than these other suggested Haiku use cases.
I think Opus 5.5 is now fast enough with the inference stack improvements that they did. Sonnet 5.5 is around 140 tokens/s when I had measured it last time. A $20 subs on claude and using only sonnet 5.5 will last a lot
I was firmly wanting to move towards local llm, and since the Sonnet 5.5 and recent Opus speed increases, I'm putting that on hold until local inference speeds can be improved. Not sure how much juice there is to squeeze there, but I'm hopeful.
I just tried to play around with it on my RTX pro 6000 setup, it spends way too many tokens on overthinking stuff even if it’s able to catch the correct approach
Its speed is pretty good on the other hand with only 3B active parameters I am getting around 170 tkn/s on fp8
Nothing flies anywhere, we use superior high speed trains. I faxed a Humorgenehmigungsantragantrag to our Bundesunterhaltungsministerium analyst, immediately. Laugh now, but you are merely lucky the reply got delayed. As soon as the leaves on the rails are dealt with, you will get a formal response that has washed itself! Let us see who is laughing then. It is nobody!
But, most importantly, is Bundesunterhaltungsministerium a single token in Kolibri? This could make a huge difference for the model's performance in German.
Silly you, thinking the German economy is merit-based. The only question is, if the bribe fits a single token of appreciation, to win a tailored call for bids!
petition to make this thread the official german jokes thread for this post, it's kind of annoying how everyone feels the need to make a top level comment for their oh-so-great "germans suck" joke.
No, I am just standing my (and my nations) ground against what is simply bad faith disrespect and what could be described as casual racism (or at least spiritually equivalent to that, to not get into the racism definition debate).
You do not get to invalidate that.
People need to stop insulting my nation.
__
If the people you're joking with aren't laughing, you're not joking with them but about them, which is generally seen as a bad move, and something that we actually wanted to leave behind with all the social progress and all.
__
This really only happens because people (as all bullies) think that they would be free to do so, because the victims would not fight back.
(Un)fortunately though, the world now has bigger problems with genuine fascists, so neurotically cowering in fear and performatively saying "yes, punch me harder. Insult me more" can be stopped now.
__
I mean look at it. By now, it's at least better, but the first 30 comments or so were "haha germany bad haaa".
That's a terrible showing for the platform even if you're not german. What value was offered? Who would want this.
We don't even need to talk about nations and identities to see that that was just noise.
I think maybe they have enough compute to try out all the promising directions at a smaller scale first and then port them to larger run
They also have incredibly smart people that can understand which improvements and directions are even worth pursuing for, I think these people are being paid in millions
Isn't this trivial? Any coding agent can and will perturb/modify it's own trace/session files if provided the right incentive structures, sometimes I just ask claude code to remove sections from it's own session that didn't contributed anything and were unnecessarily bloating the context
