The other companies have signed the waiver, however they aren’t being used in classified systems currently. So that type of use is already extremely limited for them. Now once they enter into those contracts to be used in those systems without these protections, I will cancel my subs to them and switch to Anthropic. xAi entered into that contract last week. Altman is now publicly siding with anthropic, so he better stand on that position with openai as they are currently negotiating for use in those system.
When they seamlessly switch from English to Dutch I feel like I’m having a stroke: all the same intonation, the same accent, but nothing makes sense any more
That doesn't jive with my experience at all. I'm half-dutch, raised in England.
Dutch doesn't have the same intonation, has harsher pronunciations, and has a whole extra sound most English people struggle with (a rolled r).
The older generations also can't pronounce -thew very well as it's not a thing in Dutch, so struggle to pronounce my name, calling me Matchoo instead of Matthew. It still boggles my mind that my Mum would pick a name the Dutch can't pronounce.
The Dutch accent is also extremely noticeable to a native English speaker.
Ultimately, they're not the same at all as English is Germanic/Latin hybrid where half the words are French/Italian words, and half the words are Germanic/Dutch words.
Dutch is not.
You can usually tell by looking at the word and the end of the word.
Words like fantastic, manual, vision, aquatic, consume are all from -ique, -alle, -umme and will have similar words in French/Italian. The tend to be longer words with more syllables.
Words like mother, strong, good, are Germanic in root. The -er, -ong, -od words will all be similar to the German/Dutch words. Shorter, quicker to pronounce.
The intonation is different, there are harsher sounds, but there are diphtongs everywhere in Dutch, and to me thisbis what makes it sound like English. French, Spanish, German etc don’t have diphtongs ( or they’re quite rare )
I had a strange experience during one episode of the show "Amsterdam Empire", which is spoken in Dutch. There's a scene where one of the characters addresses some foreign tourists: the (Dutch) subtitles continued to make sense, but his speech was just absolute gibberish. It was startling to realize that he had been speaking English, my native language: in the moment, I did not recognize it at all.
The pattern matching example has a type Shape which is never referenced and this seems to conflict with the idea that you never write a type, am I missing something obvious?
I think they mean you never write types for your variables or functions. They don't mean you can't create types. That's the reference to Hindley–Milner type system and type inference. You don't have to say
x : Nat
x = 5
You just say x = 5
I personally don't like that you don't seem to be able to manually describe the type for a fn/var, because it's very useful when prototyping to write stubs where you provide the typedef but then the actual variable/function is just marked as "todo"
"Spamming", or rather, responding too quickly in an intense discussion, is cause for automatic shadowban here on HN. It happened to me on a previous account some years ago. The posts themselves were harmless, I merely responded to too many users in a too short timeframe. My attempts at having the ban undone also turned out to be a waste of time. Completely absurd.
The other day I had an agent write a parser for a niche query language which I will not name. There are a few open source implementations of this language on github, but none of them are in my target language and none of them are PEGs. The agent wrote a near perfect implementation of this query language in a PEG. I know that it looked at the implementations that were on github, because I told it to, yet the result is nothing like them. It just used them as a reference. Would and should this be a licensing issue (if they weren't MIT)?
I'm more interested in the general question rather than the specifics of this situation, which I'm sure is now incredibly common. I know it looked at those implementations because I asked it to, and therefore I will credit those projects when I release this library. In general though, people do not know what other material the agents looked at in order to derive their results, therefore they can't give credit, or even be sure that they are technically complying with the relevant licenses.
it was set up by a person and it's "soul" is defined by a person, but not every action is prompted by a person, that's really the point of it being an agent.
It had been shown that LLMs don't know how they work. They asked a LLM to perform computations, and explain how they got to the result. The LLM explanation is typical of how we do it: add number digit by digit, with carry, etc... But by looking inside the neural network, it show that the reality is completely different and much messier. None of it is surprising.
Still, feeding it back its own completely made up self-reflection could be an effective strategy, reasoning models kind of work like this.
Right. Last time I checked this was easy to demonstrate with word logic problems:
"Adam has two apples and Ben has four bananas. Cliff has two pieces of cardboard. How many pieces of fruit do they have?" (or slightly more complex, this would probably be easily solved, but you get my drift.)
Change the wordings to some entirely random, i.e. something not likely to be found in the LLM corpus, like walruses and skyscrapers and carbon molecules, and the LLM will give you a suitably nonsensical answer showing that it is incapable of handling even simple substitutions that a middle schooler would recognize.
The explanation becomes part of the context which can lead to more effective results in the next turn, it does work, but it does so in a completely misleading way
Which should be expected, since the same is true for humans. The "adding numbers digit by digit with carry" works well on paper, but it's not an effective method for doing math in your head, and is certainly not how I calculate 14+17. In fact I can't really tell you how I calculate 14+17 since that's not in the "inner monologue" part of my brain, and I have little introspection in any of the other parts
Still, feeding humans their completely made-up self-reflection back can be an effective strategy
The difference is that if you are honest and pragmatic and someone asked you how you added two numbers, you would only say you did long addition if that's what you actually did. If you had no idea what you actually did, you would probably say something like "the answer came to me naturally".
LLMs work differently. Like a human, 14+17=31 may come naturally, but when asked about their though process, LLMs will not self-reflect on their condition, instead they will treat it like "in your training data, when someone is asked how he added number, what follows?", and usually, it is long addition, so that is the answer you will get.
It is the same idea as to why LLMs hallucinate. They will imitate what their dataset has to say, and their dataset doesn't have a lot of "I don't know" answers, and a LLM that learns to answer "I don't know" to every question wouldn't be very useful anyways.
>if you are honest and pragmatic and someone asked you how you added two numbers, you would only say you did long addition if that's what you actually did. If you had no idea what you actually did, you would probably say something like "the answer came to me naturally".
To me that misses the argument of the above comment. The key insight is that neither humans nor LLMs can express what actually happens inside their neural networks, but both have been taught to express e.g. addition using mathematical methods that can easily be verified. But it still doesn't guarantee for either of them not to make any mistakes, it only makes it reasonably possible for others to catch on to those mistakes. Always remember: All (mental) models are wrong. Some models are useful.
Life lesson for you: the internal functions of every individual's mind are unique. Your n=1 perspective is in no way representative of how humans as a category experience the world.
Plenty of humans do use longhand arithmetic methods in their heads. There's an entire universe of mental arithmetic methods. I use a geometric process because my brain likes problems to fit into a spatial graph instead of an imaginary sheet of paper.
Claiming you've not examined your own mental machinery is... concerning. Introspection is an important part of human psychological development. Like any machine, you will learn to use your brain better if you take a peek under the hood.
> Claiming you've not examined your own mental machinery is... concerning
The example was carefully chosen. I can introspect how I calculate 356*532. But I can't introspect how I calculate 14+17 or 1+3. I can deliberate the question 14+17 more carefully, switching from "system 1" to "system 2" thinking (yes, I'm aware that that's a flawed theory), but that's not how I'd normally solve it. Similarly I can describe to you how I can count six eggs in a row, I can't describe to you how I count three eggs in a row. Sure, I know I'm subitizing, but that's just putting a word on "I know how many are there without conscious effort". And without conscious effort I can't introspect it. I can switch to a process I can introspect, but that's not at all the same
It must be anthropomorphization that's hard to shake off.
If you understand how this all works it's really no surprise that reasoning post-factum is exactly as hallucinated as the answer itself and might have very little to do with it and it always has nothing to do with how the answer actually came to be.
The value of "thinking" before giving an answer is reserving a scratchpad for the model to write some intermediate information down. There isn't any actual reasoning even there. The model might use information that it writes there in completely obscure way (that has nothing to do what's verbally there) while generating the actual answer.
That's because when the failure becomes the context, it can clearly express the intent of not falling for it again. However, when the original problem is the context, none of this obviousness applies.
Very typical, and gives LLMs the annoying Captain Hindsight -like behaviour.
IDK how far AIs are from intelligence, but they are close enough that there is no room for anthropomorphizing them. When they are anthropomorphized its assumed to be a misunderstanding of how they work.
Whereas someone might say "geeze my computer really hates me today" if it's slow to start, and we wouldn't feel the need to explain the computer cannot actually feel hatred. We understand the analogy.
I mean your distinction is totally valid and I dont blame you for observing it because I think there is a huge misunderstanding. But when I have the same thought, it often occurs to me that people aren't necessarily speaking literally.
This is a sort of interesting point, it's true that knowingly-metaphorical anthropomorphisation is hard to distinguish from genuine anthropomorphisation with them and that's food for thought, but the actual situation here just isn't applicable to it. This is a very specific mistaken conception that people make all the time. The OP explicitly thought that the model would know why it did the wrong thing, or at least followed a strategy adjacent to that misunderstanding. He was surprised that adding extra slop to the prompt was no more effective than telling it what to do himself. It's not a figure of speech.
> No one gets in trouble for saying that 2 + 2 is 5, or that people in Pittsburgh are ten feet tall. Such obviously false statements might be treated as jokes, or at worst as evidence of insanity, but they are not likely to make anyone mad. The statements that make people mad are the ones they worry might be believed. I suspect the statements that make people maddest are those they worry might be true.
People are upset when AIs are anthropomorphized because they feel threatened by the idea that they might actually be intelligent.
Hence the woefully insufficient descriptions of AIs such as "next token predictors" which are about as fitting as describing Terry Tao as an advanced gastrointestinal processor.
The comment you replied to made a point that, if you accept it (which you probably should), makes that PG quote inapplicable here. The issue in this case is that treating the model as though it has useful insight into its own operation - which is being summarized as anthropomorphizing - leads to incorrect conclusions. It’s just a mistake, that’s all.
There's this underlying assumption of consistency too - people seem to easily grasp that when starting on a task the LLM could go in a completely unexpected direction, but when that direction has been set a lot of people expect the model to stay consistent. The confidence with which it answers questions plays tricks on the interlocutor.
I am speaking general terms - not just this conversation here. The only specific figure of speech I see in the original comment is "self reflection" which doesn't seem to be in question here.
It’s not even doing that. It’s just an algorithm for predicting the next word. It doesn’t have emotions or actually think. So, I had to chuckle when it said it was arrogant. Basically, it’s training data contains a bunch of postmortem write ups and it’s using those as a template for what text to generate and telling us what we want to hear.
Your calculations are off by some margin. Assuming 312kg per car, it would take 3962 minis to transport it all, somewhat more than the 4 you accounted for. Of course you could do this with 4 cars over a thousand round trips - I'm not sure which option is most likely to lead to success, I suspect both might arouse suspicion.
I think it’s actually a combination of people who have seen bad results from ai code generation (and have not looked deeper or figured out how to wield it properly yet) and another segment of the developer population who are now feeling threatened because it’s doing stuff they can’t do. Different groups
If that group is necessary then it's a damning indictment of the product/engineering culture. The CTO's job should be to fix the broken culture, not try to side-step it.
Hard disagree. Culture isn’t the problem, org structure is. You can call it an experiment or even a hack. Every team is already innovating within their scope, and splitting becomes easier as that scope grows.
What is too much is asking an Engineering Manager to start a completely independent product line that may go nowhere. It’s far more effective to rely on senior, staff+ engineers who don’t need management and have experience taking things from 0 to 1. They can build an MVP quick. Once we see real signals of PMF, we can then build a team around it (or drop it)
You’re right but you’re in the wrong place to argue this. Bezos has a talk where he famously talks about instituting weblabs and A/B testing because he doesn’t want to be a decision bottleneck and wants low stakes experiments with little friction.
But HN now is full of people completely removed from any kind of entrepreneurial mindset, people who aren’t “hackers” even in the most generous sense. They will not agree.
Keyboard warriors is probably the best descriptor of HN demo now.
