It's kind of hilarious that you're trying to charge money for this. Given that compressing the prompt requires putting the full prompt into GPT-4, it's mathematically impossible for you to save the user more money than you're spending.
Doesn't look like they're trying to charge money for it? The pricing page explicitly states the product is free and they're open to work on projects/contracts.
I wonder if you could trivially make the model better at math by hacking a precise calculator into its model somehow that it naturally figures out how to use. And whether you could do the same for human brains.
I think the author misses the magic feeling of the early internet and is trying to rationalize their feelings, but hasn't quite figured out the real explanation. I really doubt that their inability to find old news is the source of their troubles; in fact, I doubt that they've struggled to find old news at all. It's not very hard to find. More likely, the author is facing the same issue as everyone else; it's harder to find or create something on the internet that feels really special, because everyone's already seen it all.
