a great misinformation generator, the best, it can even tell tales about unicorns, what's not to like?
do you know what was the best attempt at text generation before GPT? it was LSTM word salad - this kind of text[1]:
> Once upon a time there were a man and noble princess!’ being so good- natured, and that morning, when he awoke, he found it in his hand it to the palace. The young wild hut a lived, on the bridge of two days…
vs GPT-2:
> In a shocking finding, scientist discovered a herd of unicorns living in a remote, previously unexplored valley, in the Andes Mountains. Even more surprising to the researchers was the fact that the unicorns spoke perfect English.
a great misinformation generator, the best, it can even tell tales about unicorns, what's not to like?
do you know what was the best attempt at text generation before GPT? it was LSTM word salad - this kind of text[1]:
> Once upon a time there were a man and noble princess!’ being so good- natured, and that morning, when he awoke, he found it in his hand it to the palace. The young wild hut a lived, on the bridge of two days…
vs GPT-2:
> In a shocking finding, scientist discovered a herd of unicorns living in a remote, previously unexplored valley, in the Andes Mountains. Even more surprising to the researchers was the fact that the unicorns spoke perfect English.
[1] https://towardsdatascience.com/text-generation-gpt-2-lstm-ma...
vs GPT-3:
> A robot wrote this entire article. Are you scared yet, human?
https://www.theguardian.com/commentisfree/2020/sep/08/robot-...