The universal truth for people is often different than the truth, and AI has to return the convenient truth.
Example. People are persuaded that women can do two things at the same time and men cannot. Despite countless counterexamples, the original study positioning everyone on a bell curve with only 6% difference in time of execution, and without checking for the quality of the results (“254 plus 786 equals 126 quick mafs!!!”), it is blatantly false, but any search engine that would return that it is false would make itself rejected by humans.
Example. People are persuaded that women can do two things at the same time and men cannot. Despite countless counterexamples, the original study positioning everyone on a bell curve with only 6% difference in time of execution, and without checking for the quality of the results (“254 plus 786 equals 126 quick mafs!!!”), it is blatantly false, but any search engine that would return that it is false would make itself rejected by humans.