Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

But most benchmarks are not about that...

Are there even any "hallucination" public benchmarks?



"Benchmarks" for LLMs are a total hoax, since you can train them on the benchmarks themselves.


I would assume a good benchmark has hidden tests, or something randomly generated that is harder to game




Consider applying for YC's Winter 2027 batch! Applications are open till November 2.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: