I won't weigh in on whether it's "cheating" but it is definitely benchmaxxing | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		howunfortunate 9 days ago \| parent \| context \| favorite \| on: I trained a small transformer in 1.5hrs and it bea... I won't weigh in on whether it's "cheating" but it is definitely benchmaxxing
		help

iwontberude 9 days ago [–]

Yeah, unless the model is evaluated with blind hold outs, the benchmarks are misleading.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact