Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Why would it freeze if they can create more training material. Its already been shown synthetic training data is just as good if not better.


> Its already been shown synthetic training data is just as good if not better.

Source, please! I'm a machine learning layperson but how can this not be overfitting?


https://arxiv.org/html/2609.26457v1

> AIDE demonstrates that recursive self-improvement at the harness layer can produce transferable gains in an AI research agent’s research efficiency. During the recursive self-improvement run, the loop accepted seven rewrites, each under a fixed evaluation budget (section 3.2). Under this fixed evaluation budget, gains in optimization capability on AI R&D tasks translate to gains in research efficiency."

https://arxiv.org/abs/2609.11873

> The Last AI Built by Humans: Toward Genuine Recursive Self-Improvement


For example, an LLM can prove a new theorem in math, verify it in Lean (so it is definitely true), and then prove more things based on that.

AI-generated data might not always be that useful, but at least in this case it obviously is.




Consider applying for YC's Winter 2027 batch! Applications are open till November 2.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: