@devsimsek Nobody ever claimed that llms get better by being trained on their own synthetic data. This blog post is very misleading.

The idea of self-improvement and singularity is that llms write improved versions of their own codebase and perform the research and experiments for coming up with better models themselves.
The idea of singularity is interesting but also full of hidden assumptions. I'm always confused when people act like singularity would exist. It's just science fiction.