Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Because the transformer architecture that enabled modern LLMs wasn't invented until 2017[1]?

1: That's the "T" in GPT fyi, even though Google is the author of the research paper that changed everything



Right. So we had enough information to train LLMs but not the technology to build it.

So the initial models arent just distilled from information. We’ve always had the information.


Yes, but not the secret of distillation.




Consider applying for YC's Fall 2026 batch! Applications are open till July 27.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: