Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Our brain is more like a MoE model activating only a few neurons for specific activities making it more efficient unlike a dense model activating all the params.

Also brain produces quality tokens @ 3.3 tps instead of fast generating hallucinated tokens by certain models. Thus MTP can produce low quality tokens at 2x speed.

Patience pays.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: