Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Look at the "Q4_0 Prompt" column. That's the tokens-per-second processing the initial prompt/system prompt. This is where the "neural accelerators inside each GPU core" is seen most prominently.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: