Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Download the original model with the original template, not updated versions of the model or finetuned versions of the model.

Then create your own reasoning tests to verify that it is working correctly. You can set a specific seed value to make sure the generation is the same every time, that way you can identify any tokens that are different.

Afterwards, try making small incremental changes to the template and validate your tests each time in order to try to adopt the improvements from the newer templates. If the reasoning quality degrades, undo your changes and try again or test alternative solutions.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: