Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

>No, you don't. Without training cost you can infer only the marginal cost of serving this kind of models.

Are you talking about Kimi's training cost or the training cost of the model(s) that Kimi distilled?

Because Moonshot didn't even incur the majority of the training costs either



> the training cost of the model(s) that Kimi distilled?

The distillation process involves getting conversation traces from the model you are distilling from, and then training your model against them.

You still have to do the training!


I believe they are talking about the closed models' training costs.

I other words, the providers that will be offering K3 inference don't have any training costs to offset, so they are only charging for the inference itself. OAI/Anthropic would need to offset their R&D and training costs in order to not be selling API access at a loss.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: