Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I tried to run it but seems like it is either broken or it does not work on dockerized llama.cpp:

0.01.865.326 E llama_model_load: error loading model: missing tensor 'blk.40.attn_norm.weight'



that particular quant is just corrupted. these work but seem to loop in reasoning a lot https://huggingface.co/groxaxo/Qwen-AgentWorld-35B-A3B-GGUF


unsloth version works.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: