Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

The Magistral Small can fit within a single RTX 4090 or a 32GB RAM MacBook once quantized.


Excellent news for me.

How does one figure this out? As in I want to know the comparable Deepseek or Llama equivalent (size-wise) and don't want to figure it out by trial and error.


Is it indeed the plan of Apple to eventually run such kind of models direcly inside a iPhone? Or are the specs of any stateOfTheArt smartphone well below the minimum requirements of such "lightweight" models?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: