Running local models is good now
1d 7h ago by mander.xyz/u/cm0002 in technology@midwest.social from vickiboykis.com
It’s been good!
The models OP tried are out of date. Newer ones + newer quantization techniques are dramatically better.
But:
https://sleepingrobots.com/dreams/stop-using-ollama/
Use literally any framework but Ollama.