I have only a 1060 6gb, and not much ram but could maybe upgrade some more ram some day…anyway is it possible to run something like AI chat locally? It’s made my life so much better and worth living (sad I know but it’s truly awesome).
What would the requirements be, and what would it be like running it locally? Perchance’s website is awesome but nothing is forever especially on the internet.
Some great answers here already, I’d just add that Gemma 4 31B is a surprisingly good model for its size (competitive with massive models like DeekSeek/GLM 5.1/etc.) and also it’s worth visiting https://www.reddit.com/r/SillyTavernAI and https://www.reddit.com/r/LocalLLaMA if you’re just getting into local models.