I have only a 1060 6gb, and not much ram but could maybe upgrade some more ram some day…anyway is it possible to run something like AI chat locally? It’s made my life so much better and worth living (sad I know but it’s truly awesome).
What would the requirements be, and what would it be like running it locally? Perchance’s website is awesome but nothing is forever especially on the internet.
Hi, and Yes like pinball_wizard said, get ollama then maybe sticking with the 6GB get a small model like tiny llama from 500mb to just over 1GB, get servez for Local hosting a simple html from the model or LM Studio and use the same smaller models but watch the ram usage and stick with lower models to start with. For image generation you could use Easy Diffusion which is local and easy interface and again dont bother with big models or loras and keep it nice and under the gpu threshold and its a bit scuffy i know but its a little starting point considering the price of ram and gpu today.