• HumanPerson@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    1
    ·
    4 months ago

    Ollama with open webui if you have a computer lying around. I’m able to run the 7b models on a 1050ti. Be warned if you haven’t hosted stuff, it’s a rabbit hole.