We tend to think that markets reflect consumer choice. But the artificial-intelligence boom has been powered by the investment decisions of concentrated capital rather than by consumer demand.
It just sounded like the kind of thing that makes good sense on paper but I’m wondering if it actually works out well. Sounds like you are in the process of getting ready to try it.
Someone mentioned that, but it doesn’t have to be off-grid. My 2 kWp system is grid-tied and if I would start running a local LLM it would be an incentive to add another couple.
It may sound odd but I’ve heard people bring up the above point a few times. “AI isn’t bad - if you run it on a sustainable off-grid system it’s perfectly fine.”
But I have NOT encountered people actually doing this even once, let alone a few times. That’s why I was asking.
Anything that wastes energy can be recast as harmless if you put it on an imaginary sustainable setup but that just seems like fantasizing.
Renewable infra isn’t sustainable, since it can’t be built with renewable energy alone. As such it’s just a fossil multiplier. I make about 2/3rd of my own net power, since my electricity meter is old enough to run backwards. I can’t install more orelse my meter would read negative. I intend to run a Qwen model that fits my 8 GB HBM Radeon card as an experiment during the day, starting end of this month.
If this works I consider running something hotter, and double my PV capacity. Adding AC or an EV would be another option. None of this is sustainable, but not exactly a fantasy.
Do you know anyone doing all of that? Running a local model on off-grid power?
deleted by creator
It just sounded like the kind of thing that makes good sense on paper but I’m wondering if it actually works out well. Sounds like you are in the process of getting ready to try it.
deleted by creator
Someone mentioned that, but it doesn’t have to be off-grid. My 2 kWp system is grid-tied and if I would start running a local LLM it would be an incentive to add another couple.
It may sound odd but I’ve heard people bring up the above point a few times. “AI isn’t bad - if you run it on a sustainable off-grid system it’s perfectly fine.”
But I have NOT encountered people actually doing this even once, let alone a few times. That’s why I was asking.
Anything that wastes energy can be recast as harmless if you put it on an imaginary sustainable setup but that just seems like fantasizing.
Renewable infra isn’t sustainable, since it can’t be built with renewable energy alone. As such it’s just a fossil multiplier. I make about 2/3rd of my own net power, since my electricity meter is old enough to run backwards. I can’t install more orelse my meter would read negative. I intend to run a Qwen model that fits my 8 GB HBM Radeon card as an experiment during the day, starting end of this month.
If this works I consider running something hotter, and double my PV capacity. Adding AC or an EV would be another option. None of this is sustainable, but not exactly a fantasy.