no notes
-
no notes
@karl choose wisely
-
no notes
@karl maybe we can get the tech bros to care about the environment if we spin it that they need to save the fresh water needed for the data centers
-
@orange_lux @saxnot @dibi58 @karl llms are useful for NLP. Inference is actually relatively cheap, it's the training that's really expensive and resource intensive. We've probably already maxed out LLM capabilities, so most of this training is not useful. Companies keep training because they need to convince investors that infinite growth is possible. What actual gains are being made are coming from architectural changes, not from training.
Basically, "AI data centers" should not exist. Local models can do everything that's needed. If we need to train new models, those need to be balanced against climate goals (basically, don't fucking do it). And LLMs should be removed from basically everything they've been shoved into recently.
If you don't know why LLMs are useful, you shouldn't have to interact with LLMs. Even some of the places where they are useful, they can be used to construct cheaper models.
There are a few things, like correlation across huge data sets, that they're useful for. But even then, simple encoding can give you semantic search, where inference is not necessary or only provides minimal additional benefit.
Yeah, basically, 95-99% reduction in cars and AI. It's basically the same thing.
-
no notes
@karl i cannot comprehend how this is something to choose.
how stupid can you be to pick between those two -
no notes
@karl@infosec.exchange we lost france to the great freezing
(guillotine the guy who colored this map)
-
@orange_lux @dibi58 @karl same we use CNN, RNN, ... etc
LMM is just another useful helpful machine learning type.in contrast: blockchain was useless from the start.
LLM is boring tech blown into weird proportions due to greed, capitalism, tech-oligarchy, etc. -
@orange_lux @dibi58 @karl same we use CNN, RNN, ... etc
LMM is just another useful helpful machine learning type.in contrast: blockchain was useless from the start.
LLM is boring tech blown into weird proportions due to greed, capitalism, tech-oligarchy, etc.@orange_lux @dibi58 @karl e. g. the sort of stuff which ranks search queries, recommends videos, "people also bought", ads, mall layouts, etc
site note: my degree has focus on data/ml stuff
-
@karl@infosec.exchange we lost france to the great freezing
-
no notes
@karl Imagine a group of hyper-intelligent beings building an incredibly powerful computer AGI in order to find out the answer to the ultimate question of life, the universe and everything
-
no notes
@karl jzzz Data Centers can be optimize by a lot.
If we are still able to contact Voyager 1/2 how the help we can’t optimize IA, datacenters, etc.Buy buy buy, crap crap crap …
We need to get to basics and build with few and what we have.It’s possible to reach climate goals and have computer power. But for that we need to have the essential and work with it.
-
@orange_lux @dibi58 @karl e. g. the sort of stuff which ranks search queries, recommends videos, "people also bought", ads, mall layouts, etc
site note: my degree has focus on data/ml stuff
-
no notes
@karl Difícil elección. O morir de calor en pos del beneficio de los ricos o no hacerlo. Dadme por favor 9ms para pensármelo...
-
@orange_lux @saxnot @dibi58 @karl llms are useful for NLP. Inference is actually relatively cheap, it's the training that's really expensive and resource intensive. We've probably already maxed out LLM capabilities, so most of this training is not useful. Companies keep training because they need to convince investors that infinite growth is possible. What actual gains are being made are coming from architectural changes, not from training.
Basically, "AI data centers" should not exist. Local models can do everything that's needed. If we need to train new models, those need to be balanced against climate goals (basically, don't fucking do it). And LLMs should be removed from basically everything they've been shoved into recently.
If you don't know why LLMs are useful, you shouldn't have to interact with LLMs. Even some of the places where they are useful, they can be used to construct cheaper models.
There are a few things, like correlation across huge data sets, that they're useful for. But even then, simple encoding can give you semantic search, where inference is not necessary or only provides minimal additional benefit.
Yeah, basically, 95-99% reduction in cars and AI. It's basically the same thing.
@Hex @orange_lux @saxnot @dibi58 @karl I suspect you're underestimating the compute being dedicated to running (not training) the models.
I was recently observing a conversation between small startup founders who are buying €100k EGX Station AI workstations to move their developers from Cursor/Claude to local models. The same person seemed both to be questioning the value of all this LLM use by his dev team, at the same time considering buying €100k in hardware to reduce his LLM costs.
-
no notes
@karl Yikes. People will die of heat this week in France
-
@karl Imagine a group of hyper-intelligent beings building an incredibly powerful computer AGI in order to find out the answer to the ultimate question of life, the universe and everything
-
@karl The article has been amended to remove the quote "Editor’s note: This is an updated version of the article. The previous version wrongly quoted Jeff Bezos. The error is regretted."
-
no notes
@karl That's true, but the temperature info graphic is horrendous. It is in absolute temperature and goes from -30°C - 50°C... that's bonkers.
Don't use stupid graphics, if the good ones are out there. (relative Temperature for a day is much better. )
-
no notes
@karl I would like the @EUCommission to take note and do something USEFUL for a while instead of saying just "yes my lord" to whatever tech lobby comes to them.
-
@Hex @orange_lux @saxnot @dibi58 @karl I suspect you're underestimating the compute being dedicated to running (not training) the models.
I was recently observing a conversation between small startup founders who are buying €100k EGX Station AI workstations to move their developers from Cursor/Claude to local models. The same person seemed both to be questioning the value of all this LLM use by his dev team, at the same time considering buying €100k in hardware to reduce his LLM costs.
@sherbang @Hex @orange_lux @saxnot @dibi58 I work at a cloud provider and can confirm that running ai isn't as cheap as it sounds.
My take is that most models are so general purpose that they're very inefficient (versatile, yes, but inefficient). Think "sorting an array through a bogo sort" inefficient. LLMs trained for a specific purpose may be more cost-effective to run long term, but that's not the norm.
-
no notes
@karl no difficult choice
