My first job was building out the first mega-datacenters.
-
My first job was building out the first mega-datacenters. 2005-2007, I was a datacenter assistant monkey working from Google working somewhere in the Chicago suburbs, swapping out hard drives and ram and writing shell scripts, as myself and my friends unknowingly laid down the prototype for the kinds of datacenters we all see today.
And so it is with some significant expertise that I say:
Fuck datacenters. Datacenters are an anti-pattern.
@cwebber At the moment we ended up with a phone that could do most of what we wanted, but had no agency over, at the backend there was the datacenter explosion, which we had no agency over. Now you can't even buy a laptop anymore because the datacenter explosion caused scarcity of its components. Check mate.
-
@thomasjwebb I've been meaning to write a blogpost for a long time. Sounds like it's time to write it!
@cwebber @thomasjwebb why am I starting to hear Bohemian Rhapsody in my head?
-
My first job was building out the first mega-datacenters. 2005-2007, I was a datacenter assistant monkey working from Google working somewhere in the Chicago suburbs, swapping out hard drives and ram and writing shell scripts, as myself and my friends unknowingly laid down the prototype for the kinds of datacenters we all see today.
And so it is with some significant expertise that I say:
Fuck datacenters. Datacenters are an anti-pattern.
@cwebber I agree with your premise. However, realistically, convincing businesses to return to on-prem is challenging. It's not just about management – maintaining, securing, and procuring on-prem hardware is a significant expense and effort compared to provisioning cloud resources.
MSPs could help, but even with their assistance, the ongoing costs and complexity often favor cloud-native solutions.
How do you think we could convince small business owners to move from Shopify for example?
-
@farfalk Datacenters are concentrations of power. Anytime a datacenter is involved, it's a sign of power centralization. The rise of datacenters corresponds with the death of p2p and other visions of a more decentralized internet.
@cwebber @farfalk I think it more corresponds to the death of personal computing as it was? People don't have desktops anymore and barely have laptops other than for work? Which is a problem for p2p? Seems like most people's decentralized/federated nodes for things are hosted in data centers? All question marks because just speculating.
-
@farfalk Datacenters are concentrations of power. Anytime a datacenter is involved, it's a sign of power centralization. The rise of datacenters corresponds with the death of p2p and other visions of a more decentralized internet.
@cwebber @farfalk Well you see Datacankers that way and I entirely agree. When will those presently apathetic about Datacancers realize their browsing and posting options have shrunken in quantity and quality? Some may be built for bitcoin mining but most have an objective I would call brain mining.
-
@cwebber that's an interesting point of view. I mean, of course the current datacenter craze is complete madness, but it seems you consider an anti-pattern the concept of datacenter itself. Why is it so? What do you suggest as an alternate solution to the problems data centers try to solve?
@farfalk @cwebber Really look at “the problems data centers try to solve”. At face value, LLMs and other “AI” are not functional or even profitable by themselves, but they are the supposed reason for the data center boom. But there’s strong evidence that the boom is driven by market manipulation for the hardware, not organic demand for its work. Further, the face value function of “AI” is to extract short term cash value while denying resources to humans. That is the secondary problem the centers try to solve (first being fraudulent investment in the centers themselves). That’s why framing it as “what’s your alternative” is a mistake.
-
@farfalk Datacenters are concentrations of power. Anytime a datacenter is involved, it's a sign of power centralization. The rise of datacenters corresponds with the death of p2p and other visions of a more decentralized internet.
@cwebber @farfalk like, I can appreciate some of the advantages of having them. Like you could get more computer per watt, maybe. I think valuable research is done with supercomputers and modern, more modular approaches to big data. But we could do way more with way fewer datacenters if these weren't used as a way to paywall functionality at the server side. The move to the cloud almost makes me miss when my problem was Cubase requiring a USB dongle.
-
@farfalk Datacenters are concentrations of power. Anytime a datacenter is involved, it's a sign of power centralization. The rise of datacenters corresponds with the death of p2p and other visions of a more decentralized internet.
@cwebber @farfalk How would you approach defining the threshold of concentration past which it's undesirable? The only obvious approach I can think of is "it's too high if there's a positive feedback loop", but that's both not really knowable and probably too low, given that we ~started from not much concentration and arrived at current, clearly undesirably high, levels thereof. -
@cwebber @farfalk I think it more corresponds to the death of personal computing as it was? People don't have desktops anymore and barely have laptops other than for work? Which is a problem for p2p? Seems like most people's decentralized/federated nodes for things are hosted in data centers? All question marks because just speculating.
@johns @cwebber @farfalk it's telling that hardware for user-controlled computing is disappearing. Memory and storage are disappearing from the market and it feels *intentional*. https://investors.micron.com/news-releases/news-release-details/micron-announces-exit-crucial-consumer-business
-
@cwebber that's an interesting point of view. I mean, of course the current datacenter craze is complete madness, but it seems you consider an anti-pattern the concept of datacenter itself. Why is it so? What do you suggest as an alternate solution to the problems data centers try to solve?
There's a very simple and actually very affordable alternative to data centers, both commercially and consumer: Self hosting.
Do you have a router in your home? Congratulations, you've got more computing resources than you'll ever need for your own little soapbox on the web as well as sending & receiving email.
For the moment it's too much of a configuration challenge for john-and-jane-doe average, but that's a software problem, that's very much solvable.
-
There's a very simple and actually very affordable alternative to data centers, both commercially and consumer: Self hosting.
Do you have a router in your home? Congratulations, you've got more computing resources than you'll ever need for your own little soapbox on the web as well as sending & receiving email.
For the moment it's too much of a configuration challenge for john-and-jane-doe average, but that's a software problem, that's very much solvable.
Small and mid sized businesses used to host their very own compute infrastructure, some 30 years ago. I was there, I worked summer jobs in their IT departments
IBM System/36, AS/400, Novell Netware, dBase/Clipper… those were the staples of the times, you could find at least one of them, but often several in most mid-sized businesses in Europe and North America.
-
@farfalk Datacenters are concentrations of power. Anytime a datacenter is involved, it's a sign of power centralization. The rise of datacenters corresponds with the death of p2p and other visions of a more decentralized internet.
-
@cwebber @farfalk like, I can appreciate some of the advantages of having them. Like you could get more computer per watt, maybe. I think valuable research is done with supercomputers and modern, more modular approaches to big data. But we could do way more with way fewer datacenters if these weren't used as a way to paywall functionality at the server side. The move to the cloud almost makes me miss when my problem was Cubase requiring a USB dongle.
@thomasjwebb @cwebber @farfalk there is always a "but sometimes" so maybe we can take it as a given that for any strident statement in short form chat there isn't all the nuance about exceptions.
The overall direction seems right to me though. We've got a not insignificant ipv6 deployment for residential use, where is the Cobalt Qube of personal computing? There is no good *technical* reason I shouldn't be able to host my personal email on my own domain, at home, on my own computer, along with a website or whatever. Big monopolistic platforms, which require huge datacenters and complex tech stacks, are an antipattern.
-
@cwebber @farfalk I think it more corresponds to the death of personal computing as it was? People don't have desktops anymore and barely have laptops other than for work? Which is a problem for p2p? Seems like most people's decentralized/federated nodes for things are hosted in data centers? All question marks because just speculating.
-
@thomasjwebb @cwebber @farfalk there is always a "but sometimes" so maybe we can take it as a given that for any strident statement in short form chat there isn't all the nuance about exceptions.
The overall direction seems right to me though. We've got a not insignificant ipv6 deployment for residential use, where is the Cobalt Qube of personal computing? There is no good *technical* reason I shouldn't be able to host my personal email on my own domain, at home, on my own computer, along with a website or whatever. Big monopolistic platforms, which require huge datacenters and complex tech stacks, are an antipattern.
@raven667 @cwebber @farfalk sure I just don’t want to be seen as someone who hasn’t considered the obvious counterpoints. I have the “always include depth-first nuance” kind of autism and ocd. But yeah I think if we design protocols right, maybe people won’t even have to self-host in many cases. It could be some truly p2p stuff than can run on the client.
-
My first job was building out the first mega-datacenters. 2005-2007, I was a datacenter assistant monkey working from Google working somewhere in the Chicago suburbs, swapping out hard drives and ram and writing shell scripts, as myself and my friends unknowingly laid down the prototype for the kinds of datacenters we all see today.
And so it is with some significant expertise that I say:
Fuck datacenters. Datacenters are an anti-pattern.
@cwebber The main motivations for using data centers are security, reliability, flexibility, and efficiency. A data center can manage power consumption much better than your typical on premises installation. Infrastructure can be shared by many users, which allows dynamic scaling without having to over provision on premises. It also allows users to share expert reliability and cybersecurity engineers.
-
@farfalk Datacenters are concentrations of power. Anytime a datacenter is involved, it's a sign of power centralization. The rise of datacenters corresponds with the death of p2p and other visions of a more decentralized internet.
-
My first job was building out the first mega-datacenters. 2005-2007, I was a datacenter assistant monkey working from Google working somewhere in the Chicago suburbs, swapping out hard drives and ram and writing shell scripts, as myself and my friends unknowingly laid down the prototype for the kinds of datacenters we all see today.
And so it is with some significant expertise that I say:
Fuck datacenters. Datacenters are an anti-pattern.
@cwebber
huhinteresting.
about that same time;
had 3 interviews with the goog
as a 'linux beige box wrangler'
at a big campus dc in northern va
my linux clue-kit was deep & shallow at the same time
they passed me over
I was bummed, bigly
then it all changed
-
Small and mid sized businesses used to host their very own compute infrastructure, some 30 years ago. I was there, I worked summer jobs in their IT departments
IBM System/36, AS/400, Novell Netware, dBase/Clipper… those were the staples of the times, you could find at least one of them, but often several in most mid-sized businesses in Europe and North America.
@datenwolf @farfalk @cwebber lots of financial institutions still have private datacenters, and still run IBM mainframes. Just easier to manage from a security perspective.
-
@cwebber @farfalk How would you approach defining the threshold of concentration past which it's undesirable? The only obvious approach I can think of is "it's too high if there's a positive feedback loop", but that's both not really knowable and probably too low, given that we ~started from not much concentration and arrived at current, clearly undesirably high, levels thereof.
