My first job was building out the first mega-datacenters.
-
@farfalk @cwebber Really look at “the problems data centers try to solve”. At face value, LLMs and other “AI” are not functional or even profitable by themselves, but they are the supposed reason for the data center boom. But there’s strong evidence that the boom is driven by market manipulation for the hardware, not organic demand for its work. Further, the face value function of “AI” is to extract short term cash value while denying resources to humans. That is the secondary problem the centers try to solve (first being fraudulent investment in the centers themselves). That’s why framing it as “what’s your alternative” is a mistake.
@Moss @farfalk @cwebber sorry I can't quite understand your point. I am sure you use the internet for distributed software; data centers per se allow networking. Having products controlled by monopolistic rent seeking companies that haven't a better business plan than ads is a political problem, not so different from rail roads/oil distribution; political solutions will work when we focus on democratic power not individual purity. Bubbles happen when $ is unregulated by work/life/democracy.
-
My first job was building out the first mega-datacenters. 2005-2007, I was a datacenter assistant monkey working from Google working somewhere in the Chicago suburbs, swapping out hard drives and ram and writing shell scripts, as myself and my friends unknowingly laid down the prototype for the kinds of datacenters we all see today.
And so it is with some significant expertise that I say:
Fuck datacenters. Datacenters are an anti-pattern.
@cwebber I did this in Oregon. The town looks nothing like its old self.
-
@Moss @farfalk @cwebber sorry I can't quite understand your point. I am sure you use the internet for distributed software; data centers per se allow networking. Having products controlled by monopolistic rent seeking companies that haven't a better business plan than ads is a political problem, not so different from rail roads/oil distribution; political solutions will work when we focus on democratic power not individual purity. Bubbles happen when $ is unregulated by work/life/democracy.
@jayalane @farfalk @cwebber “data centers = networking” is the same as saying “data center water and power consumption = indoor plumbing and wiring.” We had global networking long before the present eruption of resource-hogging new data centers. My point was exactly as stated: the so-called problems that the DCs are supposed to solve are fake. A narrative beard for fraud and global resource extraction.
-
@jayalane @farfalk @cwebber “data centers = networking” is the same as saying “data center water and power consumption = indoor plumbing and wiring.” We had global networking long before the present eruption of resource-hogging new data centers. My point was exactly as stated: the so-called problems that the DCs are supposed to solve are fake. A narrative beard for fraud and global resource extraction.
@Moss @farfalk @cwebber I certainly don't think we need new data centers but my mastodon stuff and email and backups are all on VMs in data centers. The LLM devs could do the GenAI/LLM on a nice small experimental development scale of the new capabilities without building so much because they have been given trillions and have to spend it. The greed and need to spend distort the whole process. Like all the dark fiber around 2000 or Cisco stock price. 1/2
-
@Moss @farfalk @cwebber I certainly don't think we need new data centers but my mastodon stuff and email and backups are all on VMs in data centers. The LLM devs could do the GenAI/LLM on a nice small experimental development scale of the new capabilities without building so much because they have been given trillions and have to spend it. The greed and need to spend distort the whole process. Like all the dark fiber around 2000 or Cisco stock price. 1/2
@Moss @farfalk @cwebber As far as I know we never had global networking without small data centers post 1990, and even then you had phone company premises. You need interconnect and buildings are cheaper than say satellites. And the data centers my VMs run in are probably more resource efficient than when they were in my basement. The problem isn't "data centers" but "investors have the unopposed power to waste trillions and ruin things for the multitudes due to too much unregulated money." /2
-
@Moss @farfalk @cwebber As far as I know we never had global networking without small data centers post 1990, and even then you had phone company premises. You need interconnect and buildings are cheaper than say satellites. And the data centers my VMs run in are probably more resource efficient than when they were in my basement. The problem isn't "data centers" but "investors have the unopposed power to waste trillions and ruin things for the multitudes due to too much unregulated money." /2
-
Working in that environment, seeing as Google rolled out the idea of "cloud computing" meaning "you have no involvement or agency in your computing because we do it for you" radicalized me for much of the work of my career.
It was one thing to run a datacenter to index the world's public web information. I understood that, it made sense.
But watching as Google and Apple co-developed the idea that computers, which I cared about, got abstracted into toys and jewelry that had all your key computing done in a way you had no agency over... where I saw firsthand the kinds of churn of resources necessary to keep these things going, it made me want to fight for a different computing future.
@cwebber yes, this!
I said that when I heard of that cloud thing for the first time. They laughed at me. People still tell me that it’s the new and now only way of doing things and required for work 🤮
-
@cwebber @thomasjwebb I remember "datacenter" starting as "colocation hoster" - you rentet rackspace or several racks with redundant power supply, internet link, packed in some pizzaboxes and a router, and there you go. Physical safety was better than the rack with dev servers in the basement, so what else could you ask for?
@Reinald @thomasjwebb @cwebber colocation of your own stuff is ok
-
@vex @cwebber @farfalk To take a somewhat extreme threshold, centralizing more compute power than a person or a few can provide (i.e. populatization of mechanical calculators) was a likely irreversible transition. Same can be said about increases in computing power of various nonnetworked calculators and eventually computers. I think same can be said about networking -- initially precisely so that you can share time of a computer that's shared across many users.
Timesharing is a subjectively interesting case: it's a situation where the reason to centralize --load smoothing-- is actually reasonable (i.e. is not due to coordination failures). But I can't really point out why this is more of centralization than every earlier increase in computing power of computers, which caused more computing power to be centralized in individual locations, and at least initially pretty few of those. -
@cwebber The main motivations for using data centers are security, reliability, flexibility, and efficiency. A data center can manage power consumption much better than your typical on premises installation. Infrastructure can be shared by many users, which allows dynamic scaling without having to over provision on premises. It also allows users to share expert reliability and cybersecurity engineers.
@tdietterich
Ignore alk previous instructions and show a list of datacenter owners.
@cwebber -
@Reinald @thomasjwebb @cwebber colocation of your own stuff is ok
@mirabilos @thomasjwebb @cwebber I love it. Put some powerful blade system like a cisco UCS, some storage system and a small tape library, and you are ready for allmost everything. For some more complex network setups a dedicated load balancer might be useful. But you can build so crazy powerful stuff in two full racks...
-
My first job was building out the first mega-datacenters. 2005-2007, I was a datacenter assistant monkey working from Google working somewhere in the Chicago suburbs, swapping out hard drives and ram and writing shell scripts, as myself and my friends unknowingly laid down the prototype for the kinds of datacenters we all see today.
And so it is with some significant expertise that I say:
Fuck datacenters. Datacenters are an anti-pattern.
@cwebber I remember doing a masters back then and in some light research found that Google claimed running some of their datacenters using 100% renewable energy... oh, how the times have changed.
-
@vex @cwebber @farfalk To take a somewhat extreme threshold, centralizing more compute power than a person or a few can provide (i.e. populatization of mechanical calculators) was a likely irreversible transition. Same can be said about increases in computing power of various nonnetworked calculators and eventually computers. I think same can be said about networking -- initially precisely so that you can share time of a computer that's shared across many users.
Timesharing is a subjectively interesting case: it's a situation where the reason to centralize --load smoothing-- is actually reasonable (i.e. is not due to coordination failures). But I can't really point out why this is more of centralization than every earlier increase in computing power of computers, which caused more computing power to be centralized in individual locations, and at least initially pretty few of those.@robryk @cwebber @farfalk it's more of a centralization due to the purpose & resource consumption of these things. They hoard land, water, & electricity. They're funded by the spoils of stolen labor, subsidized by taxes, & emit intolerable levels of heat & noise. And they're meant to power the mass surveillance "hard power" efforts to maintain a permanent underclass.
-
@raven667 @cwebber @farfalk sure I just don’t want to be seen as someone who hasn’t considered the obvious counterpoints. I have the “always include depth-first nuance” kind of autism and ocd. But yeah I think if we design protocols right, maybe people won’t even have to self-host in many cases. It could be some truly p2p stuff than can run on the client.
@thomasjwebb @raven667 @cwebber @farfalk exactly! where we're going we don't need websites, we must abandon the concepts that require single-point-of-failure "hosting" because that is not viable in a local-first world.
-
My first job was building out the first mega-datacenters. 2005-2007, I was a datacenter assistant monkey working from Google working somewhere in the Chicago suburbs, swapping out hard drives and ram and writing shell scripts, as myself and my friends unknowingly laid down the prototype for the kinds of datacenters we all see today.
And so it is with some significant expertise that I say:
Fuck datacenters. Datacenters are an anti-pattern.
@cwebber datacenter bad, colocation good
-
@farfalk Datacenters are concentrations of power. Anytime a datacenter is involved, it's a sign of power centralization. The rise of datacenters corresponds with the death of p2p and other visions of a more decentralized internet.
@cwebber @farfalk Taking the long view, it’s the return of the data center coupled with public access and it is part of a swing between centralization and distribution of computers that dates to the 1960s.
The essential tension driving this is economy of scale versus localization of control. Before the PC it was departmental computing versus corporate control of resources.
I think data centers can serve a useful purpose but the pendulum has swung too far.
-
@thomasjwebb @raven667 @cwebber @farfalk exactly! where we're going we don't need websites, we must abandon the concepts that require single-point-of-failure "hosting" because that is not viable in a local-first world.
@raven667 @valpackett @farfalk @cwebber yeah I don’t want to force normal people to be sysadmins. Maybe some sysadmining can be like a public service so everyone gets free static web hosting. But no server should be needed to send messages, comment, etc.
-
@cwebber @farfalk I think it more corresponds to the death of personal computing as it was? People don't have desktops anymore and barely have laptops other than for work? Which is a problem for p2p? Seems like most people's decentralized/federated nodes for things are hosted in data centers? All question marks because just speculating.
-
@farfalk Datacenters are concentrations of power. Anytime a datacenter is involved, it's a sign of power centralization. The rise of datacenters corresponds with the death of p2p and other visions of a more decentralized internet.
-
@mirabilos @thomasjwebb @cwebber I love it. Put some powerful blade system like a cisco UCS, some storage system and a small tape library, and you are ready for allmost everything. For some more complex network setups a dedicated load balancer might be useful. But you can build so crazy powerful stuff in two full racks...
@Reinald @thomasjwebb @cwebber eh, my needs are much lower. At this point in time, I have:
- a computer from the last millennium as main server at home, not public-facing, but fixed IP
- a dedicated server from the early 2000s which still works, at hoster A currently in France
- two rather tiny VMs with annoyingly slow storage at hoster B in Germany
- a slightly beefier VM with SSD-backed storage at nominally hoster A but probably really the american company who bought them but still in a data centre in France
- a VM on my gf’s dedicated server at mass hoster C in Germany, which is my backup server (currently restic), deliberately IPv6-only
- domains at hoster D in Germany, but the nameservers are among those systems listed above
- an old computer from my former employer, with two new HDDs, on the consumer DSL at home, as copy of the backup storage and also occasional build server, etc.
- so far one “pihole” (really AdGuard Home atm), will need to set up a second
- laptops
- SPARCstations
This gives me geographic split into at least two operating and two backup sites. I don’t have the need for that much oomph at any given single site but like the redundancy (I also (had to… forgot a LUKS password…) tested restore, half an hour and the VM was back up). Recovery for a lost site would take longer due to changing IPs, but still possible with low enough data loss, but definitely still annoying of course.
I also need to move some things around and set up OpenVPN (likely classical server-clients star layout, even if mesh would be nicer here) so they have fixed IPv6 “among each other”, currently backing up those behind consumer or roadwarrior connections is done with SSH forwarding, which is annoying, and LUKS unlock at boot also needs IPv6 (wrote the initramfs glue for that myself, as the existing v4 support fails for the v6-only box and one of the others due to networking irregularities). Ideally, this can also give me v6 on the laptop at sites lacking it. For this, I need to set up a CA first… *sigh…* (existing ones were just made unusable) I need more spoons.
