I'm coming to the conclusion that community-owned and operated small clouds (co-ops) with easy onramps for self-hosting open source services like mail, storage, and VPN are the only way forward.
-
@mttaggart @stag @HolosSocial there are actual new attempts of using atproto without any relays and external architecture, things like "red dwarf" and even "wafrn" now adopt this mechanism
i am not exactly sure on how it works but as far as i understand, it performs activitypub-style federation but with proper backfilling and it's pretty darn efficient for small and big deployments alike
maybe my friend @alexia is better at explaining it than i am, she does work pretty closely to wafrn
@stag@mk.absturztau.be @HolosSocial@mastodon.social @mttaggart@infosec.exchange @nelson@wetdry.world
hi hello
to TL;DR this because I don't want to make too large of an explanation, for a good few months now instead of relying on a relay+appview we've instead been relying on https://www.microcosm.blue/ and more specifically Constellation as well as Jetstream (both of which amount to basically filtered down relays) which dramatically decreaess the amount of storage use, network bandwidth and CPU required to run wafrn, even if you were to do it full-stack setup with hosting constellation, jetstream, wafrn and a PDS on your own.
I think jetstream still uses a relay as an upstream but even those have become one hell of a lot cheaper to run thanks to more customizability to what is and isn't kept and for how long
point is all of the above can now run on a really shitty contabo vps for maybe like 3-4€ or whatever @gabboman pays
(that said, depending on circumstances it can still be more expensive than an activitypub server)
(do also note that the most expensive part of Bluesky's stack has always been the AppView, which provides an API, caching with redis, full-text indexing, a CDN…) -
@stag@mk.absturztau.be @HolosSocial@mastodon.social @mttaggart@infosec.exchange @nelson@wetdry.world
hi hello
to TL;DR this because I don't want to make too large of an explanation, for a good few months now instead of relying on a relay+appview we've instead been relying on https://www.microcosm.blue/ and more specifically Constellation as well as Jetstream (both of which amount to basically filtered down relays) which dramatically decreaess the amount of storage use, network bandwidth and CPU required to run wafrn, even if you were to do it full-stack setup with hosting constellation, jetstream, wafrn and a PDS on your own.
I think jetstream still uses a relay as an upstream but even those have become one hell of a lot cheaper to run thanks to more customizability to what is and isn't kept and for how long
point is all of the above can now run on a really shitty contabo vps for maybe like 3-4€ or whatever @gabboman pays
(that said, depending on circumstances it can still be more expensive than an activitypub server)
(do also note that the most expensive part of Bluesky's stack has always been the AppView, which provides an API, caching with redis, full-text indexing, a CDN…)@alexia @stag @gabboman @HolosSocial @nelson
Right. Jetstream does rely on an upstream Relay, and I think Bsky acquired Jetstream from an independent project. And yes, the AppView for large lexicons is the hard problem.
-
@alexia @stag @gabboman @HolosSocial @nelson
Right. Jetstream does rely on an upstream Relay, and I think Bsky acquired Jetstream from an independent project. And yes, the AppView for large lexicons is the hard problem.
@nelson@wetdry.world @alexia@app.wafrn.net @mttaggart@infosec.exchange @HolosSocial@mastodon.social @stag@mk.absturztau.be
bsky centralized discourse again?
gona be quick.
each wafrn instance in https://join.wafrn.net is independent of bluesky.You can host a wafrn instance on a shitty contabo vps or even worse (gabboman xyz costs less than 20 euros a year).
We use external apis that are easily hosteable on a VERY EXPENSIVE raspberry pi. such extreme compute power required.
its a different architecture. and I will say what I always say: knowing how one works makes harder for your brain understanding the other one.
I say this as someone who has wrote implementations of both
-
@nelson@wetdry.world @alexia@app.wafrn.net @mttaggart@infosec.exchange @HolosSocial@mastodon.social @stag@mk.absturztau.be
bsky centralized discourse again?
gona be quick.
each wafrn instance in https://join.wafrn.net is independent of bluesky.You can host a wafrn instance on a shitty contabo vps or even worse (gabboman xyz costs less than 20 euros a year).
We use external apis that are easily hosteable on a VERY EXPENSIVE raspberry pi. such extreme compute power required.
its a different architecture. and I will say what I always say: knowing how one works makes harder for your brain understanding the other one.
I say this as someone who has wrote implementations of both
@gabboman @alexia @mttaggart @HolosSocial @stag nononono this time it's different lol
-
@gabboman @alexia @mttaggart @HolosSocial @stag nononono this time it's different lol
@nelson@wetdry.world @alexia@app.wafrn.net @mttaggart@infosec.exchange @HolosSocial@mastodon.social @stag@mk.absturztau.be
sorry ive seen it too many times and fedi is very negative about it. i posted without reading too much, im busy making wafrn worse
-
@nelson@wetdry.world @alexia@app.wafrn.net @mttaggart@infosec.exchange @HolosSocial@mastodon.social @stag@mk.absturztau.be
sorry ive seen it too many times and fedi is very negative about it. i posted without reading too much, im busy making wafrn worse
@gabboman @alexia @mttaggart @HolosSocial @stag that's the spirit!
-
I'm coming to the conclusion that community-owned and operated small clouds (co-ops) with easy onramps for self-hosting open source services like mail, storage, and VPN are the only way forward. Every corpo service is eventually going to make you ashamed to use it.
@mttaggart yes!
-
I'm coming to the conclusion that community-owned and operated small clouds (co-ops) with easy onramps for self-hosting open source services like mail, storage, and VPN are the only way forward. Every corpo service is eventually going to make you ashamed to use it.
@mttaggart I recently came to the same conclusion. I love self-hosting but it's not for everyone.
A friend and I put together this site to gauge interest. Would love any feedback you have.
-
@mttaggart I recently came to the same conclusion. I love self-hosting but it's not for everyone.
A friend and I put together this site to gauge interest. Would love any feedback you have.
@mttaggart This whole thread is amazing, btw.
-
I'm coming to the conclusion that community-owned and operated small clouds (co-ops) with easy onramps for self-hosting open source services like mail, storage, and VPN are the only way forward. Every corpo service is eventually going to make you ashamed to use it.
@mttaggart I hate to admit it but this is how I've been the whole time. I had a friend whose father was one of the biggest cattle ranchers. Hundreds of thousands of numbered heads, as far as the eye could see in massive dirt lots with industrial feed and killing machines. But when they wanted to eat beef, they went to their little grassy backyard and brought the slowly raised, hand-fed cow with a name like "Bessie" over to their good friend the butcher. "We will eat Bessie, never from the lots".
True story.
And as much as I worked for the biggest operations (and still do, consulting) I always ran my own servers. Web log has been my own Linux machine since 1995, always self-hosted. Mail server too. But I understand why some people can't imagine getting their hands involved, thinking deep like how to care for and yet say goodbye to Bessie instead of just ripping open a package of prepared meals.
-
@mttaggart This whole thread is amazing, btw.
@stanley Thanks for this! I'll give it a read ASAP.
-
I'm coming to the conclusion that community-owned and operated small clouds (co-ops) with easy onramps for self-hosting open source services like mail, storage, and VPN are the only way forward. Every corpo service is eventually going to make you ashamed to use it.
@mttaggart and if they don't, they'll enshitify until you can't stand them anymore. I've come to that conclusion and yours over the last couple years.
-
> "support network and a set of tools to help individuals and community organisations self host"
we have yet to articulate this with @coopcloud but i do believe we are going in this direction
the solidarity network is crucial to emphasise which goes beyond hollow top-down claims of "reuse" and "community"
unity upon strategic tool use has major benefits which stands in stark contract to the dominant reinvent the wheel tech hype cycles...
@d1 @philcowans @mttaggart @vfrmedia @coopcloud that's good to hear, and we definitely hope it goes well
-
@mttaggart I am also one of those running servers for friends (mail, web, Nextcloud, Jitsi Meet, SearXNG etc) and I think about moving this to a private community, so I am not the only one taking care of the infrastructure.
@askaaron @mttaggart This is the way. Find several people already running small personal clouds and club them together so they each can be responsible for a smaller number of services. If you do that, maybe you get reliable machines and enough capacity that you can serve more people.
-
@mttaggart A throwback to the 1990's/early 00's when you'd share a box running FreeBSD or Solaris colo-ed where we knew somebody and kick in what amounted to beer money.
@rlonstein @mttaggart Yep. Old-school hosting.
Kinda like tildes these days, when you think about it.
-
@jumpingjackrussell Don't try to solve every problem at once.
@mttaggart @jumpingjackrussell Agreed. That's a "this porblem is way too big to solve" idea killer.
Think BBS. Then think BBS net.
-
@mttaggart I think it would have to follow the pirate radio model: anchor a ship in international waters, tap into subsea cables, 'adopt' some IP addresses, provide a top-level DNS server, ...
@khleedril @mttaggart Data havens.
-
@mttaggart I think email especially, without that level of resiliency, is basically malpractice
@delta_vee @mttaggart That's an idea killer. You have to start small.
Think back to how everything started off in the 1980's.
-
@mttaggart @jumpingjackrussell Agreed. That's a "this porblem is way too big to solve" idea killer.
Think BBS. Then think BBS net.
Sounds like life these days… requires apocoloptimism.
-
@delta_vee @mttaggart That's an idea killer. You have to start small.
Think back to how everything started off in the 1980's.
@drwho @mttaggart We don't live there anymore, and I haven't run email or DNS (or hell even web services) without some form of HA since 2007
