POV: you’re standing at the bottom of a slide at a playground in Boston

So the standard approach to this is so-called “perceptual hashing.” Effectively, using cryptographic hashes (sha256, etc.) doesn’t really work well in this case. Given a piece of illegal content, that content is likely to still be just as illegal with a single pixel changed – however, it’ll have a completely different cryptographic hash. So instead, a hash function that determines how “similar-looking” two images are, ignoring things like dimensions, color palette, JPEG compression artifacts, etc. This is obviously way fuzzier, and is prone to both false positives and negatives.

Because all this is inherently kinda fuzzy, the exact database of hashes is usually “secret sauce” if you will. If it were public, it would be super easy to circumvent. As an example, given an illegal image:

1. Is the image’s hash in the DB?
2. No? All done, you can post it with impunity.
3. Yes? Change one random pixel, GOTO 1.

As a result even “public” databases are distributed with NDAs etc. This obviously does not jive well with an open source, federated network like Mastodon, and I have my doubts as to how willing the relevant agencies would be to give their databases to every rando with $5 to spin up a Pleroma instance on a VPS. A public DB might help in some cases, but unfortunately more illegal content is produced every day, and so it would be extremely hard to keep up with the bad actors.

In my opinion the biggest issue the author points out is that cached materials are sometimes retained even after moderator action. Which honestly just sounds like a straight up bug more than anything. Though if I were running an instance, the feds showing up at my door with a warrant because I’ve been accidentally distributing CSAM would be my nightmare scenario. And of course jurisdiction plays a part, too: an American user on a Canadian server might see drawn depictions of sexualized minors, think “weird but not illegal,” and now the Canadian admin has content that’s illegal in Canada on their Canadian server and has no idea.

IMO I think the best solution to this is something similar to what Renaud Chaput (Mastodon’s resident infra boffin) described in his recent blog post. Effectively, give admins a way to hand this off to pluggable third-party services. Admins that are worried about this sort of thing can then have some degree of safety via e.g. PhotoDNA, whereas others can take on additional risk and preserve additional privacy.

All that said: yeah the headline makes it sound like .social is some 8chan-esque hellhole, whereas in reality my feed is 99% German programmers sharing milquetoast political takes.

Oooh as a communist… where to even start. Most of this is US/anglo centric…

1. Actually read fucking theory. Most of it was literally written for 19th century German factory workers with a third grade education who worked 16 hour shifts in the orphan crushing factory. When people say this it isn’t because they want to feel smart, it’s because you’re saying dumb shit that got litigated out in like the '60s and you sound like a moron.
2. This does not include “video essays” on “breadtube.” If I wanted something explained to me badly by a pedophile I’d join NAMBLA.
3. For the love of all that is holy, read something written after the second World War. Vast intellectual strides have been made in the past several decades. We do not need to relitigate the fucking Sino-Soviet split in the year of our Lord 2023. They both kinda fucking sucked. Read Debord. Read Tiqqun for all I care. But if I get handed one more Trotskyist zine I’m gonna fucking lose it.
4. Any modern communist party, especially in the imperial core, is probably dogshit. The IMT are sex abusers, PSL has terrible politics, and I’m not even gonna touch the western Maoists.
5. We are not in an era of resurgence for the Left. Comparing the intellectual and political influence of the Left in e.g. the '70s vs today is straight up depressing. The average SNCC/BPP member could run circles around 90% of Twitter “Leftists” while ripping a fat joint of the worst dirt weed known to man.
6. Anti-intellectualism is an extremely bad look. We should seek to deeply understand as much of the world as possible, not fall back on misunderstanding and anecdotes. That isn’t to say that the modern state of academia isn’t godawful, but forming opinions off screenshots of headlines does not lead to a coherent worldview.
7. For anarchists especially: stop fetishizing mob violence. “Death penalty without trial for alleged rapists!” is not a progressive opinion, and will give free reign to the worst elements in society.
8. Horizontal organization is not a panacea for State repression. While the BLM protests would have been more immune to COINTELPRO than was the BPP, it was dead easy for the government to shut them down through standard curfews and kettling because the whole thing was so goddamn disorganized.
9. While deplatforming is often effective as a tactic, it can easily be turned around on the Left. Big business is only your friend so long as it’s profitable, and will kick you off as soon as an advertiser complains about anti-landlord discrimination or some dumb shit.
10. Opposition to technology is also not a progressive viewpoint. It is important to separate a given technology from who owns it. Computing can be used to democratize production and allocate resources – the fact that it is primarily used to further the aims of the capitalist class is an implementation detail of the present economic system. Personally, I’m gonna keep taking aspirin even though it’s manufactured by Big Pharma.
11. “Shrill panic” is not a good tone, especially when your understanding of the facts is limited. Would Fred Hampton have had a meltdown on main because some junior state senator in Idaho proposed a piece of legislation that was clearly never going to make it to a vote? No? Ok so shut the fuck up then.
12. US pigs are terrible, but that isn’t a unique phenomenon. “Of course the French can protest that good, they don’t have US police!” sir the French police literally love beating protestors to within an inch of their life, you sound like an idiot.
13. It’s not enough to say “thing sucks.” You have to come up with something better. And that’s often fucking hard, but incredibly worthwhile.

I truly do have optimism that we can build a better world. Every once in a while, it shines through the cracks: kids partying in the street while cops look on powerless, a little old lady cheering from the window while marchers chant “fuck 12,” even a single trans person finding a community that accepts them wholeheartedly.

But damn do you internet mfs make it hard sometimes.

My fave Lin Manuel-Miranda song is the one where he advocates on behalf of the US government for the privatization of the Puerto Rican electrical grid claiming it will improve reliability but then it actually becomes even less reliable. It’s really catchy 😊

Yup was just typing a comment to basically this effect. Federation adds a ton of overhead – you can still do things fairly efficiently, but every interaction having to fan out to (and fan in from!) many servers instead of like a single RDBMS is gonna cost you.

In all likelihood the code is not as efficient as it could be, but usually you get time to work those out gradually. A giant influx of users quickly turns “TODO: fix in the next six months” into “Oh god the servers are melting fuck fuck.”

That said, assuming the devs can get over this hump, I suspect using a compiled language will pay off long-term. Sure things will still be primarily IO-bound, but making things less CPU-bound is usually a good thing.

For some illustrative examples: Mastodon is in Ruby and hits dumb scaling limitations far more often than other fedi microblogs. Pleroma/Akkoma are Elixir (and BEAM is super well optimized for fast message passing/scaling/IO), Calckey (primarily Typescript) is moving some code to Rust, GoToSocial (Golang) is able to run in a fraction of the resources of Mastodon. The admins of one of the bigger tech instances recently announced they’re basically giving up on administrating Mastodon and are instead going to write a new server from scratch in a compiled language because it’s easier for them than scaling a Rails monolith.

TL;DR everything is IO-bound til it’s not.