Reddit’s QAnon ban points to how it’s tracking toxic communities

Illustration by Alex Castro / The Verge

Reddit has finally banned r/greatawakening, the main QAnon subreddit, and then it banned /r/The_GreatAwakening, the backup subreddit where users fled. QAnon, the web of conspiracy theories — which involve Donald Trump, Barack Obama, Hillary Clinton, and politicians and government officials stretching all the way back to Kennedy era — originated on 4chan through Q, an anonymous person purporting to have a high-level security clearance. It then quickly spread to Reddit, Facebook, and eventually offline.

A spokesperson confirmed to The Verge that r/greatawakening was banned for violating Reddit’s policy against “inciting violence, harassment, and the dissemination of personal information,” while r/The_GreatAwakening was taken down for inciting harassment.

The takedowns come on the heels of banning of r/MillionDollarExtreme earlier this week, the community belonging to alt-right comedy troupe of the same name led by Sam Hyde, Nick Rochefort, and Charls Carroll. r/MillionDollarExtreme and associated subs /r/BillionShekelSupreme and /r/ChadRight were banned from the site on Monday night, a Reddit spokesperson confirmed to The Verge, citing violations of the company’s most recent content policy update. Per the postings left in the place of the subreddits, MDE and ChadRight were banned for violating the forum’s violent speech guidelines, while BSS was taken offline for ban evasion.

While previous Reddit bans have come about mostly as a result of external pressure, these are the first higher-profile bans directly tied to Reddit’s new, more explicit content policy, which was rolled out in October 2017. After years of inconsistency from the company’s leadership, the site’s handling of this set of bans suggests a more codified strategy being implemented across the board for policing toxic users.

Reddit’s MDE ban follows a similar decision by YouTube in May to ban the group for content violations. Their comedy is what some would describe as edgy: racist, sexist, and homophobic. Adult Swim, which hosted the group’s first show, Million Dollar Extreme Presents: World Peace, reportedly had to strip out swastikas and coded racist messages before the show aired. Likewise, the QAnon community is well-known for its connection to high-profile figures like Roseanne Barr, the former star of her eponymous show who lost her job after she tweeted a racist remark about former Obama adviser Valerie Jarrett in the context of a larger Q-related conspiracy.

Since its founding in 2005 as a home for interesting links, Reddit has long defined itself as a space that values nearly absolute freedom of speech and expression. “We’re a free speech site with very few exceptions (mostly personal info) and having to stomach occasional troll reddit like picsofdeadkids or morally questionable reddits like jailbait are part of the price of free speech on a site like this,” then-general manager Erik Martin said in one of the site’s popular Ask Me Anything threads in 2011.

The /r/Jailbait and /r/PicsOfDeadKids subreddits have since been banned, along with many of their worst compatriots, but each ban has more or less been a one-off response to lengthy campaigns from users, media, and the general public. (Research suggests these bans are actually working to decrease the platform’s share of awful content.) As Reddit has grown more popular, it’s become increasingly obvious that the norms and implied protections the site has offered are inadequate. Despite CEO Steve Huffman’s continued waffling in his resolve to ban Reddit’s worst actors, a change seems to be afoot.

The week after last year’s violent white supremacist rally in Charlottesville, Virginia, and two months before it would implement its current content guidelines, Reddit banned the subreddit /r/Physical_Removal. A reference to former Chilean president Augusto Pinochet’s habit of murdering his enemies by throwing them out of helicopters, the subreddit revolved around the idea that liberals and leftists specifically deserved “to get a helicopter ride.” As The New Yorker’s Andrew Marantz reported in March:

“This is a good thing,” the top post on Physical_Removal read. “They are mockeries of life and need to fucking go.” Reddit had a rule prohibiting content that “encourages or incites violence,” and this was a violation of that rule. Huffman said, “We’d had our eye on that community for a while, and it felt good to get rid of them, I have to say. But it still didn’t feel like enough.”

The New Yorker’s reporting implies that Reddit does, in fact, have a list of subreddits it considers borderline — areas of the site likely to violate its new(ish) guidelines that it might need to take action against one day. A list like that is a smart thing to have: certain areas of the internet are simply more violent and offensive than others, and if a site like Reddit is really serious about how it polices violent and offensive content, it makes sense to keep a careful eye on how those areas operate on its own servers.

The fandom around the alt-right comedy troupe Million Dollar Extreme has long been one of those spaces. Two years ago, Adult Swim ordered Million Dollar Extreme Presents: World Peace to series, only to cancel it five months after its premiere, thanks to pressure from Adult Swim talent like Tim Heidecker and Brett Gelman, who referred to the show as “an instrument of hate.”

Hyde claimed to be confused about why the show was canceled. “It’s not the craziest stuff that’s ever been on TV here. And we came under fire — I don’t know why,” he told The Hollywood Reporter shortly after the cancellation. “Probably because we aren’t anti-white.”

The MDE and BSS subreddits reflected Hyde’s attitude, and they frequently employed racial slurs and anti-Semitic memes. (Even though their subreddit is down, you can pretty easily re-create the experience by browsing @new_engine, which is, according to Hyde’s Facebook, MDE’s new Twitter account.) Meanwhile, a number of believers in Q conspiracies have turned up to places referenced in the online community. These new bans reflect Reddit’s more explicit attitudes toward its most virulent subreddits, including an emphasis on “ban evasion” — ensuring that a banned subreddit doesn’t simply reform under a new name.

The way Reddit approaches the problem internally is a bit more engaged, according to a source within the company familiar with the process. After a subreddit is banned for violating Reddit’s content policy, site admins can follow where the banned users go. And if another like-minded subreddit decides to host the fleeing community, admins ban those communities, too. Earlier this week, an official Reddit spokesperson told The Verge that “as of September 10th, r/milliondollarextreme and associate subreddits have been banned for violating our violent content rules,” which suggests that those associate subreddits, r/BillionShekelSupreme and r/ChadRight, were where the newly banned MDE community went next. The same thing appears to have happened to users of r/greatawakening and r/The_GreatAwakening.

It’s an effective strategy for making sure the site’s most toxic users don’t replicate the behaviors that got them banned in other subreddits. It’s also a smart way to figure out which subreddits are hosting similar kinds of content. Think of it in terms of viral replication: viruses spread inside an organism by taking over the host cell’s machinery in order to replicate millions of copies of themselves; afterward, they trigger their host into bursting, and those copies flood the rest of the organism looking for more cells to infect.

In this case, the explosion is a site-wide ban, and Reddit’s admins are simply following the new viruses and stopping them before the next host is infected because they’re attempting to protect the whole organism. Contain a virus, and it doesn’t spread. The bans seem to indicate that Reddit has finally figured out how to enforce a speech policy. All that remains to be seen is whether they’ll continue to enforce it in the long-term.

Entertainment

Spotify is testing personalized song recommendations in official playlists

Gaming

Nintendo lets terminal cancer patient play Super Smash Bros. Ultimate early

Entertainment

For more kid-friendly horror like The House with a Clock in Its Walls, stream The Gate

View all stories in Culture
Recommended by Outbrain

Comments

I was probably canceled because I’m not anti-white

More likely, that you think that is exactly why. Also, wow, that #new_engine feed…

Sad to see r/greatawakening gone. I’ve never seen such a wild mix of religious fervor (many people on there were devout Rapture-ready Christians who would complain when posted memes had bad words), blind faith (there was a post this week that said Trump’s slurring of "anonymous" twice at his Montana rally was really a clue to Qultists), and anti-government hysteria (yesterday’s 9/11 posts were unbelievable—lots of decade-old debunked theories being postulated as if brand new). It was great fodder for laughs and would have been fun to study in years to come.

It was a true human circus. I never knew if it was roleplay or genuine fervent belief… Given that people are showing up to rallies etc in Q shirts, it was probably a mixture of the former enabling the latter…

I read an article a while back about how flat earthers were originally a tongue-in-cheek goof by trolls (the Ken M kind not the toxic kind). It became famous for how incredibly stupid it was. Some people watched "ironic" youtube videos but never got the joke and eventually it actually turned into a real movement. Of people, in the modern era, who have probably been on airplanes, who believe the earth is actually flat, as in disc shaped.

Isn’t that how the_donald started? If I’m remembering correctly, it was originally a joke sub made to mock how trump supports are dumb sheep. Didn’t long for crazy people to miss the joke and turn it into a full-on worship cult.

Yup, pretty much. But I still think a lot of them are just hard role-playing in the same way that people do on other forums…

Surely…

Nice job, Reddit. Shame it took so long, but at least they are finally taking some action.

Too late, the damage is done.

Maybe for me is obvious, but Q is an Italian novel written by Wu Ming Foundation, a collective of writers. They used to be also called Luther Blisset Project, another collective that used do do TV, media and internet pranks in the ‘90s. This whole thing is clearly a prank and a citation to them. They’ve also been interviewed about it https://www.heise.de/tp/features/Conspiracy-theorists-are-in-the-same-league-as-psychics-magicians-astrologists-and-gurus-4144259.html

Sam Hyde from Million Dollar Extreme is the biggest tool. If you look at any youtube interview or video with Tim Heidecker there are all of these antisemitic furious comments from MDE fans. Tim Heidecker has stated that he was not involved in the MDE world peace cancellation. He is not involved in programming at adult swim. The show was probably canceled because Sam Hyde did a sketch in black face where he acted really really angry and stupid (essentially black face) and then MDE promoted that sketch with the picture of Sam Hyde in black face with the caption "celebrate diversity!" Was cartoon network really going to allow a anti-minority, anti-gay show on their network headed by a guy who donates money to The Daily Stormer?

Common carrier laws need to be applied to these forums. The answer to people attempting to abuse free speech has always been to answer those lies and misrepresentations with truth. Instead, we cheer as we give control over the civil discourse to a handful of powerful and unanswerable media owners who collectively hold a nearly complete monopoly on the movement and spread of information in our society.

You asked for this. You’ve got it.

Yay!

I always find it strange how these progressive, highly evolved, socially well-adjusted liberals politely clap when the media tells them that "bad people" have been silenced. They always pat each other on the back and shake their heads at the oh-so pathetic lunatics who seem to be so gosh darn obsessed with freedom. Meanwhile liberals are presenting zero ideas for how to stem the absolute chaos taking over the world, instead only pushing their agenda further and further and further, telling us to ignore the inevitable violence that comes from having weak borders and mixing cultures that are deeply, deeply incompatible with one another. "Just hang in there, Comrade… we’re building a utopia!"

View All Comments
Back to top ↑