Online Library

When toxic online communities on mainstream platforms face moderation measures, such as bans, they may migrate to other platforms with laxer policies or set up their own dedicated website. Previous work suggests that, within mainstream platforms, community-level moderation is effective in mitigating the harm caused by the moderated communities. It is, however, unclear whether these results also hold when considering the broader Web ecosystem. Do toxic communities continue to grow in terms of user base and activity on their new platforms? Do their members become more toxic and ideologically radicalized? In this paper, we report the results of a large-scale observational study of how problematic online communities progress following community-level moderation measures. We analyze data from r/The_Donald} and r/Incels, two communities that were banned from Reddit and subsequently migrated to their own standalone websites. Our results suggest that, in both cases, moderation measures significantly decreased posting activity on the new platform, reducing the number of posts, active users, and newcomers. In spite of that, users in one of the studied communities (r/The_Donald) showed increases in signals associated with toxicity and radicalization, which justifies concerns that the reduction in activity may come at the expense of a more toxic and radical community. Overall, our results paint a nuanced portrait of the consequences of community-level moderation and can inform their design and deployment.

VOX-Pol Blog post.

Although it is understudied relative to other social media platforms, YouTube is arguably the largest and most engaging online media consumption platform in the world. Recently, YouTube’s outsize influence has sparked concerns that its recommendation algorithm systematically directs users to radical right-wing content. Here we investigate these concerns with large scale longitudinal data of individuals’ browsing behavior spanning January 2016 through December 2019. Consistent with previous work, we find that political news content accounts for a relatively small fraction (11%) of consumption on YouTube, and is dominated by mainstream and largely centrist sources. However, we also find evidence for a small but growing “echo chamber” of far-right content consumption. Users in this community show higher engagement and greater “stickiness” than users who consume any other category of content. Moreover, YouTube accounts for an increasing fraction of these users’ overall online news consumption. Finally, while the size, intensity, and growth of this echo chamber present real concerns, we find no evidence that they are caused by YouTube recommendations. Rather, consumption of radical content on YouTube appears to reflect broader patterns of news consumption across the web. Our results emphasize the importance of measuring consumption directly rather than inferring it from recommendations.

We announced this inquiry into hate crime and its violent consequences in early July 2016. Our decision to undertake the inquiry followed the murder of Jo Cox MP in June in the lead-up to the EU referendum. There was also evidence of an increase in the number of attacks on people from ethnic minorities and of non-British nationality, including on their community centres and places of worship, immediately following the referendum. In addition, our inquiry into antisemitism was already under way, which was raising serious questions about how to address wider issues around the actions of those holding extremist or fixated views. It therefore seemed particularly timely and necessary to launch this
inquiry. We have received a large volume of written evidence. We have taken oral evidence on a wide range of issues including Islamophobia, misogyny, far-right extremism, the role of social media in hate crime and the particular issues faced by Members of Parliament in relation to hate crime and its violent manifestations. Our witnesses have included
academics, community organisations, social media companies, police forces and their representative organisations, the principal Deputy Speaker of the House of Commons, and Ministers. We are grateful to everyone who has contributed to the inquiry.

Recent studies suggest that empathy induced by narrative messages can effectively facilitate persuasion and reduce psychological reactance. Although limited, emerging research on the etiology of radical political behavior has begun to explore the role of narratives in shaping an individual’s beliefs, attitudes, and intentions that culminate in radicalization. The existing studies focus exclusively on the influence of narrative persuasion on an individual, but they overlook the necessity of empathy and that in the absence of empathy, persuasion is not salient. We argue that terrorist organizations are strategic in cultivating empathetic-persuasive messages using audiovisual materials, and disseminating their message within the digital medium. Therefore, in this paper we propose a theoretical model and analytical framework capable of helping us better understand the neurocognitive process of digital radicalization.

Emerging research on the etiology of violent radical political behavior has begun to explore the role of empathy in shaping an individual’s beliefs, attitudes, and intentions that culminate in radicalization. The existing studies focus on persuasive influence upon an individual, but they overlook the centrality of empathy and that in the absence of empathy, persuasion is not salient. If an individual empathizes with a message then when it is processed by the receiver, the message is more likely to be considered realistic, relatable, believable, and therefore, persuasive. However, very little is known as to how messages should be designed to stimulate empathy in order to optimize their persuasive impact, which is particularly relevant to terrorist and extremist messaging given the lethal outcome of successful persuasion. This study examines the neurocognitive process of radicalization, specifically as it occurs within virtual online space, and how message content and production features have the potential to arouse empathy and generate radical-persuasive outcomes among the target audience. The findings of this research demonstrate how emotions, specifically that of empathy, can be stimulated in order to facilitate the process of radicalization, thus increasing the potential for violent radical political behavior.