Online Library

VOX-Pol Blog post.

When toxic online communities on mainstream platforms face moderation measures, such as bans, they may migrate to other platforms with laxer policies or set up their own dedicated website. Previous work suggests that, within mainstream platforms, community-level moderation is effective in mitigating the harm caused by the moderated communities. It is, however, unclear whether these results also hold when considering the broader Web ecosystem. Do toxic communities continue to grow in terms of user base and activity on their new platforms? Do their members become more toxic and ideologically radicalized? In this paper, we report the results of a large-scale observational study of how problematic online communities progress following community-level moderation measures. We analyze data from r/The_Donald} and r/Incels, two communities that were banned from Reddit and subsequently migrated to their own standalone websites. Our results suggest that, in both cases, moderation measures significantly decreased posting activity on the new platform, reducing the number of posts, active users, and newcomers. In spite of that, users in one of the studied communities (r/The_Donald) showed increases in signals associated with toxicity and radicalization, which justifies concerns that the reduction in activity may come at the expense of a more toxic and radical community. Overall, our results paint a nuanced portrait of the consequences of community-level moderation and can inform their design and deployment.

The chapter addresses the question of how crisis and emergency communicators in the justice (police) and health sector in Norway reflect on their use – or lack of use – of social media during the terror crisis on 22 July 2011. We examine how these communicators in the years following the crisis have developed their use of social media to optimise their and the public’s awareness of similar crises. Our semi-structured interviews with key emergency managers and responders display how the terrorist-induced crisis in 2011 was a wake-up call for communicators in the police and the health sector. They reflect on the significance, strengths and weaknesses of social media in the management of crises such as this one. Book edited by Harald Hornmoen and Klas Backholm

Extreme online content from far-right organisations, including the website of a banned terrorist group, is accessible via hardware based in the UK, potentially in breach of the law, and in contrast with Theresa May’s call for technology companies to act to remove terrorist content from their platforms.

• In this report, we show how recent terror attacks in the UK have been successfully exploited by anti-Muslim activists over social media, to increase their reach and grow their audiences.
• Monitoring key anti-Muslim social media accounts and their networks, we show how even small events are amplified through an international network of activists.
• We also provide concrete evidence of a leading anti-Muslim activist whose message is hugely amplified by the use of a 100+ strong ‘bot army’.
• The global reach, low price and lack of regulation on social media platforms presents new possibilities for independent, single issue and extremist viewpoints to gain significant audiences.
• We delve into the murky and secretive world of the dark web to explore just what tools are available for manipulating social media and show how easy it is to make use of these tactics even for non-tech savvy users.
• Through testing, we conclude that even cheaply inflating one’s number of followers has an effect on the ability to reach a larger audience.
• We situate these developments in the context of increasing hostility towards Muslims and immigration in the Europe and the US.
• “Trigger events” such as terror attacks, and other events that reflect badly on Muslims and Islam, cause both an increase in anti-Muslim hate on the street and, as we will show, also online.

Though aiming to remedy genuine harms, government regulation of our online lives also raises legitimate concerns over privacy and freedom of expression. We must address online harms whilst ensuring harms are not also inflicted through unfairly infringing on people’s freedoms. HOPE not hate recognises the importance of this balancing act, and encourages a form of regulation of platforms that places democratic rights front-and-centre. In a world increasingly infused with the web, the significance of this legislation cannot be overstated and it is undoubtedly the case that getting it right will take rigorous reflection. To that end, we encourage debate of the recommendations proposed in this report.