Online Library

This document sets up the main recommendations identified through the three years of engagement and dialouge on this topic. It is anchored in the discussions from the round tables. It further builds on the experiences from UN field presences that are working to address these challenges at country level. The paper is the result of a cooperation between my Office and the ESRC Human Rights, Big Data and Technology Project at the University of Essex. I would like to especially thank Ahmed Shaheed, Deputy Director, Essex Human Rights, Big Data and Technology Project and former United Nations Special Rapporteur on Freedom of Religion or Belief for this partnership over the last several years and which has resulted in this policy paper.

Measuring extremist behavior and discourse online presents a significant methodological challenge largely due to the volume of content. This paper assesses the extent to which discourse communities created by extremists identified through qualitative analysis in prior research are present in a novel Telegram dataset and can be identified through Latent Dirichlet Allocation topic modeling and network analysis. It then compares the results of Louvian and Girvan-Newman network community detection methods and the topics assigned to each community to see if the underlying structure of association between topics is robust to the use of different community detection methods. The results indicate that it may be possible to map discourse communities through topic modeling and network analysis. However, the comparison of the algorithms is inconclusive. This work contributes to our understanding of how computational social science methods can be used to measure and analyze extremist use of the Internet at scale.

Social media’s role in the spread and evolution of extremism is a focus of intense study. Online extremists have been involved in the spread of online hate, mis/disinformation, and real-world violence. However, the overwhelming majority of existing work has focused on right-wing extremism. In this paper, we perform a first of its kind large-scale, data-driven study exploring left-wing extremism. We focus on “tankies,” a left-wing community that first arose in the 1950s in support of hardline actions of the USSR and has evolved to support what they call “actually existing socialist countries,” e.g., CCP run China, the USSR, former soviet countries, and North Korea. We collect 1.3M posts from 53K authors from tankies subreddits, and explore the position of tankies within the broader far-left community on Reddit. Among other things, we find that tankies are clearly on the periphery of the larger far-left community. When examining the contents of posts, we find misalignments and conceptual homomorphisms that confirm the description of tankies in the theoretical work. We also discover that tankies focus more on state-level political events rather than social issues in comparison to other far-left communities. Finally, we show that tankies exhibit some of the same worrying behaviors as right-wing extremists, e.g., relatively high toxicity and an organized response to deplatforming events.

This systematic review seeks to position online radicalisation within whole system frameworks incorporating individual, family, community and wider structural influences, whilst reporting evidence of public mental health approaches for individuals engaging in radical online content. Methods: Authors searched Medline (via Ovid), PsycInfo (via Ebscohost) and Web of Science (Core Collection), with the use of Boolean operators across ‘extremism’, ‘online content’, and ‘intervention’. Results: Following assessment of full text, all retrieved papers had to be excluded. Results from six excluded articles which did not fit inclusion criteria but identified theoretical relationships between all three elements of online extremism, psychological outcomes, and intervention strategy, were discussed. Authors found no articles outlining public mental health approaches to specifically online radicalisation. Conclusions: There is an immediate need for further research in this field given the increase in different factions of radicalised beliefs resulting from online, particularly social media, usage.

This paper introduces the concept of “imagined extremist communities,” a term that encapsulates the unique social landscape where right-wing lone actors, despite not being affiliated with organised groups, partake in a form of communal interaction. By examining the cases of Anders Behring Breivik, Brenton Harrison Tarrant, and Philip Manshaus, this paper illuminates how group-based and lone actors are more alike than what is conventionally expressed in existing research. Although lone actors are not subject to an external command like group-based actors are, the imagined extremist community functions as a “group” for lone actors and is, for all practical purposes, a corresponding alternative to a terror cell. During the radicalisation process, these individuals seek and turn to the imagined extremist community, enabling them to form a sense of belonging and identification and underscoring that these actors, although conventionally labelled as “lone,” are immersed in an alternative culture that nurtures their ideas and sustains their extremist ideology. This becomes particularly evident through their cognitive radicalisation, a process amplified by their psychological predispositions. The concept of the imagined extremist community elucidates how lone actors, especially those embracing right-wing ideologies, are subject to radical influences. Their conservative traits and psychological dispositions make them particularly receptive to the appeal of such communities.