Online Library

This guide is intended to help creators producing or thinking about making shortform video content seeking to counter extremism. Our goal is not to tell you what to create; your original content is what makes your channel creative and organic. Instead, we hope to provide you with tools and tips to create stronger content that harnesses evidence from decades of academic research. Creating short-form video content (with expected video length to be 15-60 seconds) that counters extremism (both violent and nonviolent) and promotes positive values is a powerful way to engage with your audience. To help you succeed in this mission, we have compiled a guide that not only inspires creativity but also provides practical tips for further success.

This report compares two large random samples of Twitter accounts that tweet in English: one taken just before Elon Musk acquired Twitter in October 2022, and one taken three months later, in January 2023. It also examines several related datasets collected during the period following the acquisition, a period in which, the study found, new accounts were created at a record-breaking pace. Some extremist and conspiracy networks created accounts faster than the baseline rate, probably because changes to Twitter’s trust and safety policies had been announced. In the context of these policy announcements, the study examines some reinstated accounts, with mixed results. Despite the loosening of several content policies, accounts that automated the sending of tweets (‘bots’) saw activity drop sharply during the period of the study, with many bot accounts being suspended or deactivated, while others voluntarily curtailed their activity in light of the API changes announced. Deactivated accounts were dominated by sex- related content and apparent financial spam or scams, often coupled with automated tweeting.

In response to the rise of various fringe movements in recent years, from anti-vaxxers to QAnon, there has been increased public and scholarly attention to misinformation and conspiracy theories and the online communities that produce them. However, efforts at understanding the radicalisation process largely focus on those who go on to commit violent crimes. This article draws on three waves of research exploring the experiences of individuals currently or formerly involved in fringe communities, including the different stages of investment they progressed through, and ultimately, what made people leave. We propose a pathway model for understanding contemporary online radicalisation, including potential interventions that could be safely made at each stage. Insight into the experience of being immersed in these communities is essential for engaging with these people empathetically, and therefore preventing both the emergence of violent terrorists and protecting vulnerable people from being drawn into these communities.

Over the past decade, two major phenomena have developed in the digital realm. On the one hand, extremism has grown massively on the Internet, with sprawling online ecosystems hosting a wide range of radical subcultures and communities associated with both ‘stochastic terrorism’ and the ‘mainstreaming of extremism’. On the other hand, Artificial Intelligence (AI) has undergone exponential improvement: from ChatGPT to video deepfakes, from autonomous vehicles to face-recognition CCTV systems, an array of AI technologies has abruptly entered our everyday lives. This report examines ‘AI extremism’, the toxic encounter of these two evolutions – each worrying in its own right. Like past technological progress, AI will indeed be – in fact already is – used in various ways to bolster extremist agendas. Identifying the many opportunities for action that come with a range of AI models, and linking them with different types of extremist actors, we offer a clear overview of the numerous facets of AI extremism. Building on the nascent academic and government literature on the issue as well as on our own empirical and theoretical work, we provide new typologies and concepts to help us organize our understanding of AI extremism, systematically chart its instantiations, and highlight thinking points for stakeholders in countering violent extremism.

VOX-Pol Blog post.

Many cases of radicalism, especially violent radicalism, manifest within the context of inter-ethnic conflict and war. Research in this domain has significantly contributed to our overarching comprehension of the issue. This form of radicalism is inherently linked to the dynamics of group affiliation. However, our focus here is directed towards the individual motivation driving radical actions. While radical actions may encompass dynamics of group affiliation (e.g., the most radical pro-life activists being members of the Army of God), they also possess a substantial individual component. For instance, numerous attacks on abortion doctors or clinics are categorized as ’lone-wolf terrorism’.

In this study, we sought to examine whether state-of-the-art Machine Learning tech- nology for text analysis could effectively discern the intent behind radical actions from user-generated content. We analyzed a diverse array of radical texts published online by various activists, including anarchists, Iranian guerrilla members, Indian revolution- aries, activists from the US civil rights movement, and The Army of God. Our analysis reveals that Machine Learning models can successfully identify potential signals indica- tive of the author’s intent behind radical actions.