Online Library

Over the past decade, two major phenomena have developed in the digital realm. On the one hand, extremism has grown massively on the Internet, with sprawling online ecosystems hosting a wide range of radical subcultures and communities associated with both ‘stochastic terrorism’ and the ‘mainstreaming of extremism’. On the other hand, Artificial Intelligence (AI) has undergone exponential improvement: from ChatGPT to video deepfakes, from autonomous vehicles to face-recognition CCTV systems, an array of AI technologies has abruptly entered our everyday lives. This report examines ‘AI extremism’, the toxic encounter of these two evolutions – each worrying in its own right. Like past technological progress, AI will indeed be – in fact already is – used in various ways to bolster extremist agendas. Identifying the many opportunities for action that come with a range of AI models, and linking them with different types of extremist actors, we offer a clear overview of the numerous facets of AI extremism. Building on the nascent academic and government literature on the issue as well as on our own empirical and theoretical work, we provide new typologies and concepts to help us organize our understanding of AI extremism, systematically chart its instantiations, and highlight thinking points for stakeholders in countering violent extremism.

VOX-Pol Blog post.

Many cases of radicalism, especially violent radicalism, manifest within the context of inter-ethnic conflict and war. Research in this domain has significantly contributed to our overarching comprehension of the issue. This form of radicalism is inherently linked to the dynamics of group affiliation. However, our focus here is directed towards the individual motivation driving radical actions. While radical actions may encompass dynamics of group affiliation (e.g., the most radical pro-life activists being members of the Army of God), they also possess a substantial individual component. For instance, numerous attacks on abortion doctors or clinics are categorized as ’lone-wolf terrorism’.

In this study, we sought to examine whether state-of-the-art Machine Learning tech- nology for text analysis could effectively discern the intent behind radical actions from user-generated content. We analyzed a diverse array of radical texts published online by various activists, including anarchists, Iranian guerrilla members, Indian revolution- aries, activists from the US civil rights movement, and The Army of God. Our analysis reveals that Machine Learning models can successfully identify potential signals indica- tive of the author’s intent behind radical actions.

The report begins by outlining some of the broad knowledge around the idea of mass persuasion, before focusing specifically on lessons that have been learned in the field of P/CVE. This is followed by a synthesis of existing “How To” guides for the creation of strategic communications from a range of policy and practitioner stakeholders. Then, we discuss specific knowledge of audiovisual content, particularly considerations for short-form video content. The report concludes by outlining how stakeholders, including social media platforms, can monitor, measure, and evaluate the impact of this type of content.

VOX-Pol Blog post.

VOX-Pol Virtual Roundtable: Artificial Intelligence and Extremism, Wednesday 13 December.

(Please note, some slides are blurred due to sensitivities around ongoing research)

This roundtable is organized by the VOX-Pol Network of Excellence on online extremism in the context of the ExID, Extreme Identities, project funded by the EU Horizon2020 NORFACE programme, Democratic Governance in Turbulent Times. Over the past decade, two major phenomena have developed on the digital realm: the extensive growth of extremism on the internet and exponential improvements of Artificial Intelligence (AI) models. This VOX-Pol Roundtable examines the toxic encounter of these two evolutions, from five distinct perspectives offered by its chair and expert panellists, offering cutting-edge insights on issues such as AI-powered detection of radical content or deepfake use by extremist groups.

Chair

Dr Stephane J. BAELE is Professor of International Relations at the Catholic University of Louvain (Belgium) and Honorary Associate Professor of Security and Political Violence at the University of Exeter (UK). The editor of ISIS Propaganda (Oxford University Press), his multidisciplinary work on extremist and violent political actors’ communications has appeared in leading journals such as the Journal of Conflict Resolution or Studies in Conflict & Terrorism. He recently published a CREST Guide on “Artificial Intelligence and Extremism: The Threat of Language Models for Propaganda Purposes” (2022).

Panelists

Dr Lewys BRACE is Senior Lecturer in Computational Social Science at the University of Exeter (UK), where he is the Co-Director of the Q-Step Centre for quantitative social sciences. His work, published in journals like Terrorism & Political Violence or the Journal of Policing, Intelligence & Counter-Terrorism, harnesses data science, Open-Source Intelligence (OSINT), and artificial intelligence methods to analyse extremism, terrorism, cybercrime, and security.

Dr Thomas HEGGHAMMER is Senior Fellow of All Souls College, University of Oxford (UK). A political scientist and historian specializing in militant Islamism and jihadism (e.g., Jihadi Culture, Jihad in Saudi Arabia, or recently Abdullah Azzam’s biography The Caravan) he has recently deployed computational/AI methods for the study of extremist corpora in Arabic (e.g., “daiR: an R package for OCR with Google Document AI” in the Journal of Open Source Software, and “OCR with Tesseract, Amazon Textract, and Google Document AI: a benchmarking experiment” in the Journal Computational Social Sciences).

Dr Miron LAKOMY is Professor at the Institute of Political Sciences of the University of Silesia (Poland) and currently visiting fellow at the ITSTIME research centre in Milan (Italy). He has held visiting positions at, among others, the University of Oxford, the University of Cambridge, the University of Milan, and the European University Institute. His research primarily focuses on various aspects of political violence and terrorism on the Internet, as well as military conflicts. He is, among others, the author of the recent article “Artificial Intelligence as a Terrorism Enabler?” (published in Studies in Conflict & Terrorism).

Ms Marie SCHRÖTER is since August the Country Director of the Friedrich-Ebert-Stiftung (FES) in the Philippines (after working for FES in Tel Aviv). Before that, she focused on the role of AI in counterterrorism as a Mercator Fellow with the United Nations Office of Counter Terrorism in New York, the International Centre for the Study of Radicalization (ICSR) at the Kings College London, and AlgorithmWatch in Berlin. She is the co-founder (in 2020) of Codetekt – a civil society organization against online disinformation. She is, among others, the author of the report “Artificial Intelligence and Countering Violent Extremism: A Primer” (published by GNET in 2020).