Online Library

VOX-Pol Blog post.

VOX-Pol Blog post.

It is well established that jihadist groups and their supporters post URLs on online platforms to outlink to items of propaganda stored on other platforms. Industry initiatives – such as Global Internet Forum to Counter Terrorism’s inclusion of URLs in its hash-sharing database, and Tech Against Terrorism’s Terrorist Content Analytics Platform – have sought to counter this practice. These measures, together with new regulatory regimes (e.g. the EU’s Terrorist Content Online Regulation) and the growing use of decentralised services, raise the question whether jihadist groups’ propaganda dissemination strategies are perhaps being forced to evolve. This report considers whether there is evidence of such an evolution, by examining the means that three jihadist groups (Islamic State (IS), Al-Qaeda (AQ) and Al-Shabaab) used to disseminate their propaganda during a two-month period in early 2023.

As efforts to identify and remove online terrorist and violent extremist content have intensified, concern has also grown about so‐called lawful but awful content. Various options have been touted for reducing the visibility of this borderline content, including removing it from search and recommendation algorithms, downranking it and redirecting those who search for it. This article contributes to this discussion by considering the moderation of such content, in terms of three sets of values. First, definitional clarity. This is necessary to provide users with fair warning of what content is liable to moderation and to place limits on the discretion of content moderators. Yet, at present, definitions of borderline content are vague and imprecise. Second, necessity and proportionality. While downranking and removal from search and recommender algorithms should be distinguished from deplatforming, tech companies’ efforts to deamplify borderline content give rise to many of the same concerns as content removal and account shutdowns. Third, transparency. While a number of platforms now publish their content moderation policies and transparency data reports, these largely focus on violative, not borderline content. Moreover, there remain questions around access to data for independent researchers and transparency at the level of the individual user.

The whitepaper has three parts. The first part provides some contextual background, describing the diverse range of online services utilised by terrorists and extremists and the process by which propaganda is disseminated online. The second part details industry responses. As well as referrals from users and law enforcement, it describes the use of AI for proactive detection and collaborative, cross-platform initiatives. The third part describes four issues for discussion: transparency; definitional clarity; the impact on those targeted; and, the use of online data for predictive purposes.

VOX-Pol Blog Post.