Online Library

This study explores the synergies between two complementary interventions for countering online extremism: deplatforming, a “hard” intervention that involves removing extremist users from online platforms, and inoculation, a “soft” intervention that exposes users to weakened forms of extremist arguments to build resistance. We developed an agent-based model to simulate the diffusion and control of online extremism, using data from systematic reviews and empirical studies. The model focuses on a population of Bayesian agents within an anti-immigration Facebook group, where these agents form beliefs about far-right content spread by extremists. We introduce both deplatforming and inoculation as interventions in the model to control the spread of extremism and find strong evidence that inoculation has a synergistic effect on deplatforming. This synergy stems from inoculation’s ability to stabilise opinion dynamics at the group level, leading to more effective containment of extremist beliefs. The findings suggest that a combined approach involving both deplatforming and inoculation is more effective than implementing either intervention in isolation. We deploy a cost–benefit analysis to show that the existence of synergies at a structural level enables the identification of efficient resource allocation. Our article demonstrates the potential of applying agent-based modelling to the study of counter-extremism policies.

Over the last four years as the Syrian uprising has grown into a full-blown civil war, a sinister parallel conflict has been fought out in cyberspace, with combatants wielding bytes and software rather than guns as they have battled for supremacy on Syria’s internet frontline.

But the consequences of this secret cyber war have been real and deadly – particularly for opponents of the Assad regime who have been targeted for arrest and torture as a consequence of personal information gleaned from their email traffic.

In some cases even the military plans of crucial rebel offensives had been hacked. But the opposition has been busy too, leaking President Bashar al-Assad’s embarrassing personal correspondence and eavesdropping on government troop deployments amid much else.

As a consequence Syria’s civil war has become fertile ground for ‘hacktivists’ from both sides – egged on and in some cases assisted by governments and agencies from outside the region.

In this special investigation for People & Power , Juliana Ruhfus has been finding out why some experts believe Syria’s electronic armies have been drawing up the blueprints for all wars of the future, conflicts that transcend traditional physical boundaries but which can be just as significant as those fought with tanks and missiles.

The article describes a systematic approach used by the Swiss Intelligence Service (SAP). The procedure described is illustrated by the authentic case of messages among extremists going on the Website www.islamic-minbar.com, a case that was prosecuted and brought to verdict by the Attorney General of the Swiss Confederation.

The purpose of this study is to synthesize the literature relating to radicalization on social media, a space with enhanced concerns about nurturing propaganda and conspiracies for violent extremism. Through the systematic review of 82 peer-reviewed studies related to radicalization through social media published in scholarly journals, this paper evidence the growth of robust studies on the usage of social media for radicalization. Nonetheless, the current work hardly discusses the radicalization issues through social media and reveals an increasing trend of publication from 2017 with a major contribution from the USA, Germany, and England. The thematic analysis indicated determinants of radicalization and the mitigation measures for the deradicalization of content on social media. However, the knowledge gap persists to understand the effects of radicalization in the different regional settings and further framing of content specific to target populations. Individuals must have the critical social media literacy to counteract the rising radicalization through social media. Individual users’ political interests are key factors in their radicalization such as citizens losing faith in the government and political parties. Active rather than passive searchers of violent radical material are more likely to engage in political violence. The results indicate that further research using experimental design, grounded theory, and pilot interventions may be relevant to suggest a solution to mitigate radicalization on social media.

The Digital Services Act (DSA) requires designated Very Large Online Platforms and Very Large Online Search Engines (VLOPs and VLOSEs) conduct assessments of the systemic risk of the dissemination of illegal content through their services- and to mitigate such risk where it arises. With regulators, researchers, civil society, and the general public finally due to see the public versions of the first systemic risk assessments conducted by VLOP and VLOSE providers, robust evaluation of the DSA’s systemic risk management approach to the dissemination of illegal content is crucial.  

CERRE’s Benchmarks for Evaluating Management of Risk of Terrorist Content Dissemination issue paper contributes to this evaluation by examining the systemic risk management approach to the dissemination terrorist content. Terrorist content is a specific subset of illegal content under the DSA that is also the subject of a complex nexus of other EU legislation, including the TERREG and several transnational initiatives. The determination of terrorist content poses a significant challenge, as authorities and platforms grapple with the use of sophisticated evasive techniques by terrorist actors, including the use of coded content or “beacons”, while also seeking to respect the fundamental rights of platform users.  

In this issue paper, author  Sally Broughton Micova explores the key definitional issues surrounding terrorist content and maps the ecosystem of actors involved in its risk assessment, mitigation, enforcement, and dissemination. Based on detailed analysis, the paper develops a series of benchmarks and concomitant metrics for the systemic risk evaluation of terrorist content. 

Jonathan Russell, Head of Policy at Quilliam, talks to Sky News #digitalview about how everyone, not just governments, can help challenge extremist propaganda.

#digitalview, Sky News (23/01/16)

Quilliam is the world’s first counter-extremism think tank set up to address the unique challenges of citizenship, identity, and belonging in a globalised world. Quilliam stands for religious freedom, equality, human rights and democracy.