Softening online extremes using network engineering
May 16, 2024
The prevalence of dangerous misinformation and extreme views online has intensified since the onset of Israel-Hamas war on 7 October 2023. Social media platforms have long grappled with the challenge of providing effective mitigation schemes that can scale to the 5 billion-strong online population. Here, we introduce a novel solution grounded in online network engineering ...
The Role of Social Networks in Facilitating and Preventing Domestic Radicalization: What Research Sponsored by the National Institute of Justice Tells Us
May 16, 2024
In 2012, the National Institute of Justice’s (NIJ) Domestic Radicalization to Terrorism program began funding research on issues related to domestic radicalization and terrorism in the United States. NIJ-sponsored research has addressed a variety of factors that can play a role in both facilitating and preventing domestic radicalization, including social networks. This report synthesizes findings ...
A semi-supervised algorithm for detecting extremism propaganda diffusion on social media
September 18, 2023
Extremist online networks reportedly tend to use Twitter and other Social Networking Sites (SNS) in order to issue propaganda and recruitment statements. Traditional machine learning models may encounter problems when used in such a context, due to the peculiarities of microblogging sites and the manner in which these networks interact (both between themselves and with ...
Radical Right Activities in Nusantara’s Digital Landscape: A Snapshot
September 18, 2023
This study analysed three social media movements linked with extreme right‑wing activities online. Such activities were carried out by right‑wing extremists and those who support their philosophy of nationalism and religious conservatism, whether actively or passively. This study also investigated how themes and narratives from across the globe, such as US political discourse, Russian disinformation ...
The Online Extremist Ecosystem: Its Evolution and a Framework for Separating Extreme from Mainstream
September 18, 2023
In this Perspective, the authors introduce a framework for internet users to categorize the virtual platforms they use and to understand the likelihood that they may encounter extreme content online. The authors first provide a landscape of the online extremist “ecosystem,” describing how the proliferation of messaging forums, social media networks, and other virtual community ...
“We are Generation Terror!”: Youth‑on‑youth Radicalisation in Extreme‑right Youth Groups
September 18, 2023
Young people – politicised, active and highly connected – are no longer just passive consumers of online terrorist content by adult groomers but are themselves propaganda creators, group organisers, peer recruiters, extremist financers and terrorist convicts. This process, called “youth‑on‑youth radicalisation”, emphasises the agency that young people have in a digital era in which the ...
Chapter 10: On free public communication and terrorism online
September 18, 2023
The basic issue that this chapter examines is how we set morally justifiable limits on what people say online, with a specific focus on speech acts related to terrorism. The chapter takes as one of its foundational assumptions that there are situations in which free speech, while an important and potentially fundamental right, can be ...
Examining the interactive effects of the filter bubble and the echo chamber on radicalization
September 18, 2023
Objectives Despite popular notions of “filter bubbles” and “echo chambers” contributing to radicalization, little evidence exists to support these hypotheses. However, social structure social learning theory would suggest a hereto untested interaction effect. Methodology An RCT of new Twitter users in which participants were randomly assigned to a treatment of “filter bubble” (personalization algorithm) suppression. ...
Hidden order across online extremist movements can be disrupted by nudging collective chemistry
September 18, 2023
Disrupting the emergence and evolution of potentially violent online extremist movements is a crucial challenge. Extremism research has analyzed such movements in detail, focusing on individual- and movement-level characteristics. But are there system-level commonalities in the ways these movements emerge and grow? Here we compare the growth of the Boogaloos, a new and increasingly prominent ...
GAFAM and Hate Content Moderation: Deplatforming and Deleting the Alt-right
September 18, 2023
Purpose – This chapter demonstrates the power that Google, Apple, Facebook, Amazon and Microsoft (or the “GAFAM”) exercise over platforms within society, highlights the alt-right’s use of GAFAM sites and services as a platform for hate, and examines GAFAM’s establishment and use of hate content moderation apparatuses to de-platform alt-right users and delete hate content. ...