Online Library

This new report, a product of the Center for Countering Digital Hate’s new Quant Lab, is a systematic study of over a million posts over the past eighteen months on the world’s leading incels forum. By stripping language down to mathematics, we can eke out trends that provide real insight into incel communities. Our Quant Lab researchers studied an active community with thousands of members, some more active than others, that attracts a wider audience who make millions of visits a month. Analysis of their discourse shows this core group poses a clear and present danger to women, other young men, and reveals an emerging threat to our children.

This study explores the beliefs, narratives and ideologies that lead to violent radicalism underpinned by an abusive interpretation of Islam, with a view to understanding of the causes and remedies for violent radicalisation. The research was conducted through analysis and empirical data collection through 145 stakeholder and primary fieldwork interviews in four Member States; Denmark, France, Germany and the UK. The interview sample was intended to capture the diversity of the Muslim ‘field’ in each country as far as possible

This white paper maps these continually shifting dynamics, drawing on proceedings from meetings of the Academic and Practical Research Working Group of the Global Internet Forum to Counter Terrorism (GIFCT), the work of the Global Network on Extremism and Technology (GNET), and original desk research. In doing so, it identifies key emerging trends and research priorities related to violent extremism, counterterrorism, and the role of the internet in these spaces. The paper is divided into three sections that respectively examine innovations in violent extremism, new developments in extremist outreach and messaging, and new research and priorities as they relate to preventing terrorist use of the internet (PTUI).

The internet can leave users vulnerable to social challenges, which creates opportunities for extremism to spread. Users can be exposed to extremism in multiple ways, including through recruitment and socialisation. Extremist content may be found on mainstream social media sites and ‘alt-tech’ platforms, which replicate the functions of mainstream social media but have been created or co-opted for the unconventional needs of specific users. Automatic detection can be used to moderate extremist content on a large scale. However, this is prone to false positives and may disproportionately impact a particular group, which can fuel mistrust in the state. Many stakeholders believe that current counter-extremism responses are too focused on law and technology, and do not address the underlying reasons that people are drawn to extremist content. Individual and societal interventions aim to identify underlying socio-economic and cultural contributors and implement protective factors to reduce how many people develop extremist views.

The Redirect Method​ uses Adwords targeting tools and curated YouTube videos uploaded by people all around the world to confront online radicalization. It focuses on the slice of ISIS’ audience that is most susceptible to its messaging, and redirects them towards curated YouTube videos debunking ISIS recruiting themes. This open methodology was developed from interviews with ISIS defectors, respects users’ privacy and can be deployed to tackle other types of violent recruiting discourses online.

This report will outline some of the ways social media continues to be exploited 20 years on to promote misinformation, as well as conspiracies that advance bigoted and prejudiced beliefs and ideologies, especially anti-Semitism.