Online Library

This report aims to provide an in-depth analysis on the state of extremism and hate on TikTok. It is the culmination of three months of research on a sample of 1,030 videos, equivalent to just over eight hours of content, posted on the social media platform. These videos were used to promote hatred, as well as glorify extremism and terrorism.

ISD set out to examine the state of hate and extremism on TikTok in two ways. The first objective involved analysing how individuals or groups promote hateful ideologies and target people on the platform based on numerous protected attributes such as ethnicity, religion, gender or others. Second, using the same framework, ISD investigated how features on TikTok like profiles, hashtags, share functions, video effects and music are used to spread hate.

This report seeks to start a conversation around how platforms like TikTok can improve their own practices to protect users from harm. Additionally, it underscores the clear need for independent oversight of such platforms, which currently leave users and the wider public open to significant risks to their health, security and rights.

This article presents a mixed methods approach for analysing text and image relations in violent extremist discourse. The approach involves integrating multimodal discourse analysis with data mining and information visualisation, resulting in theoretically informed empirical techniques for automated analysis of text and image relations in large datasets. The approach is illustrated by a study which aims to analyse how violent extremist groups use language and images to legitimise their views, incite violence, and influence recruits in online propaganda materials, and how the images from these materials are re-used in different media platforms in ways that support and resist violent extremism. The approach developed in this article contributes to what promises to be one of the key areas of research in the coming decades: namely the interdisciplinary study of big (digital) datasets of human discourse, and the implications of this for terrorism analysis and research.

Incels – a term that stands for “involuntary celibates”—is a subculture of men connected by their inability to obtain romantic and sexual relationships. As a group known for real-world violent attacks, understanding the drivers of online membership offers valuable insight into these vulnerable men. The current study used inductive qualitative analysis of over 8,000 posts made by 703 unique posters in two online incel communities to explore common themes within the process of incel membership online. Qualitative analyses uncovered two higher-order concepts: perceptions of injustice and searching for esteem. Within these concepts several underlying themes emerged: victimization, perceived barriers to manhood, psychological responses, and black pill as liberation. The results posit that one avenue to incel membership comes from heightened perceptions of injustice among these users. In addition, the incel forum offers a strategy to increase self-esteem through online membership, which may be a vital draw for disenfranchised young people. Unfortunately, it seems that online incel membership, while a source of self-esteem, shapes incel perceptions, leading members to re-interpret instances in their lives through the lens of extremist ideology.

As the global political barometer increasingly shifts towards insularity, protectionism and propaganda-driven populism across countries, the CVE community is faced with a varied set of challenges. Whether it is on the question of dealing with returning ISIS FTFs, and preventing their move to different geographical theatres; or combatting majoritarian groups that rally around grievances, race or religion and fuel extreme violence—we need to ask ourselves how much more vulnerable we are today, and identify where the fault lines lie. While addressing these challenges, it is equally necessary to ensure that the protection of human rights and fundamental freedoms are balanced as governments address security priorities. It is with the desire to see more global conversation on the manifold ideologies that drive violence and the responsibility of governments, platforms and civil society engaged in CVE initiatives that the Observer Research Foundation (ORF) organised the second iteration of Tackling Insurgent Ideologies, with the theme “Implementing the Christchurch Call: Towards a Global CVE Agenda.” We brought together a diverse group of policymakers, researchers and practitioners involved in the process of developing strategies that deal with the proliferation of radicalism and violence to debate and discuss best practices, learnings and a way forward.

The OCCI Insight Reports equip NGO partners on an ongoing basis with the knowledge
needed to develop effective, targeted campaigns. Without access to in-depth, data-driven
insights into the fast-evolving landscape of extremist and terrorist propaganda, narratives
and networks, it is impossible to mount a proportional targeted response. Additionally, the
reports highlight recommendations for future counterspeech campaigning to address the
identified narratives. OCCI will work closely with any organisation who is interested in
piloting and implementing these recommendations.

This review presents the existing research on the role of the Internet in radicalization processes. Using a systematic literature search strategy, our paper yields 88 studies on the role of the Internet in a) right-wing extremism and b) radical jihadism. Available studies display a predominant interest in the characteristics of radical websites and a remarkable absence of a user-centred perspective. They show that extremist groups make use of the Internet to spread right wing or jihadist ideologies, connect like-minded others in echo chambers and cloaked websites, and address particularly marginalized individuals of a society, with specific strategies for recruitment. Existing studies have thus far not sufficiently examined the users of available sites, nor have they studied the causal mechanisms that unfold at the intersection between the Internet and its users. The present review suggests avenues for future research, drawing on media and violence research and research on social identity and deindividuation effects in computer-mediated communication.