Online Library

Although there is an ongoing need for law enforcement and intelligence agencies to identify and assess the online activities of violent extremists prior to their engagement in violence offline, little is empirically known about their online posting patterns generally or differences in their online patterns compared to non-violent extremists who share similar ideological beliefs particularly. Even less is empirically known about how their online patterns compare to those who post in extremist spaces in general. This study addresses this gap through a content analysis of postings from a unique sample of violent and non-violent right-wing extremists as well as from a sample of postings within a sub-forum of the largest white supremacy web-forum, Stormfront. Here the existence of extremist ideologies, personal grievances, and violent extremist mobilization efforts were quantified within each of the three sample groups. Several notable differences in posting patterns were observed across samples, many of which may inform future risk factor frameworks used by law enforcement and intelligence agencies to identify credible threats online. This study concludes with a discussion of the implications of the analysis, its limitations, and avenues for future research.

While the messaging tactics of extremist organizations have been studied by researchers, little attention has been devoted to understanding how alternative multimodal communications can enable resistance to polarizing content. This article takes as case studies three grassroots youth arts projects that deploy multimodal resources to educate and build resilience: Build Solid Ground, Jamal al-Khatib and Loulu. The projects won awards at the Horizon 2020 Building Resilience to Violent Extremism and Polarisation (BRaVE) Fair, which was hosted by the Berlin-based intercultural organization Cultures Interactive and took place via Zoom in November 2020. In the pandemic context of increased time spent online, polarization, and growing social and structural vulnerability in which young people face uncertain futures, these projects have been selected for their ability to build channels of communication that support pro-social resilience.

Extremist and terrorist groups are known to have used games and gaming successfully in their online recruitment and indoctrination campaigns. What are the possibilities for using online games to generate resilience against extremism? Current research on online counter and alternative narratives generally acknowledges effects in terms of awareness raising, yet is skeptical when it comes to impact, mostly owing to the limited evidence and empirical research in this area. A related problem with the early counter and alternative narrative campaigns, however, has been not only a lack of initial preparatory work on understanding the radicalization process itself — specifically, on how narratives are produced and disseminated — but also on aspects relating to the audience, the messenger, and the communications strategy more broadly. In designing DECOUNT, an online game that incorporates both counter and alternative narratives, we have taken these aspects into consideration and created an accessible, easy-to-use product by first researching the following: individual radicalization processes; extremist online propaganda narratives and imagery; and the preferences and issues of the target population. We then created and tested the game and placed it on particular social media platforms (Instagram, YouTube/Let’s Play), with appropriate targeting. Finally, we carried out a number of evaluation procedures, including a qualitative assessment and two quasi-experiments. This paper outlines this preparatory, creative, and evaluative work, and contextualizes it within the literature on the role played by online platforms and content both in individual radicalization processes and in creating resilience.

This article constitutes a first step in understanding how Internet memes are used in extreme-right online milieus and formulating appropriate policy responses. First it looks at existing literature on memes as communication units. Secondly, it looks at the particular ways in which transnational extreme-right groups use Internet memes. Thirdly, it discusses the applicability of these memes to resilience-building projects targeting the extreme right. The article’s conclusions discourage the use of Internet memes by state and security actors, while highlighting positive uses by grassroots organisations. Some notes on further necessary research conclude the piece.

Polarization is implicated in the erosion of democracy and the progression to violence, which makes the polarization properties of large algorithmic content selection systems (recommender systems) a matter of concern for peace and security. While algorithm-driven social media do not seem to be a primary driver of polarization at the country level, they could be a useful intervention point in polarized societies. This paper examines algorithmic depolarization interventions aimed at transforming conflict: not suppressing or eliminating conflict, but making it more constructive. Algorithmic intervention is considered at three stages: what content is available (moderation), how content is selected and personalized (ranking), and content presentation and controls (user interface). Empirical studies of online conflict suggest that not only could the exposure-diversity intervention proposed as an antidote to ‘filter bubbles’ be improved: under some conditions, it can even worsen polarization. Using civility metrics in conjunction with diversity in content selection may be more effective. However, diversity-based interventions have not been tested at scale, and may not work in the diverse and dynamic contexts of real platforms. Instead, intervening in platform polarization dynamics will likely require continuous monitoring of polarization metrics, such as the widely used ‘feeling thermometer’. These metrics can be used to evaluate product features, and can potentially be engineered as algorithmic objectives. While using any metric as an optimization target may have harmful consequences, to prevent optimization processes from creating conflict as a side effect it may prove necessary to include polarization measures in the objective function of recommender algorithms.

This research employs the concept of social capital to compare the efforts that a range of tech companies have claimed to take to counter polarization and extremism and build resilience on their platforms. The dataset on which our analysis is based is made-up of a purposive sample of official blog posts from three ‘older’ (i.e., Facebook, Twitter, YouTube) and three ‘newer’ (i.e., TikTok, Discord, and Telegram) technology platforms. The selected posts focused on companies’ efforts to make their platform safer, build community resilience, counter violent extremism and/or polarization, or mentioned related topics such as countering hate organizations, radicalization, or misinformation. Revealed were seven themes incorporating, to a greater or lesser extent, the three main types of social capital (i.e., bonding, bridging and linking). These themes were granting user powers, strengthening existing communities, provision of information and education, building community, enhancing user rights, keeping users safe, and building trust and relationships with users. Analysis of these showed that while creation of all three types of social capital was apparent, similar to previous studies, bridging capital dominated here too; while there were some discrepancies between social capital generating activities and their framings on ‘older’ versus ‘newer’ platforms, other factors, including platform size and company values are likely to be equally or more important; and, finally, that companies attempts at generating online social capital can have negative as well as positive impacts with regard to countering polarization and extremism.