Online Library

VOX-Pol Blog post.

This article reports on the International Center for Study of Violent Extremism (ICSVE’s) most recent Facebook ad
campaign aimed at raising awareness about the realities of living under ISIS and protecting vulnerable potential
recruits from considering joining. During the course of 24 days in December of 2017, ICSVE researchers mounted
the campaign on Facebook using a counter-narrative video produced by ICSVE. The Facebook ad campaign
targeted Iraq, where Facebook is the most widely used social media platform, with ISIS also driving powerful
recruiting campaigns on Facebook and enticing youth into joining. The results were promising in terms of driving
engagement with our counternarrative video materials, leading close to 1.7 million views and hundreds of specific
comments related to both our video content and ISIS in general. In terms of policy implications, in addition to
raising awareness about the dangers of joining ISIS and our Breaking the ISIS Brand Counter Narrative Project, the
campaign served as an important platform to challenge extremist narratives as well as channel doubt, frustration,
and anger into positive exchange of ideas and participation.

The purpose of the study was to contribute to the overall understanding of terrorist organizations’ use of the Internet and to increase researchers’ knowledge of Web site effectiveness. The methodological approach was the evaluation of the perceived credibility of Web sites based on existing criteria derived from information users. The Web sites of four terrorist organizations were assessed: two secular nationalist groups, the People’s Front for the Liberation of Palestine (PFLP) and Liberation Tigers of Tamil Elam (LTTE or Tamil Tigers); and two religious nationalist groups, Hamas and Hezbollah. The findings of this analysis showed differences in perceived credibility factors among terrorist organizations’ Web sites and positive levels of perceived credibility for the Web sites. These findings indicate the potential for positive impressions of the organizations’ Web sites by information users, which would help empower the organizations with the capacity to reach their objectives. By using Web sites, these groups can effectively increase their support base through disseminating information, improving recruiting, and attracting monetary contributions, and can establish themselves as legitimate components of society.

Radical right influencers routinely use social media to spread highly divisive, disruptive and anti-democratic messages. Assessing and countering the challenge that such content poses is crucial for ensuring that online spaces remain open, safe and accessible. Previous work has paid little attention to understanding factors associated with radical right content that goes viral. We investigate this issue with a new dataset (ROT) which provides insight into the content, engagement and followership of a set of 35 radical right influencers. It includes over 50,000 original entries and over 40 million retweets, quotes, replies and mentions. We use a multilevel model to measure engagement with tweets, which are nested in each influencer. We show that it is crucial to account for the influencer-level structure, and find evidence of the importance of both influencer- and content-level factors, including the number of followers each influencer has, the type of content (original posts, quotes and replies), the length and toxicity of content, and whether influencers request retweets. We make ROT available for other researchers to use.

Radical right actors routinely use social media to spread highly divisive, disruptive, and anti-democratic messages. Assessing and countering such content is crucial for ensuring that online spaces can be open, accessible, and constructive. However, previous work has paid little attention to understanding factors associated with radical right content that goes viral. We investigate this issue with a new dataset (the ‘ROT’ dataset) which provides insight into the content, engagement, and followership of a set of 35 radical right actors who are active in the UK. ROT contains over 50,000 original entries and over 40 million retweets, quotes, replies and mentions, as well as detailed information about followership. We use a multilevel model to assess engagement with tweets and show the importance of both actor- and content-level factors, including the number of followers each actor has, the toxicity of their content, the presence of media and explicit requests for retweets. We argue that it is crucial to account for role of actors in radical right viral tweets, and therefore, moderation efforts should be taken not only on a post-to-post level but also on an account level.

Deplatforming websites—removing infrastructure services they need to operate, such as website hosting—can reduce the spread and reach of extremism and hate online, but when does deplatforming succeed? This report shows that deplatforming can decrease the popularity of extremist websites, especially when done without warning. We present four case studies of English-language, U.S.-based extremist websites that were deplatformed: the Daily Stormer, 8chan/8kun, TheDonald.win/Patriots.win, and Nicholas Fuentes/America First. In all of these cases, the infrastructure service providers considered deplatforming only after highly publicized or violent events, indicating that at the infrastructure level, the bar to deplatforming is high. All of the site administrators in these four cases also elected to take measures to remain online after they were deplatformed. To understand how deplatforming affected these sites, we collected and analyzed publicly available data that measures website-popularity rankings over time.

We learned four important lessons about how deplatforming affects extremist websites:

• It can cause popularity rankings to decrease immediately.
• It may take users a long time to return to the website. Sometimes, the website never regains its previous popularity.
• Unexpected deplatforming makes it take longer for the website to regain its previous popularity levels.
• Replicating deplatformed services such as discussion forums or live-streaming video products on a stand-alone website presents significant challenges, including higher costs and smaller audiences.

Our findings show that fighting extremism online requires not only better content moderation and more transparency from social media companies but also cooperation from infrastructure providers like Cloudflare, GoDaddy, and Google, which have avoided attention and critique.