Online Library

At a time when ISIS exploits social media to spread its ideology and gain new recruits, Monika Bickert, the head of global policy management at Facebook, explains how her team removes content that promotes violence and terrorism. Bickert, a former federal prosecutor, describes Facebook’s efforts to use “counter-speech” to fight hateful and extremist ideologies.

For years, social media, including Facebook, have been criticized for lacking transparency in their community standards, especially in terms of extremist content. Yet, moderation is not an easy task, especially when extreme-right actors use content strategies that shift the Overton window (i.e., the range of ideas acceptable in public discourse) rightward. In a self-proclaimed search of more transparency, Facebook created its Transparency Center in May 2021. It also has regularly updated its community standards, and Facebook Oversight Board has reviewed these standards based on concrete cases, published since January 2021. In this paper, we highlight how some longstanding issues regarding Facebook’s lack of transparency still remain unaddressed in Facebook’s 2021 community standards, mainly in terms of the visual ‘representation’ of and endorsement from dangerous organizations and individuals. Furthermore, we also reveal how the Board’s no-access to Facebook’s in-house rules exemplifies how the longstanding discrepancy between the public and the confidential levels of Facebook policies remains a current issue that might turn the Board’s work into a mere PR effort. In seeming to take as many steps toward shielding some information as it has toward exposing others to the sunshine, Facebook’s efforts might turn out to be transparency theater.

The Facebook Redirect Programme (FRP) is designed to combat violent extremism and dangerous organisations by redirecting users who have entered hate or violence-related search queries towards educational resources and outreach groups. A pilot of the programme was launched with delivery partners Life After Hate in May 2019 and Exit Australia in September 2019. It was specifically designed to ensure that individuals searching for white supremacist and/or neo-Nazi communities on Facebook would be offered authentic, meaningful and impactful support off-platform. The purpose of this pilot was to test the programme design and inform future deployments targeting both new geographies and other hate-based communities. Moonshot was contracted by Facebook to evaluate the pilot period of programme performance and make recommendations for future deployments. This report evaluates the pilot programme by examining:
-Facebook’s use of keywords and the safety module as a method of redirecting people off-platform;
-The full user journey from Facebook to delivery partner landing pages;
-The extent to which the pilot can be considered a proof of concept for future deployments.

Recent years has seen a trend towards the increasing specificity of recruitment targets for global jihad. This paper is a case study of the discourses used to recruit a Western female who originally subscribed to an antigovernment, anti-New World Order ideology. Categorising using grounded theory analysis found that female recruiters tapped into the interest of their target subject and then shifted her towards sympathy and commitment to radical Islam. This was achieved through media saturation of Western aggression against Muslims coupled with an ideology that promotes the need to fight and resist. Subject material to which the recruit was directed was carefully controlled and initially deemphasized the Qur’an in favour of mujahedeen narratives and the teachings of Anwar al-Awlaki. Overall, the research supported a sophisticated narrowcasting strategy that was carefully developed primarily by female recruiters.

Emerging research on the etiology of violent radical political behavior has begun to explore the role of empathy in shaping an individual’s beliefs, attitudes, and intentions that culminate in radicalization. The existing studies focus on persuasive influence upon an individual, but they overlook the centrality of empathy and that in the absence of empathy, persuasion is not salient. If an individual empathizes with a message then when it is processed by the receiver, the message is more likely to be considered realistic, relatable, believable, and therefore, persuasive. However, very little is known as to how messages should be designed to stimulate empathy in order to optimize their persuasive impact, which is particularly relevant to terrorist and extremist messaging given the lethal outcome of successful persuasion. This study examines the neurocognitive process of radicalization, specifically as it occurs within virtual online space, and how message content and production features have the potential to arouse empathy and generate radical-persuasive outcomes among the target audience. The findings of this research demonstrate how emotions, specifically that of empathy, can be stimulated in order to facilitate the process of radicalization, thus increasing the potential for violent radical political behavior.

VOX-Pol Blog post.