Online Library

In setting out the work program for the past 12 months, the group’s shared objective was to collaborate across industry, government, and civil society “to map content-sharing algorithms and processes used by industry that may facilitate consumption of content that may increase user interest in or amplify terrorist and violent extremist content and consider positive interventions and risk mitigation points.” This report focuses on the first part of that objective: To map content-sharing algorithms and processes used by industry. The potential role of content-sharing algorithms in radicalization and violent extremist recruitment continues to be an issue of focus. Yet there is little understanding about what those algorithms are and how they might be misused, contribute to radicalization, or be exploited by violent extremist groups and bad actors. This document is the first step in contributing to that understanding.

In setting out the work program for the past 12 months, the shared objective of the group was to collaborate across industry, government, and civil society “to map contentsharing algorithms and processes used by industry that may facilitate consumption of content that may increase user interest in or amplify terrorist and violent extremist content and consider positive interventions and risk mitigation points.” This report focuses on the second part of the objective in considering positive interventions and risk mitigation points. GIFCT’s mission is focused on preventing terrorists and violent extremists from exploiting digital platforms. For the purposes of this work we have taken a content-agnostic approach and sought to map positive interventions already used in the countering violent extremism (CVE) space as well as those that have been used elsewhere but could be applied to CVE. The use of counter and alternative narratives is recognized as an online CVE mechanism for connecting users to alternative sources of information. Yet there is less awareness of the uses of other forms of positive interventions.

As we seek to broaden and diversify our membership, and as the nature of terrorist and violent extremist activity online evolves, GIFCT must focus on developing rights-based technical solutions that are thoughtful, practical, and scalable. In our view, hash-sharing is an innovative and important first step in GIFCT’s efforts to share information among member companies and thereby promote more effective content moderation. But hashsharing is only one piece of the puzzle. When it comes to technical solutions and industry collaboration to address terrorist and violent extremist exploitation of the internet, much more remains to be done. GIFCT looks forward to working with our diverse stakeholder community to advance this collaborative effort in service of a safer and more open internet
and world.

The multistakeholder Global Network Initiative (GNI) reviewed more than twenty recent governmental initiatives that claim to address various forms of online harm related to user-generated content — a practice we refer to broadly as “content regulation.” We focused on proposals that could shift existing responsibilities and incentives related to user-generated content. Our analysis illustrates the ways that good governance and human rights principles provide time-tested guidance for
how laws, regulations, and policy actions can be most appropriately and effectively designed and carried out. Because content regulation is primarily focused on and likely to impact digital communication and content, we use international human rights principles related to freedom of expression and privacy as our primary lens.

The role of information and communication technology (ICT) companies in responding to alleged terrorist or extremist content has become one of the most challenging issues for freedom of expression and privacy online. In July 2015, GNI launched a policy
dialogue to explore key questions and considerations concerning government efforts to restrict online content with the aim of protecting public safety, and to discuss the human rights implications of such government actions.

Radicalization research is dedicated to analyzing factors related to radicalization processes, which in turn can lead to extremism. One factor is frequently discussed: the role of the Internet. This paper examines the relationship between active and passive online activities, including consumption, networking, and posting, and extremist attitudes in the field of Islamism and right-wing extremism among adolescents. Data from a school survey (N = 6,715) show that right-wing attitudes are particularly correlated with consumption of political websites, though this effect is weaker among females. However, posting shows only a small effect and networking shows no effect at all. Islamist attitudes, on the other hand, are related to the extent to which one consumes violent Islamist videos, meets other Muslims online, and posts Islamic content.

Die Radikalisierungsforschung untersucht Faktoren und Bedingungen von Prozessen, die hin zu Extremismus führen können. Ein häufig genannter Faktor ist das Internet. Diese Arbeit untersucht den Zusammenhang zwischen verschiedenen passiven und aktiven Internetaktivitäten, wie das Konsumieren, Vernetzen und Posten mit extremistischen Einstellungen im Bereich Islamismus und Rechtsextremismus bei Jugendlichen. Daten einer Schüler*innenbefragung (N = 6,715) zeigen, dass rechtsextreme Einstellungen insbesondere bei Jungen mit dem Konsum politischer Websites einhergehen, während Posting nur geringe und das Netzwerken keine Zusammenhänge mit rechtsextremen Einstellungen zeigen. Bei islamistischen Einstellungen zeigen sich dagegen Zusammenhänge mit dem Konsum von islamistischen Gewaltvideos, dem Vernetzen mit anderen Muslim*innen und dem Posten islamischer Inhalte.