Online Library

Algorithms and especially recommendation algorithms play an important role online, most notably on YouTube. Yet, little is known about the network communities that these algorithms form. We analyzed the channel recommendations on YouTube to map the communities that the social network is creating through its algorithms and to test the network for homophily, that is, the connectedness between communities. We find that YouTube’s channel recommendation algorithm fosters the creation of highly homophilous communities in the United States (n = 13,529 channels) and in Germany (n = 8,000 channels). Factors that seem to drive YouTube’s recommendations are topics, language, and location. We highlight the issue of homophilous communities in the context of politics where YouTube’s algorithms create far-right communities in both countries.

The European Union (EU) is an influential voice in the global debate on regulation of online speech. For that reason, two upcoming regulatory regimes might – in addition to shaping EU digital policy – create global precedents for how to regulate both online speech generally and terrorist content specifically.

Hate speech and toxic communication online is on the rise. Responses to this issue tend to offer technical (automated) or non-technical (human content moderation) solutions, or see hate speech as a natural product of hateful people. In contrast, this article begins by recognizing platforms as designed environments that support particular practices while discouraging others. In what ways might these design architectures be contributing to polarizing, impulsive, or antagonistic behaviors? Two platforms are examined: Facebook and YouTube. Based on engagement, Facebook’s Feed drives views but also privileges incendiary content, setting up a stimulus–response loop that promotes outrage expression. YouTube’s recommendation system is a key interface for content consumption, yet this same design has been criticized for leading users towards more extreme content. Across both platforms, design is central and influential, proving to be a productive lens for understanding toxic communication.

Anecdotal evidence asserts that extremist materials on the internet play a decisive role in radicalization processes. However, due to a structural absence of empirical data in the current literature, it remains uncertain if—and to what extent—online extremist materials radicalize. Therefore, the approach of the study was two-fold. First, we explored what types of online jihadist media are pro-actively sought and consumed by young adults. Second, we investigated if and how active exposure to online jihadist media is related to cognitive radicalization, whilst taking into account one’s moral disengagement, prior involvement in petty crime, and socio-demographics. Cross-sectional data analyses within a sample of Belgian young adults (n = 1872) show that beheading videos—the most violent and radical form of any of the jihadist materials under scrutiny—were most sought online (36%), but were, paradoxically, the least predictive for radicalization. On the contrary, the rather static jihadist magazines were sought by a small minority (10–11%) but were most strongly associated with radicalization. A stepwise linear regression analysis and Structural Equation Model support our hypothesis that the process of cognitive radicalization is a complex, phasic trajectory from actively seeking out extremist materials to sympathies for violent political behaviors.

The Western Balkans faces a double challenge from online extremism. Online platforms are facilitating the specific targeting of the region by diverse international extremist narratives. Meanwhile regional histories and geopolitics are being appropriated to justify extremist actions and narratives around the world. This is part of a wider trend that underscores the growing challenge posed by the proliferation of transnational extremist ideologies on online platforms, both violent jihadist and extreme right wing. In the Western Balkans, this poses a number of specific risks. While the issue of the prevention, mitigation, and regulation of online extremism is a global one, there are a number of region-specific considerations relevant to effective policy and practitioner responses.

This paper offers a set of specific proposals for better describing harmful content online and for reducing the damage it causes, while protecting freedom of expression. The ideas are mainly meant for OSPs since they regulate the vast majority of online content; taken together they operate the largest system of censorship the world has ever known, controlling more human communication than any government. Governments, for their part, have tried to berate or force the companies into changing their policies, with limited and often repressive results. For these reasons, this paper focuses on what OSPs should do to diminish harmful content online. The proposals focus on the rules that form the basis of each regulation system, as well as on other crucial steps in the regulatory process, such as communicating rules to platform users, giving multiple stakeholders a role in regulation, and enforcement of the rules.