YouTube’s video recommendation system, in particular, has been criticised for radicalising young people and steering viewers down rabbit holes of disturbing content.
The company claims it is trying to avoid amplifying problematic content. But research from YouTube’s parent company, Google, indicates this is far from straightforward, given the commercial pressure to keep users engaged via ever more stimulating content.
But how do YouTube’s recommendation algorithms actually work? And how much are they really to blame for the problems of radicalisation?
The fetishisation of algorithms
Almost everything we see online is heavily curated. Algorithms decide what to show us in Google’s search results, Apple News, Twitter trends, Netflix recommendations, Facebook’s newsfeed, and even pre-sorted or spam-filtered emails. And that’s before you get to advertising.
More often than not, these systems decide what to show us based on their idea of what we are like. They also use information such as what our friends are doing and what content is newest, as well as built-in randomness. All this makes it hard to reverse-engineer algorithmic outcomes to see how they came about.
Algorithms take all the relevant data they have and process it to achieve a goal – often one that involves influencing users’ behaviour, such as selling us products or keeping us engaged with an app or website.
At YouTube, the “up next” feature is the one that receives most attention, but other algorithms are just as important, including search result rankings, homepage video recommendations, and trending video lists.
How YouTube recommends content
The main goal of the YouTube recommendation system is to keep us watching. And the system works: it is responsible for more than 70% of the time users spend watching videos.
When a user watches a video on YouTube, the “up next” sidebar shows videos that are related but usually longer and more popular. These videos are ranked according to the user’s history and context, and newer videos are generally preferenced.
This is where we run into trouble. If more watching time is the central objective, the recommendation algorithm will tend to favour videos that are new, engaging and provocative.
Yet algorithms are just pieces of the vast and complex sociotechnical system that is YouTube, and there is so far little empirical evidence on their role in processes of radicalisation.
In fact, recent research suggests that instead of thinking about algorithms alone, we should look at how they interact with community behaviour to determine what users see.
The importance of communities on YouTube
YouTube is a quasi-public space containing all kinds of videos: from musical clips, TV shows and films, to vernacular genres such as “how to” tutorials, parodies, and compilations. User communities that create their own videos and use the site as a social network have played an important role on YouTube since its beginning.
Right-wing content creators also know YouTube’s policies well. Their videos are often “borderline” content: they can be interpreted in different ways by different viewers.
YouTube’s community guidelines restrict blatantly harmful content such as hate speech and violence. But it’s much harder to police content in the grey areas between jokes and bullying, religious doctrine and hate speech, or sarcasm and a call to arms.
Moving forward: a cultural shift
There is no magical technical solution to political radicalisation. YouTube is working to minimise the spread of borderline problematic content (for example, conspiracy theories) by reducing their recommendations of videos that can potentially misinform users.
However, YouTube is a company and it’s out to make a profit. It will always prioritise its commercial interests. We should be wary of relying on technological fixes by private companies to solve society’s problems. Plus, quick responses to “fix” these issues might also introduce harms to politically edgy (activists) and minority (such as sexuality-related or LGBTQ) communities.
When we try to understand YouTube, we should take into account the different factors involved in algorithmic outcomes. This includes systematic, long-term analysis of what algorithms do, but also how they combine with YouTube’s prominent subcultures, their role in political polarisation, and their tacticsfor managing visibility on the platform.
Before YouTube can implement adequate measures to minimise the spread of harmful content, it must first understand what cultural norms are thriving on their site – and being amplified by their algorithms.
Ariadna Matamoros-Fernández is a Lecturer in Digital Media at the School of Communication, Queensland University of Technology. You can follow her on Twitter: @andairamf
Joanne Gray is a Lecturer in Creative Industries, Queensland University of Technology.
The authors would like to acknowledge that the ideas presented in this article are the result of ongoing collaborative research on YouTube with researchers Jean Burgess, Nicolas Suzor, Bernhard Rieder, and Oscar Coromina.
This article was originally posted on TheConversation.com website. Republished here with permission from the author(s) and under Creative Commons License.