Online Library

We present a machine learning framework that leverages a mixture of metadata, network, and temporal features to detect extremist users, and predict content adopters and interaction reciprocity in social media. We exploit a unique dataset containing millions of tweets generated by more than 25 thousand users who have been manually identified, reported, and suspended by Twitter due to their involvement with extremist campaigns. We also leverage millions of tweets generated by a random sample of 25 thousand regular users who were exposed to, or consumed, extremist content. We carry out three forecasting tasks, (i) to detect extremist users, (ii) to estimate whether regular users will adopt extremist content, and finally (iii) to predict whether users will reciprocate contacts initiated by extremists. All forecasting tasks are set up in two scenarios: a post hoc (time independent) prediction task on aggregated data, and a simulated real-time prediction task. The performance of our framework is extremely promising, yielding in the different forecasting scenarios up to 93 % AUC for extremist user detection, up to 80 % AUC for content adoption prediction, and finally up to 72 % AUC for interaction reciprocity forecasting. We conclude by providing a thorough feature analysis that helps determine which are the emerging signals that provide predictive power in different scenarios.

There can be few greater fears for a parent than their child being contacted by a stranger, indoctrinated with an extreme ideology, and encouraged to join a violent movement, all while accessing the internet from their bedroom. Children’s smartphones and computers
may be portals to the most dangerous places on earth. The use of the internet, and more specifically social media, by violent extremists is certainly nothing new. The technical skills and proficiency displayed by groups such as ISIS have been causing concern for governments, law enforcement, industry, schools, religious leaders, and parents around the world. In reality the radicalization of children is rare and particularly nuanced, and far from a linear process that exclusively occurs online. While the media have reported high-profile cases, such as the teenagers from Chicago who tried to leave the United States and join ISIS or the three girls from the United Kingdom who traveled through Turkey to Syria the frequency and nature of conversion to violent extremism is a lot more complex than often reported. Evidence from search histories, online interactions and social media profiles suggest that contact is being made by those intent on radicalizing others. However, while information can be sought and contact can be initiated, complete conversion to a violent ideology is not happening in isolation online. That is to say that the internet is serving as a facilitator, not a direct means of recruitment. In any case action needs to be taken to safeguard children and young people from these risks.

• In this report, we show how recent terror attacks in the UK have been successfully exploited by anti-Muslim activists over social media, to increase their reach and grow their audiences.
• Monitoring key anti-Muslim social media accounts and their networks, we show how even small events are amplified through an international network of activists.
• We also provide concrete evidence of a leading anti-Muslim activist whose message is hugely amplified by the use of a 100+ strong ‘bot army’.
• The global reach, low price and lack of regulation on social media platforms presents new possibilities for independent, single issue and extremist viewpoints to gain significant audiences.
• We delve into the murky and secretive world of the dark web to explore just what tools are available for manipulating social media and show how easy it is to make use of these tactics even for non-tech savvy users.
• Through testing, we conclude that even cheaply inflating one’s number of followers has an effect on the ability to reach a larger audience.
• We situate these developments in the context of increasing hostility towards Muslims and immigration in the Europe and the US.
• “Trigger events” such as terror attacks, and other events that reflect badly on Muslims and Islam, cause both an increase in anti-Muslim hate on the street and, as we will show, also online.

Young People Combating Hate Speech Online is a project of the Council of Europe’s youth sector running between 2012 and 2015. The project aims to combat racism and discrimination in their online expression of hate speech by equipping young people and youth organisations with the competences necessary to recognize and act against such human rights violations. Central to the project is a European youth media campaign which will be designed and implemented with the agency of young people and youth organisations. As a preparation for the project, the Council of Europe’s Youth Department commissioned three “mapping” studies about the realities of hate speech and young people and projects and campaigns about it. These studies are published here as a resource for the activists, youth leaders, researchers, partners and decision makers associated to the project and the online campaign. They are truly a starting points: more research is needed, both on the legal and policy implications of hate speech online as on its impact and relation with young people.

This revised edition of Bookmarks reflects the end of the coordination of the youth campaign by the Council Europe. The campaign may be officially over, but the education and awareness-raising to counter hate speech and promote human rights values remain an urgent task for young people of all ages.

The work of the Council of Europe for democracy is strongly based on education: education in schools, and education as a lifelong learning process of practising democracy, such as in non-formal learning activities. Human rights education and education for democratic citizenship form an integral part of what we have to secure to make democracy sustainable. Hate speech is one of the most worrying forms of racism and discrimination prevailing across Europe and amplified by the Internet and social media. Hate speech online is the visible tip of the iceberg of intolerance and ethnocentrism. Young people are directly concerned as agents and victims of online abuse of human rights; Europe needs young people to care and look after human rights, the life insurance for democracy.

Bookmarks was originally published to support the No Hate Speech Movement youth campaign of the Council of Europe for human rights online. Bookmarks is useful for educators wanting to address hate speech online from a human rights perspective, both inside and outside the formal education system. The manual is designed for working with learners aged 13 to 18 but the activities can be adapted to other age ranges.

Fanaticism, Racism, and Rage Online is a critical exploration of digital hate culture and its myriad infiltrations into the modern online community. The book examines radical movements that have emerged both on the fringes of the Internet, as well as throughout the web’s most popular spaces where extremist voices now intermix with mainstream politics and popular culture. This investigation brings to light the different forms of extremist culture on the web, from the blatant hate websites, to the much more invasive faux-social networks, racist political blogs, and pseudo-scientific domains.