Online Library

Social media and tech companies face the challenge of identifying and removing terrorist and extremist content from their platforms. This paper presents the findings of a series of interviews with Global Internet Forum to Counter Terrorism (GIFCT) partner companies and law enforcement Internet Referral Units (IRUs). It offers a unique view on current practices and challenges regarding content removal, focusing particularly on human-based and automated approaches and the integration of the two.

To inform the discussion, the paper draws on the debates that have surrounded the U.K. ‘Encouragement of Terrorism’ criminal offence. Created by the Terrorism Act 2006, and recently amended by the Counter-Terrorism and Border Security Act 2019, this offence has proved controversial from its inception for two principal reasons. First, the offence expressly encompasses both direct and indirect encouragement. Critics have argued that the concept of indirect encouragement is too nebulous and gives the offence too wide a scope. Second, the framing of the offence focuses not on the purpose of the speaker, but on whether the potential effect of the statement is to encourage terrorism.

‘Islamic State’s Online Activity and Responses’ provides a unique examination of Islamic State’s online activity at the peak of its “golden age” between 2014 and 2017 and evaluates some of the principal responses to this phenomenon. Featuring contributions from experts across a range of disciplines, the volume examines a variety of aspects of IS’s online activity, including their strategic objectives, the content and nature of their magazines and videos, and their online targeting of females and depiction of children. It also details and analyses responses to IS’s online activity – from content moderation and account suspensions to informal counter-messaging and disrupting terrorist financing – and explores the possible impact of technological developments, such as decentralised and peer-to-peer networks, going forward. Platforms discussed include dedicated jihadi forums, major social media sites such as Facebook, Twitter, and YouTube, and newer services, including Twister.

‘Islamic State’s Online Activity and Responses’ is essential reading for researchers, students, policymakers, and all those interested in the contemporary challenges posed by online terrorist propaganda and radicalisation. The chapters were originally published as a special issue of Studies in Conflict & Terrorism.

Social-media companies make extensive use of artificial intelligence in their efforts to remove and block terrorist content from their platforms. This paper begins by arguing that, since such efforts amount to an attempt to channel human conduct, they should be regarded as a form of regulation that is subject to rule-of-law principles. The paper then discusses three sets of rule-of-law issues. The first set concerns enforceability. Here, the paper highlights the displacement effects that have resulted from the automated removal and blocking of terrorist content and argues that regard must be had to the whole social-media ecology, as well as to jihadist groups other than the so-called Islamic State and other forms of violent extremism. Since rule by law is only a necessary, and not a sufficient, condition for compliance with rule-of-law values, the paper then goes on to examine two further sets of issues: the clarity with which social-media companies define terrorist content and the adequacy of the processes by which a user may appeal against an account suspension or the blocking or removal of content. The paper concludes by identifying a range of research questions that emerge from the discussion and that together form a promising and timely research agenda to which legal scholarship has much to contribute.

This paper was presented at the 2nd European Counter Terrorism Centre (ECTC) Advisory Group conference, 17-18 April 2018, at Europol Headquarters, The Hague. The views expressed are the authors’ own and do not necessarily represent those of Europol.
In a speech delivered at the United Nations General Assembly in September 2017, the U.K. Prime Minister Theresa May called on social media companies to do more to remove and block terrorist content from their platforms [1]. In the speech she stated that the average lifespan of online propaganda from the so-called Islamic State (IS) was 36 hours. For such content to be disrupted effectively, she claimed that this figure needed to be reduced to one to two hours. This has since come to be known as the ‘golden window’: if terrorist material can be detected and removed within one to two hours, its spread will be prevented.

The so-called Islamic State (IS) has a sophisticated media strategy (Winter 2017), an important part of which has been its English-language online magazine Dabiq. Launched in July 2014, a total of fifteen issues of Dabiq in the two years that followed. These issues were disseminated in a variety of ways, including archive sites (Bodo and Speckhard 2017), web forums and file-sharing networks (Gambhir 2016), the dark web (Stacey 2017), and even via an attempt to sell the freely available magazines for profit through the online retailer Amazon (Masi 2015). One of the most important forums for dissemination, however, was the social media platform Twitter (Bodo and Speckhard 2017; Gambhir 2016; Cunningham, Everton and Schroeder 2015; Shaheen 2015). Released in July 2016, the theme of Dabiq issue 15 was ‘Break the Cross’. After referring to a number of attacks that had occurred in the preceding weeks, the issue’s foreword called on ‘pagan Christians’, ‘liberalist secularists’ and ‘sceptical atheists’ to ‘recognize their Creator and submit to Him’. In addition to regular features, including ‘Among the believers are men’ and ‘In the words of the enemy’ (which, in this issue’ focussed on Pope Francis), and advertisements for other IS media, issue 15 contained an 18 page feature article, also titled ‘Break the Cross’. Arguing that the Bible does not display the three hallmarks of a true divine text, the article discusses the doctrine of the Trinity, whether Jesus was crucified, and whether Paul’s New Testament teachings are authentic (repeatedly stating that Paul was a known liar). It then seeks to establish the authenticity of the Prophet Muhammad, before asking Christians rhetorically: ‘O People of the Scripture, follow the truth from your Lord, whom you claim to love. Would you follow your parents and ancestors if you knew they were walking into a fire?’ and concluding ‘Know well that our fight will continue until you are defeated and submit to the rule of your Creator, or until we achieve martyrdom. Allah has made our mission to wage war against disbelief until it ceases to exist, as he has ordered us to kill all pagans wherever they are found’. Drawing on an original dataset, in this article we examine the response to the release of Dabiq issue 15 on Twitter. We examine the response in two respects: first, the response from Twitter itself, in terms of suspension activity; and, second, the response from other users, in terms of their engagement with posts disseminating the new issue. Before presenting our findings, we begin by offering an overview of our methodology.