Online Library

VOX-Pol Blog post.

Digital platforms were slow to build robust teams to counter threat actors, but today, many of those corporate teams have robust processes, specialized tools, and innovative approaches to countering highly adaptive adversaries. They operate in a tremendously dynamic environment where their adversaries can innovate at low cost, primarily because of the nature of the digital “terrain” where the conflict occurs. And while the actions these teams take are not kinetic, as those sometimes utilized in geopolitical conflict, the cat-and-mouse game between Trust & Safety teams and threat actors online suggests lessons that are increasingly relevant to the national security community. This article explores five factors that were key to facilitating innovation in Facebook’s approach to countering the Islamic State—and that I argue are more generalizable. They are: people, organization, legitimacy, tools, and collaboration. It also identifies lessons that can be learned from that experience. For example, we did not prioritize using a particular technology or focus experimentation in some bespoke “innovation center.” Rather, we succeeded because we were made responsible for a critical mission, were unencumbered by past process, and had the right team structured to reduce external dependencies for innovation. Basic technological innovation can occur in an ivory tower, but applied innovation requires proximity to real-world missions. You cannot expect dramatic innovation without failure and iteration in an environment of real responsibility. Fundamentally, that means that innovation requires accepting risk. The structures and incentives of Silicon Valley cannot and should not simply be grafted on to our national security infrastructure. The rewards and costs of failure are different. But military organizations should shoulder the risks associated with innovation and study the lessons of corollary efforts in Silicon Valley and the private sector more broadly.

This article seeks to propose a valuable frame for understanding which processes, either cognitive or practical, take part in the making of a terrorist act within the frame of the onlife region. A term recently coined, onlife, refers to the interacting/indistinguishable domain of online and offline world: this is the environment where today’s global terrorism/extremism flourishes. This region of complexity and the phenomena that entails can valuably explored through the General System Theory (GST). In the first part of the paper how global terrorism is changing, moving into cyber terrorism, at the light of the GST, according to recent theoretical achievements in the field is described in detail. The second part will explore a case study of onlife terrorism perpetrated in New Zealand, in order to focus the passage from the ‘possible’ idea of making a massacre to its effective performance, from onlife radicalization to the onlife event (a livestreamed attack filmed by the author) – through a deliberate use of the internet. At this point, the author will be able to come back to the question posed before, sketching some insights that might be valuable for cyber terrorism as well as for GST, especially for what concerns systemic processes within the moral domain.

Given the rise of media and information technology, the debate over anti-blasphemy laws has become one of international importance. Cutting across different regions and faiths, blasphemy laws have triggered instability, empowered extremists, and increased sectarian violence. With frequently vague wording, they are open to whimsical interpretations, resulting in scores of human rights abuses, and violating international standards of free expression, religion, and belief.

While many religious traditions have taboos against blaspheming the sacred, violence related to allegations of blasphemy is particularly prevalent across Islamic states. In some Islamic states, scores of human rights abuses, committed in the name of fighting blasphemy, constitute obstacles to reform and democracy, and enhance the likelihood of sectarian violence. Blasphemy laws often help majority viewpoints to triumph against those of dissenters. As a result, religious minorities, free-thinkers, and political dissidents in Muslim majority countries are frequently targeted by blasphemy laws, weakening social cohesion and constraining free expression.

Whether online or offline, high-profile allegations of blasphemy have affected foreign relations and have raised new policy stakes for relations between the U.S. and the Muslim world. In the digital age, verbal expressions that were once limited to the immediate geographic vicinity are now broadcast globally at lightning speed. It is thus becoming increasingly important for governments and social media companies to implement policies that protect pluralism and democracy. Social media companies must take action to ensure the protection of both their users and uphold global standards of free speech. The U.S. government also has a duty to encourage pluralism and freedom of expression around the world. There are certain steps the United States should take to oppose anti-blasphemy laws in a broader effort to curb violent extremism and promote the peaceful expression of religious views, which is essential to democratic reform.

Content takedowns have emerged as one of the central pillars in the global fight against disinformation and extremism. Despite their increasing ubiquity as disruptive tools in political processes, their true efficacy remains up for debate. We ‘know’, for example, that takedowns had a strong disruptive effect on Islamic State-supporting networks online, but we do not know whether constraining avenues for expression may ultimately accelerate offline acts of violence. We also know that extreme-right networks have weaponised content takedowns as evidence of victimisation and the steadfast erosion of ‘free speech’, often underpinning calls to (violent) action. There is much to understand about the efficacy of content moderation with regard to accelerationism, democracy and (violent) extremism: this event seeks to address these issues in an open forum for discussion.

Chair: Dr. James Fitzgerald (Dublin City University)

Presentation 1: Moderating Borderline Content whilst Respecting Fundamental Values Dr Katy Vaughan (Swansea University)

Presentation 2: Recommending Instead of Taking Down: YouTube hyper-partisan content promotion amid the 2022 Brazilian general elections Profs. Rose Marie Santini, Débora Salles, & Bruno Mattos (Federal University of Rio de Janeiro)

Presentation 3: Wellness and Conspiracy Theories: The promise and peril(s) of content takedowns Dr. Vivian Gerrand (Deakin University) and Dr. James Fitzgerald (Dublin City University)

VOX-Pol Blog post.