Online Library

VOX-Pol Blog post.

Debates around the effectiveness of high-profile Twitter account suspensions and similar bans on abusive users across social media platforms abound. Yet we know little about the effectiveness of warning a user about the possibility of suspending their account as opposed to outright suspensions in reducing hate speech. With a pre-registered experiment, we provide causal evidence that a warning message can reduce the use of hateful language on Twitter, at least in the short term. We design our messages based on the literature on deterrence, and test versions that emphasize the legitimacy of the sender, the credibility of the message, and the costliness of being suspended. We find that the act of warning a user of the potential consequences of their behavior can significantly reduce their hateful language for one week. We also find that warning messages that aim to appear legitimate in the eyes of the target user seem to be the most effective. In light of these findings, we consider the policy implications of platforms adopting a more aggressive approach to warning users that their accounts may be suspended as a tool for reducing hateful speech online.

VOX-Pol Blog post.

VOX-Pol Blog post.

VOX-Pol Blog post.

The apocalyptic narrative of the Syrian civil war promoted by the Islamic State (IS) terrorist group in 2014 had galvanised around a hundred radicals in Malaysia who subsequently migrated to Iraq and Syria. At least forty-five of them propagated their jihadist cause online resulting in the mushrooming of online extremism in the country. The growth spans over five years (2013-2017) in two phases, one led by Muhammad Lotfi Arifin’s network of online followers and the other by Muhammad Wanndy Muhammad Jedi’s online supporters and sympathizers. Lotfi and his network popularised the concept of ‘jihad’ from the perspective of militant groups, while Wanndy lured vulnerable online followers deeper into the later stages of violent radicalisation. The trajectory of Malaysia’s online violent radicalism from Lotfi to Wanndy was coincidental rather than deliberate, signifying the ‘funnel’ process of radicalisation. This process is synced with the terrorists’ switch from online public platforms to encrypted and private ones.