Online Library

The Islamic State (ISIS) was uniquely effective among extremist groups in the Middle East at recruiting Westerners. A major way ISIS accomplished this was by adopting Hollywood-style narrative structures for their propaganda videos. In particular, ISIS utilized a heroic martyr narrative, which focuses on an individual’s personal glory and empowerment, in addition to traditional social martyr narratives, which emphasize duty to kindred and religion. The current work presented adult participants (n = 238) video clips from ISIS propaganda which utilized either heroic or social martyr narratives and collected behavioral measures of appeal, narrative transportation, and psychological dispositions (egoism and empathy) associated with attraction to terrorism. Narrative transportation and the interaction between egoism and empathy predicted video recruitment appeal. A subset of adults (n = 80) underwent electroencephalographic (EEG) measurements while watching a subset of the video-clips. Complementary univariate and multivariate techniques characterized spectral power density differences when perceiving the different types of narratives. Heroic videos show increased beta power over frontal sites, and globally increased alpha. In contrast, social narratives showed greater frontal theta, an index of negative feedback and emotion regulation. The results provide strong evidence that ISIS heroic narratives are specifically processed, and appeal to psychological predispositions distinctly from other recruitment narratives.

VOX-Pol Blog post.

Debates around the effectiveness of high-profile Twitter account suspensions and similar bans on abusive users across social media platforms abound. Yet we know little about the effectiveness of warning a user about the possibility of suspending their account as opposed to outright suspensions in reducing hate speech. With a pre-registered experiment, we provide causal evidence that a warning message can reduce the use of hateful language on Twitter, at least in the short term. We design our messages based on the literature on deterrence, and test versions that emphasize the legitimacy of the sender, the credibility of the message, and the costliness of being suspended. We find that the act of warning a user of the potential consequences of their behavior can significantly reduce their hateful language for one week. We also find that warning messages that aim to appear legitimate in the eyes of the target user seem to be the most effective. In light of these findings, we consider the policy implications of platforms adopting a more aggressive approach to warning users that their accounts may be suspended as a tool for reducing hateful speech online.

VOX-Pol Blog post.

VOX-Pol Blog post.

An empirical study by the Israel Internet Association analyzes the manner and quality of response by various social media platforms to 447 verified and confirmed reports of harmful content. These reports were submitted to the platforms by the Association’s Internet Safety Hotline, recognized by most platforms as an official Trusted Flagger, after meticulously confirming that all content reported explicitly violated the relevant platforms’ content policies.  The study considers all reports verified and sent to the platforms by the Hotline team between October 7 and December 7, 2023 (the first two months of the Israel-Hamas war) through official channels, the response received from the platforms to these reports, and actions taken or not taken by the platforms in response to the reported content. Parameters evaluated include: response time, the nature and quality of response as a function of content type, and whether the platforms’ actions matched their public commitments to addressing online threats in the wake of the Hamas attacks.

The findings are troubling, and show that response times were exceedingly slow, with little to no action on weekends. Handling of content requiring manual review or contextual understanding was notably poor, revealing significant differences between content types and across different platforms. We show that the same platforms have succeeded in similar situations in other countries, suggesting that success is possible when appropriate resources are channeled into achieving it. We present detailed recommendations as to how to remedy the present situation, and emphasize that responsibility lies not only with the platforms but also with governments and legislators, who permit these companies to operate with minimal transparency and accountability.