Extended Multimodal Hate Speech Event Detection During Russia-Ukraine Crisis - Shared Task at CASE 2024

Surendrabikram Thapa*, Kritesh Rauniyar*, Farhan Ahmad Jafri, Hariram Veeramani, Raghav Jain, Sandesh Jain, Francielle Vargas*, Ali Hürriyetoğlu, Usman Naseem

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference paperAcademicpeer-review

6 Citations (Scopus)

Abstract

Addressing the need for effective hate speech moderation in contemporary digital discourse, the Multimodal Hate Speech Event Detection Shared Task made its debut at CASE 2023, co-located with RANLP 2023. Building upon its success, an extended version of the shared task was organized at the CASE workshop in EACL 2024. Similar to the earlier iteration, in this shared task, participants address hate speech detection through two subtasks. Subtask A is a binary classification problem, assessing whether text-embedded images contain hate speech. Subtask B goes further, demanding the identification of hate speech targets, such as individuals, communities, and organizations within text-embedded images. Performance is evaluated using the macro F1-score metric in both subtasks. With a total of 73 registered participants, the shared task witnessed remarkable achievements, with the best F1-scores in Subtask A and Subtask B reaching 87.27% and 80.05%, respectively, surpassing the leaderboard of the previous CASE 2023 shared task. This paper provides a comprehensive overview of the performance of seven teams that submitted results for Subtask A and five teams for Subtask B.

Original languageEnglish
Title of host publicationCASE 2024 - 7th Workshop on Challenges and Applications of Automated Extraction of Socio-Political Events from Text, Proceedings of the Workshop
EditorsAli Hurriyetoglu, Hristo Tanev, Surendrabikram Thapa, Gokce Uludogan
Place of PublicationSt Julians
PublisherAssociation for Computational Linguistics (ACL)
Pages221-228
Number of pages8
ISBN (Electronic)9798891760707
Publication statusPublished - Mar 2024
Event7th Workshop on Challenges and Applications of Automated Extraction of Socio-Political Events from Text, CASE 2024 - St. Julian's, Malta
Duration: 22 Mar 2024 → …

Conference/symposium

Conference/symposium7th Workshop on Challenges and Applications of Automated Extraction of Socio-Political Events from Text, CASE 2024
Country/TerritoryMalta
CitySt. Julian's
Period22/03/24 → …

Fingerprint

Dive into the research topics of 'Extended Multimodal Hate Speech Event Detection During Russia-Ukraine Crisis - Shared Task at CASE 2024'. Together they form a unique fingerprint.
  • EFRA

    Mutlu, O. (PhD candidate), Fensel, A. (Promotor), Hürriyetoğlu, A. (Co-promotor) & van der Velden, B. (Co-promotor)

    1/12/23 → …

    Project: PhD

  • EFRA: Extreme Food Risk Analytics

    1/01/2331/12/25

    Project: EU research project

  • EU23033 - EFRA (BO-64-101-014)

    van der Velden, B. (Project Leader)

    1/01/2331/12/23

    Project: LVVN project

Cite this