| Title: |
Weigh Your Own Words: Improving Hate Speech Counter Narrative Generation via Attention Regularization |
| Authors: |
Helena Bonaldi; Giuseppe Attanasio; Debora Nozza; Marco Guerini |
| Contributors: |
Bonaldi, Helena; Attanasio, Giuseppe; Nozza, Debora; Guerini, Marco |
| Publisher Information: |
Association for Computational Linguistics |
| Publication Year: |
2023 |
| Collection: |
Fondazione Bruno Kessler: CINECA IRIS |
| Description: |
Recent computational approaches for combating online hate speech involve the automatic generation of counter narratives by adapting Pretrained Transformer-based Language Models (PLMs) with human-curated data. This process, however, can produce in-domain overfitting, resulting in models generating acceptable narratives only for hatred similar to training data, with little portability to other targets or to real-world toxic language. This paper introduces novel attention regularization methodologies to improve the generalization capabilities of PLMs for counter narratives generation. Overfitting to training-specific terms is then discouraged, resulting in more diverse and richer narratives. We experiment with two attention-based regularization techniques on a benchmark English dataset. Regularized models produce better counter narratives than state-of-the-art approaches in most cases, both in terms of automatic metrics and human evaluation, especially when hateful targets are not present in the training data. This work paves the way for better and more flexible counter-speech generation models, a task for which datasets are highly challenging to produce. |
| Document Type: |
conference object |
| Language: |
English |
| Relation: |
ispartofbook:Proceedings of the 1st Workshop on CounterSpeech for Online Abuse; 1st Workshop on CounterSpeech for Online Abuse (CS4OA); firstpage:13; lastpage:28; numberofpages:16; https://hdl.handle.net/11582/341588 |
| Availability: |
https://hdl.handle.net/11582/341588; https://aclanthology.org/2023.cs4oa-1.2/ |
| Rights: |
info:eu-repo/semantics/openAccess |
| Accession Number: |
edsbas.E317CD9D |
| Database: |
BASE |