How should Conversational Agent systems respond to sexual harassment?

Laura De Grazia, Alex Peiró Lilja, Mireia Farrús Cabeceran, Mariona Taulé


Abstract
This paper investigates the appropriate responses that Conversational Agent systems (CAs) should employ when subjected to sexual harassment by users. Previous studies indicate that conventional CAs often respond neutrally or evade such requests. Enhancing the responsiveness of CAs to offensive speech is crucial, as users might carry over these interactions into their social interactions. To address this issue, we selected evaluators to compare a series of responses to sexual harassment from four commercial CAs (Amazon Alexa, Apple Siri, Google Home, and Microsoft Cortana) with alternative responses we realized based on insights from psychological and sociological studies. Focusing on CAs with a female voice, given their increased likelihood of encountering offensive language, we conducted two experiments involving 22 evaluators (11 females and 11 males). In the initial experiment, participants assessed the responses in a textual format, while the second experiment involved the evaluation of responses generated with a synthetic voice exhibiting three different intonations (angry, neutral, and assertive). Results from the first experiment revealed a general preference for the responses we formulated. For the most voted replies, female evaluators exhibited a tendency towards responses with an assertive intent, emphasizing the sexually harassing nature of the request. Conversely, male evaluators leaned towards a more neutral response, aligning with prior findings that highlight gender-based differences in the perception of sexual harassment. The second experiment underscored a preference for assertive responses. The study’s outcomes highlight the need to develop new, educational responses from CAs to instances of sexual harassment, aiming to discourage harmful behavior.
Anthology ID:
2024.teicai-1.5
Volume:
Proceedings of the 1st Worskhop on Towards Ethical and Inclusive Conversational AI: Language Attitudes, Linguistic Diversity, and Language Rights (TEICAI 2024)
Month:
March
Year:
2024
Address:
St Julians, Malta
Editors:
Nina Hosseini-Kivanani, Sviatlana Höhn, Dimitra Anastasiou, Bettina Migge, Angela Soltan, Doris Dippold, Ekaterina Kamlovskaya, Fred Philippy
Venues:
TEICAI | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
28–35
Language:
URL:
https://aclanthology.org/2024.teicai-1.5
DOI:
Bibkey:
Cite (ACL):
Laura De Grazia, Alex Peiró Lilja, Mireia Farrús Cabeceran, and Mariona Taulé. 2024. How should Conversational Agent systems respond to sexual harassment?. In Proceedings of the 1st Worskhop on Towards Ethical and Inclusive Conversational AI: Language Attitudes, Linguistic Diversity, and Language Rights (TEICAI 2024), pages 28–35, St Julians, Malta. Association for Computational Linguistics.
Cite (Informal):
How should Conversational Agent systems respond to sexual harassment? (De Grazia et al., TEICAI-WS 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.teicai-1.5.pdf
Video:
 https://aclanthology.org/2024.teicai-1.5.mp4