Does Media Format Matter? Investigating the Toxicity, Sentiment and Topic of Audio Versus Text Social Media Messages

Li, Jamy; Penaranda Valdivia, Karen

Abstract

Audio messaging and voice-based interactions are growing in popularity. Lexical features of a manually-curated dataset of real-world audio tweets, as well as text and video/image tweets from the same user accounts, are analyzed to explore how user-generated audio differs from text. The toxicity, sentiment, topic and length of audio tweet transcripts are compared with their accompanying text, date-matched text tweets from the same users and date-matched video/image tweets and their accompanying text. Audio tweets were significantly less toxic than both text tweets and text that accompanied the audio tweet, as well as significantly lower sentiment than their accompanying text. The topics and word counts of audio, text and video/image tweets also differed. These findings are then used to derive design implications for audio and conversational agent interaction. This research contributes preliminary insights about audio social media messages that may help researchers and designers of audio- and agent-based interaction better understand and design for different media formats.

Citation

Li, J., & Penaranda Valdivia, K. (2022, December). Does Media Format Matter? Investigating the Toxicity, Sentiment and Topic of Audio Versus Text Social Media Messages. Presented at 10th International Conference on Human-Agent Interaction, Christchurch, New Zealand

• Presentation Conference Type: Conference Paper (published)
• Conference Name: 10th International Conference on Human-Agent Interaction
• Start Date: Dec 5, 2022
• End Date: Dec 8, 2022
• Acceptance Date: Dec 5, 2022
• Publication Date: 2022-12
• Deposit Date: May 7, 2024
• Publisher: Association for Computing Machinery (ACM)
• Peer Reviewed: Peer Reviewed
• Pages: 13-22
• Book Title: HAI '22: Proceedings of the 10th International Conference on Human-Agent Interaction
• ISBN: 978-1-4503-9323-2
• DOI: https://doi.org/10.1145/3527188.3561927