Multimodal Technologies and Interaction (Jul 2022)

Harvesting Context and Mining Emotions Related to Olfactory Cultural Heritage

  • M. Besher Massri,
  • Inna Novalija,
  • Dunja Mladenić,
  • Janez Brank,
  • Sara Graça da Silva,
  • Natasza Marrouch,
  • Carla Murteira,
  • Ali Hürriyetoğlu,
  • Beno Šircelj

DOI
https://doi.org/10.3390/mti6070057
Journal volume & issue
Vol. 6, no. 7
p. 57

Abstract

Read online

This paper presents an Artificial Intelligence approach to mining context and emotions related to olfactory cultural heritage narratives, particularly to fairy tales. We provide an overview of the role of smell and emotions in literature, as well as highlight the importance of olfactory experience and emotions from psychology and linguistic perspectives. We introduce a methodology for extracting smells and emotions from text, as well as demonstrate the context-based visualizations related to smells and emotions implemented in a novel smell tracker tool. The evaluation is performed using a collection of fairy tales from Grimm and Andersen. We find out that fairy tales often connect smell with the emotional charge of situations. The experimental results show that we can detect smells and emotions in fairy tales with an F1 score of 91.62 and 79.2, respectively.

Keywords