Title
Generating audiovisual summaries from literary works using emotion analysis
Date Issued
01 October 2019
Access level
metadata only access
Resource Type
conference paper
Publisher(s)
Institute of Electrical and Electronics Engineers Inc.
Abstract
Literature work reading is an essential activity for human communication and learning. However, several relevant tasks as selection, filter or analyze in a high number of such works become complex. For dealing with this requirement, several strategies are proposed to rapidly inspect substantial amounts of text, or retrieve information previously read, exploiting graphical, textual or auditory resources. In this paper, we propose a methodology to generate audiovisual summaries by the combination of emotion-based music composition and graph-based animation. We applied natural language processing algorithms for extracting emotions and characters involved in literary work. Then, we use the extracted information to compose a musical piece to accompany the visual narration of the story aiming to convey the extracted emotion. For that, we set important musical features as chord progressions, tempo, scale, and octaves, and we assign a set of suitable instruments. Moreover, we animate a graph to sum up the dialogues between the characters in the literary work. Finally, to assess the quality of our methodology, we conducted two user studies that reveal that our proposal provides a high level of understanding over the content of the literary work besides bringing a pleasant experience to the user.
Start page
31
End page
38
Language
English
OCDE Knowledge area
Ciencias de la computación
Scopus EID
2-s2.0-85077094871
Resource of which it is part
Proceedings - 32nd Conference on Graphics, Patterns and Images, SIBGRAPI 2019
ISBN of the container
9781728152271
Conference
Proceedings - 32nd Conference on Graphics, Patterns and Images, SIBGRAPI 2019
Sponsor(s)
ACKNOWLEDGMENT The authors acknowledge the financial support from Department of Computer Science at the Universidad Católica San Pablo and São Paulo Research Foundation - FAPESP (grant #2019/10560-0).
Sources of information: Directorio de Producción Científica Scopus