Data-to-music sonification and user engagement

Jonathan Middleton; Jonathan Middleton; Jaakko Hakulinen; Katariina Tiitinen; Juho Hella; Tuuli Keskinen; Pertti Huuskonen; Jeffrey Culver; Juhani Linna; Markku Turunen; Mounia Ziat; Roope Raisamo

doi:10.3389/fdata.2023.1206081

Frontiers in Big Data (Aug 2023)

Data-to-music sonification and user engagement

Jonathan Middleton,
Jonathan Middleton,
Jaakko Hakulinen,
Katariina Tiitinen,
Juho Hella,
Tuuli Keskinen,
Pertti Huuskonen,
Jeffrey Culver,
Juhani Linna,
Markku Turunen,
Mounia Ziat,
Roope Raisamo

Affiliations

Jonathan Middleton: Department of Fine and Performing Arts, Eastern Washington University, Cheney, WA, United States
Jonathan Middleton: Tampere Unit for Computer-Human Interaction (TAUCHI), Tampere University, Tampere, Finland
Jaakko Hakulinen: Tampere Unit for Computer-Human Interaction (TAUCHI), Tampere University, Tampere, Finland
Katariina Tiitinen: Tampere Unit for Computer-Human Interaction (TAUCHI), Tampere University, Tampere, Finland
Juho Hella: Tampere Unit for Computer-Human Interaction (TAUCHI), Tampere University, Tampere, Finland
Tuuli Keskinen: Tampere Unit for Computer-Human Interaction (TAUCHI), Tampere University, Tampere, Finland
Pertti Huuskonen: Tampere Unit for Computer-Human Interaction (TAUCHI), Tampere University, Tampere, Finland
Jeffrey Culver: School of Business, Eastern Washington University, Spokane, WA, United States
Juhani Linna: Tampere Unit for Computer-Human Interaction (TAUCHI), Tampere University, Tampere, Finland
Markku Turunen: Tampere Unit for Computer-Human Interaction (TAUCHI), Tampere University, Tampere, Finland
Mounia Ziat: Department of Information Design and Corporate Communication, Bentley University, Waltham, MA, United States
Roope Raisamo: Tampere Unit for Computer-Human Interaction (TAUCHI), Tampere University, Tampere, Finland

DOI: https://doi.org/10.3389/fdata.2023.1206081
Journal volume & issue: Vol. 6

Abstract

Read online

The process of transforming data into sounds for auditory display provides unique user experiences and new perspectives for analyzing and interpreting data. A research study for data transformation to sounds based on musical elements, called data-to-music sonification, reveals how musical characteristics can serve analytical purposes with enhanced user engagement. An existing user engagement scale has been applied to measure engagement levels in three conditions within melodic, rhythmic, and chordal contexts. This article reports findings from a user engagement study with musical traits and states the benefits and challenges of using musical characteristics in sonifications. The results can guide the design of future sonifications of multivariable data.

Published in Frontiers in Big Data

ISSN: 2624-909X (Online)
Publisher: Frontiers Media S.A.
Country of publisher: Switzerland
LCC subjects: Technology: Technology (General): Industrial engineering. Management engineering: Information technology
Website: https://www.frontiersin.org/journals/big-data

About the journal

Abstract

Keywords