From Trends to Experiences: Co-Creation with Generative Artificial Intelligence in Developing Interactive Multimedia Applications

Abstract

The emergence of generative artificial intelligence (GenAI) tools has ushered in new possibilities for creating diverse content, encompassing text, images, sound, videos, 3D objects, and even code for programming languages. Within this dynamic landscape, both significant challenges and opportunities arise in the field of interactive multimedia application development. It is imperative that the evolving trends in the utilization of these tools metamorphose into experiences that not only reflect but also facilitate the replication of models, methods, and development approaches. This paper contributes to the academic discourse by presenting three distinct development experiences. Each experience represents the initial steps of an incremental exploration process, thus contributing to exploratory research in this domain. These experiences are presented as case studies, with the first one analyzed retrospectively, and the latter two deliberately designed to scrutinize the challenges and opportunities associated with integrating generative artificial intelligence into the software development process, playing a significant role in a co-creation process. The results presented are qualitative, with detailed independent analyses for each case study, offering a comprehensive description of the findings. Thus, this paper presents a set of recommendations facilitating the transfer, replication, and improvement of these experiences by other multimedia development labs or teams.

Keywords

• Generative Artificial Intelligence
• Prompt Engineering
• Multimedia Development and Production
• Interactive Multimedia Applications
• Co-Creation