Immersive Techniques and Artificial Intelligence in Contemporary Audiovisual Creation

Authors

DOI:

https://doi.org/10.36025/arj.v13i1.39150

Keywords:

artificial intelligence, audiovisual creation, immersion, artistic techniques, aesthetics

Abstract

Artificial Intelligence dazzles with its promise and revolutionizes all cultural creation, especially that most closely related to audiovisual, but also with many of the practices in the hybrid space between immersion and hybrid artistic projects. Its presence has disrupted the limits of what is possible in the immersion of the spectator, leading to a rapid advance in the field and the proliferation of projects in this line. Next, a tour is made throughout the current audiovisual creative panorama to analyze the current implication and impact of artificial intelligence in immersive techniques, as well as addressing ethical questions and reflections that arise as a result of its application, around authorship, the transformation of collaboration in creation.

Downloads

Download data is not yet available.

Author Biographies

Manuel Mari-Altozano, Universidad de Málaga (UMA)

Manuel Emilio Marí Altozano is a predoctoral FPU student in the Department of Audiovisual Communication and Advertising at the University of Malaga. He has a Master's degree in Audiovisual Creation and Performing Arts. In recent years, he has performed musical premieres both in Spain and in European countries such as Sweden and Italy. He is currently complementing his training with a Master's degree in Teaching at the UMA and a Degree in Orchestra Conducting at the CSM Málaga.

Ana Sedeño-Valdellós, Universidad de Málaga (UMA)

Ana María Sedeño-Valdellós is PhD in Audiovisual Communication and Professor in the Department of Audiovisual Communication and Advertising at the University of Malaga (Spain). Her research deals with music in relation to audiovisual media and audiovisual practices in the contemporary scene from an historical or educational perspective, with special emphasis on facts art as the VJ, the mapping or videodance. In connection with them she has published several books such as Language of the music video, Contemporary Music in Film, Analysis of contemporary cinema: aesthetic strategies, narrative and staging or History of video art in Spain. Some of her articles are published in several academics journals.

References

AGRUP LAB, S. Immersive experience in the world of art. REM Experience. 2013. Disponível em: https://remexperience.com/en/proyecto/paintings/. Acesso em: 21 dez. 2024.

ANANTRASIRICHAI, N.; GILCHRIST Iain; BULL David. Fixation identification for low-sample-rate mobile eye trackers. In: IEEE international conference on image processing (ICIP), p. 3126-3130, 2016. DOI: 10.1109/ICIP.2016.7532935.

BARALE, Alice.”Se parla da sola”: Incontri teatrali tra umani e IA. Etica e Politica/ Ethics & Politics, XXVI, n. 3, p. 71-86, 2024. Disponível em: https://sites.units.it/etica/2024_3/BARALE.pdf. Acesso em: 15 jan. 2025.

EDMONDS, Ernst. The Art of Interaction: What HCI Can Learn from Interactive Art. In: J. M. CARROLL (ed.). Synthesis Lectures on Human Centered Informatics. v. 3. 2018.

CAVAZZA, Marc; LUGRIN, Jean-Luc; HARTLEY, Simon; LE RENARD, Mark; NANDI, Alok; JACOBSON, Jephrey; CROOKS, Sean. Intelligent virtual environments for virtual reality art. Computers & graphics, v. 29, n. 6, p. 852-861, 2005. https://doi.org/10.1016/j.cag.2005.09.002.

CHEN, Xu, SUN, C., SUN, Yiqun y ZHOU, Haibo.Artificial Aesthetics and Ethical Ambiguity: Exploring Business Ethics in the Context of AI-driven Creativity. Journal of Business Ethics, 2024 https://doi.org/10.1007/s10551-024-05837-2.

EINBOND, Aaron, CARPENTIER, Thibaut, SCHWARZ, Diemo y BRESSON, Jean. Embodying Spatial Sound Synthesis with AI in Two Compositions for Instruments and 3-D Electronics. Computer Music Journal, v. 46, n. 4, p. 43-61, 2022. https://doi.org/10.1162/comj_a_00664.

FAN, Mingming y WEN, Cha. Research on Interactive Art Form Based on Artificial Intelligence Technology. 2019 International Conference on Literature, Art and Human Development (ICLAHD 2019), p. 139-144, 2019. https://doi.org/10.25236/iclahd.2019.027.

FLATHERS, Mathew; SMITH, Griffin; WAGNER, Ellen; FISHER, Carl; TOROUS, John. AI depictions of psychiatric diagnoses: a preliminary study of generative image outputs in Midjourney V.6 and DALL-E 3. BMJ Ment Health, 27:e301298, 2024. https://doi.org/10.1136/bmjment-2024-301298.

KESWANI, Bright; MOHAPATRA, Ambarish; MISHRA, Tarini; KESWANI, Poonam; MOHAPATRA, Pradeep; AKHTAR, Md Mobin; VIJAY, Prity. World of Virtual Reality (VR) in Healthcare. In: GUPTA, D.; HASSANIEN, A.; KHANNA, A. (ed.). Advanced Computational Intelligence Techniques for Virtual Reality in Healthcare. Studies in Computational Intelligence, vol 875. Cham: Springer, 2020. https://doi.org/10.1007/978-3-030-35252-3_1.

KITSON, Alexandra; MUNTEAN, Reese; DIPAOLA, Steve; RIECKE, Bernhard. Lucid Loop: Exploring the Parallels between Immersive Experiences and Lucid Dreaming. Designing Interactive Systems Conference, p. 865-880, 2022. https://doi.org/10.1145/3532106.3533538.

KNOTTS, Shelley; COLLINS, Nick. A survey on the uptake of Music AI Software. Proceedings of International Conference on New Interfaces for Musical Expression (NIME), p. 499-504, 2020. Disponível em: https://www.nime.org/proceedings/2020/nime2020_paper95.pdf.

KUMAR, Abhishek. Gamification in training with next generation AI– virtual reality, animation design and immersive technology. Journal of Experimental & Theoretical Artificial Intelligence, v. 36, n. 7, p. 1121-1134, 2022. https://doi.org/10.1080/0952813X.2022.2125080.

KUTA, Sarah. Art made with artificial intelligence wins at state fair. Smithsonian Magazine, 6 set. 2022. Disponível em: https://www.smithsonianmag.com/smart-news/artificial-intelligence-art-wins-colorado-state-fair-180980703/ Acesso em: 25 nov. 2024.

LI, Blanca. Blanca Li, 2020. https://www.blancali.com/.

MANOVICH, Lev. AI Aesthetics. Moscou: Strelka Press, 2018.

MANOVICH, Lev. El software toma el mando. Barcelona: UOC, 2013.

MARÍ-ALTOZANO, Manuel Emilio; SEDEÑO-VALDELLÓS, Ana. Arte audiovisual inmersivo: antecedentes y líneas futuras. Fonseca, Journal of Communication, v. 28, n.1, p. 259-275, 2024. https://doi.org/10.48047/fjc.28.01.18.

MARTI TESTÓN, Ana. Hacia una museografía 4.0. Diseño de experiencias inmersivas con dispositivos de realidad aumentada. Tesis doctoral. Universitat Politècnica de València, 2018.

MILLER, Arthur. Can AI Be Truly Creative? An Article in American Scientist. Sigma XI, p. 244-249, 2020. Disponível em: https://arthurimiller.com/articles/can-ai-be-truly-creative-an-article-in-american-scientist/. Acesso em: 03 jan. 2025.

LAVER, Kate; LANGE, Belinda; GEORGE Stacey; DEUTSCH Judith; SAPOSNIK Gustavo; CROTTY, Maria. Virtual reality for stroke rehabilitation. Cochrane Database System Review v. 11, n. 11, p. 1-183, 2017. https://doi.org/10.1002/14651858.cd008349.pub4.

NG, Adrian; CHAN, Leith; LAU, Henry. A study of cybersickness and sensory conflict theory using a motion-coupled virtual reality system. Displays v. 61, p. 101922, 2020. https://doi.org/10.1016/j.displa.2019.08.004.

NINGH, Zhen; ZHANG, Zheng; BAN, Jerry; JING, Kaiwen; GAN, Ruohong; TIAN, Yapeng; LI, Toby. Mimosa: Human-AI Co-Creation of Computational Spatial Audio Effects on Videos. Proceedings of the 16 th conference on creativity and cognition, p. 156-169, 2024. https://doi.org/10.1145/3635636.3656189.

PARK, Jeonyeon; KANG, Hyunmin; KIM, Ha Yang. Human, Do You Think This Painting is the Work of a Real Artist? International Journal of Human-Computer Interaction, v. 40, n. 18, p. 5171-5191, 2023. https://doi.org/10.1080/10447318.2023.2232978.

PICINALI, Lorenzo; KATZ, Brian; GERONAZZO, Michele; MAJDAK, P.; REYES-LECUONA, Arcadio; VINCIARELLI, Alessandro. The SONICOM Project: Artificial Intelligence-Driven Immersive Audio, From Personalization to Modeling. IEEE Signacl Processing Magazine, v. 39, n. 6, p. 85-88, 2022. https://doi.org/10.1109/MSP.2022.3182929.

REN, Zhen. The role of AI in theatre: Exploring the creation of AI-generated stage plays. Theoretical and Natural Science, v. 34, n. 1, p. 27-32, 2024. https://doi.org/10.54254/2753-8818/34/20241146.

RODRIGUEZ, Veronica. Experiencias de teatro en realidad virtual. IamVR, 27, mar. 2021. Disponível em: https://i-amvr.com/experiencias-de-teatro-en-realidad-virtual/. Acesso em: 10 fev. 2025.

SAFADI, Firas; FONTENEAU, Raphael; ERNST, Damien. Artificial Intelligence in Video Games: Towards a Unified Framework. International Journal of Computer Games Technology, 15, 2015.

TAKACS, Barnabas; VINCZE, Zsuzsanna. Deep authoring – an AI Tool set for creating immersive MultiMedia experiences. Multimedia Tools and Applications, v. 80, n. 20, 31105-31134, 2021. https://doi.org/10.1007/s11042-020-10275-z.

TRAPARIC, David; LARABI, Mohammed Chakry; BELLATRECHE, Ladjel. Towards Automatic Content Generation for Immersive Cinema Theater Based on Artificial Intelligence. En IEEE 25th International Workshop on Multimedia Signal Processing (MMSP), Poitiers: France, 2023, p. 1-6. Disponível em: https://ieeexplore.ieee.org/document/10337685.

WAGSTAFF, Kiri Lee. Machine learning that matters. Proceedings of the 29th International Coference on International Conference on Machine Learning, p. 1851-1856, 2012. Disponível em: https://arxiv.org/abs/1206.4656.

WEST, Ruth y BURBANO, Andrés. AI, Arts & Design: Questioning Learning Machines. Artnodes, v. 26, p. 1-9, 2020. https://doi.org/10.7238/a.v0i26.3390.

WU, Zhen. Theatre of Tomorrow – A Virtual Exhibition and Performing Arts Platform Created by Digital Game Technology. In: CIANCARINI, Paolom DI IORIO, Angelo, HLAVACS, Helmut, y POGGI, Franceso, Entertainment Computing – ICEC 2023 (p. 426-437). Springer Nature Singapore. Disponível em: https://link.springer.com/chapter/10.1007/978-981-99-8248-6_41.

WU, Yunxuan. Application of Artificial Intelligence within Virtual Reality for Production of Digital Media Art. Computacional intelligence and neuroscience, 2022. https://doi.org/10.1155/2022/3781750.

Published

10-06-2026

How to Cite

MARI-ALTOZANO, Manuel; SEDEÑO-VALDELLÓS, Ana. Immersive Techniques and Artificial Intelligence in Contemporary Audiovisual Creation. Art Research Journal: Revista de Pesquisa em Artes, Natal, v. 13, n. 1, 2026. DOI: 10.36025/arj.v13i1.39150. Disponível em: https://www.periodicos.ufrn.br/artresearchjournal/article/view/39150. Acesso em: 18 jun. 2026.