
Effective Human-AI Interaction as Observational Learning for Multisensory Creative Fashion Design: Sound(music)-Text-Image Processing
Citation Lee, Y. K. (2025). Effective human-AI interaction as observational learning for multisensory creative fashion design: sound(music)-text-image processing. International Journal of Costume and Fashion, 25(2), 89-100.
Abstract
The rapid advancement of artificial intelligence (AI) increasingly challenges the traditional view of creativity as a uniquely human domain, raising concerns about the erosion of human creative capacities. This study investigates whether incorporating auditory stimuli into visually-driven design activities can enhance creativity, and further explores how multisensory training involving images, language, and music (modern classical) can support human-AI collaboration. An exploratory three-month study was conducted with 23 third-year fashion design students, who engaged with the modern classical piece Cello Sonata No. 1 ‘Gyeongya’ while utilising Generative AI tools (Midjourney, DALL-E 3, and Bing Image Creator) throughout the concept development and design stages. Participants were guided to use linguistic thinking activities to bridge auditory and visual perceptions. The findings demonstrate that multisensory stimulation, particularly when coupled with structured linguistic reflection, facilitated cognitive expansion and enabled the generation of a wider range of visual imagery. These outcomes validate the potential of human-AI interaction in enhancing synergistic creativity by integrating auditory and visual elements. This study contributes to the emerging field of interdisciplinary creative education, offering new insights into how AI technologies and multisensory approaches can be strategically applied to strengthen creative thinking in fashion design pedagogy.
Keywords:
Artificial intelligence (AI), Generative AI, Fashion design pedagogy, Multisensory creativityAcknowledgments
This work was supported by the Ministry of Education of the Republic of Korea and the National Research Foundation of Korea(NRF-2024S1A5A8021365)
References
-
Adel, A. (2022). Future of industry 5.0 in society: human-centric solutions, challenges and prospective research areas. Journal of Cloud Computing, 11(1), 40.
[https://doi.org/10.1186/s13677-022-00314-5]
-
Bandura, A. (2001). Social cognitive theory: An agentic perspective. Annual Review of Psychology, 52(1), 1-26.
[https://doi.org/10.1146/annurev.psych.52.1.1]
-
Greenberg, L. S. & Safran, J. D. (1980). Encoding, information processing and the cognitive behavioural therapies. Canadian Psychology/Psychologie Canadienne, 21(2), 59.
[https://doi.org/10.1037/h0081086]
-
LaBat, K. L. & Sokolowski, S. L. (1999). A three-stage design process applied to an industry-university textile product design project. Clothing and Textiles Research Journal, 17(1), 11-20.
[https://doi.org/10.1177/0887302X9901700102]
-
Lee, Y. K. (2022). How complex systems get engaged in fashion design creation: Using artificial intelligence. Thinking Skills and Creativity, 46, 101137.
[https://doi.org/10.1016/j.tsc.2022.101137]
-
Lee, Y. K. (2024, January). Creative Design Discipline through Convergence of Fashion and Classical Music. In International Textile and Apparel Association Annual Conference Proceedings (Vol. 80, No. 1). Iowa State University Digital Press.
[https://doi.org/10.31274/itaa.17579]
-
Lee, Y. K. & DeLong, M. (2016). Improving Creative Design Skills-The Effects of Past Experience on Apparel Design Education. Journal of the Korean Society of Clothing and Textiles, 40(2), 397-408.
[https://doi.org/10.5850/JKSCT.2016.40.2.397]
-
Muzzio, I. A., Kentros, C., & Kandel, E. (2009). What is remembered? Role of attention on the encoding and retrieval of hippocampal representations. The Journal of physiology, 587(12), 2837-2854.
[https://doi.org/10.1113/jphysiol.2009.172445]
-
Pan, C., Banerjee, J. S., De, D., Sarigiannidis, P., Chakraborty, A., & Bhattacharyya, S. (2023, February). ChatGPT: A OpenAI platform for society 5.0. In Doctoral Symposium on Human Centered Computing (pp. 384-397). Singapore: Springer Nature Singapore.
[https://doi.org/10.1007/978-981-99-3478-2_33]
- Roskies, A. L. (1995). Grounds for synthesis: Mechanisms of retinocollicular map development. University of California press.
-
Shams, L. & Seitz, A. R. (2008). Benefits of multisensory learning. Trends in Cognitive Sciences, 12(11), 411-417.
[https://doi.org/10.1016/j.tics.2008.07.006]