Illum :
Visuals for ABGT 600 Music Festival
#Generative AI #Media Art #Interactive Visuals
Role
Visual Designer | Visual Researcher
Team
1 Music Producer / MIT Research Scientist
4 MIT PhD Researchers
2 Visual Designers / Researchers
Timeline
3 Months (May 2023 ~ July 2023)
I had the opportunity to collaborate with Norhan Bayomi (a.k.a Nourey), a musician and an MIT Postdoctoral Research Scientist, and the MIT Environmental Solutions Initiative team. I was tasked to create audio-interactive visuals that depict the catastrophic situation of the African Biodiversity using Generative AI. After multiple iterations, the final visuals were showcased at the ABGT 600 Mexico City Music Festival.
Process
Research
Visual Iteration 01
Visual Engineering
Generative AI Design
Post Processing
African Biodiversity Research
Festival Attendee User Research
Reference Study
Festival Showcase
SNS Material Re-frame
Festival Screen Optimization
Visual Iteration 02
Visual Engineering
Generative AI Design
Post Processing
How might we influence music festival attendees of the current catastrophic status of the impact of Human Activities on the African Biodiversity?
Research & Design Engineeering Process
After researching the current situation of Climate Change and its impact on the African Biodiversity, I used Nick Brandt's Photography as a visual inspiration and generated AI images. Then using Touchdesigner as a medium, I made the visual sequence audio-reactive to transition from each visual to the next. Also I used Image Depth algorithms to make the visuals more immersive from 2D to 3D.



Visual Design Iterations
Iteration 01
This version was the outcome of the process above, featuring experimental visuals depicting endangered African biodiversity frame by frame.
However, feedback was given that it was too experimental for a festival visual media settings.
Iteration 02 (Final)
This version was the outcome of utilizing a combination of multiple Generative AI tools.
Received feedback stated that it brought the visuals more to life and conveyed visual storytelling significantly more effectively.
Festival Showcase
The final visuals were showcased during Norhan Bayomi's (a.k.a Nourey) Performance at the ABGT 600 Music Festival in Mexico City with an audience size of 14,000+.
(Illum begins from 38:50)
Reflections
I was honored to work with amazing talented individuals each an expert in their own field. This project was a collaboration across multiple fields including engineering, research, design, and music with the objective of global sustainable impact. Through this opportunity, I learned :
The impact of interdisciplinary team collaboration
Application of Generative AI and Emerging Technologies for storytelling in mass entertainment
The necessity of sustainable action in collaboration with industry-leading figures & celebrities
Norhan presented the team and our project at the MIT SOLVE conference



As a cross-functional team, we ideated how to implement AR experiences for festival attendees at the ABGT Weekender event at the Gorge.
Copyright©2024. All right reserved Sun-Q Kim
