Marbles of Memories

— An audio reactive visual project based on a generative piece composed using Csound

Csound Code Excerpt

What do memories mean to people? Some are like ripples, leaving beautiful patterns on the surface of water. Some are like smoke in the air, changing their shapes every second. Over time, they evolve. Some are like rocks weathering away into dust, but others are polished by flowing water into shiny and reflective marbles

Marbles of Memories is an audio reactive visual artwork made using TouchDesigner. The goal of the project is to realize the beauty of  generative music by using visual art. The visual patterns are generated according to a live audio input using self-generated music composed in Csound. The patterns are generated using a noise feedback loop, and the generation and position is audio reactive according to the audio frequency and level.

Inspired by Iain Mccurdy’s Csound Haiku, the self-generated music is composed using Csound instruments, and the generation possibilities and music expressions (pitch bend, spatialization, envelope of notes, etc.) are all programmed using Csound opcodes.

Fragment of Lines

— An audio reactive visual work made using TouchDesigner with Ableton

What if lines could break space into fragments? Fragment of Lines is an audio reactive visual project made using TouchDesigner with Ableton. The project combines minimalism visual with Electronic glitch music, discovering different forms of lines in space.

The Visual uses the line component in TouchDesigner transformed by a sphere component. By using TD Ableton, each audio track is connected with different parameters in TouchDesigner, making the visual audio-reactive. The space is divided into two at first, but with the chaos developed, the lines finally breaks the boundary and the space is unified.

The Glitch sounds are a combination of self-made effect chain using Ableton with processed samples. The effect chain using lfo to modulate pitch, fm depth, and other parameters of Ableton’s Operator, processed using effects including grain delay, convolution reverb, and multi-band compressor to create the glitch sound. Vocals are pitch shifted and chopped in align with the glitchy style.

By the Creek

— An audio-visual reactive artwork made using AI generate images with modular synthesizer

By the Creek is an audio-visual artwork done together with Joana Fredrich Sroka using modular synthesizer and AI generated image tool. The purpose of the project is to integrate AI generated images with audio reactive visual.

The idea of the piece is using a self-generated modular synthesizer patch on a Behringer Arp 2600 to generate sounds in nature and using image generation prompts like birds, nature, and minimalism for visual. The visual pattern is generated and modified using a customized built component in TouchDesigner using the compute(r)enderer API. By using stable diffusion, the API enables image generation with short time cost. A particle system is set up to integrate with the AI generated images, and the visual is audio reactive by using TDAbleton.  

Role  played in the project :

Visual designing in TouchDesigner, modular synthesizer patching and recording.