PixelAudio: A toolkit for intermedia composition

<p xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" class="first" dir="auto" id="d4047968e55">PixelAudio is a Java software library for the Processing development environment. It offers a toolkit for intermedia composition where images and audio signals are mapped onto each other. Features include curve drawing to activate audio sampling and additive audio synthesis for simultaneous sound and pattern generation. PixelAudio builds on historical experiments with cross-modal sensory instruments such as colour organs and lumia, and more recent experiments in digital transcoding, glitch, and intermedia experiences. The library tools fill out a theoretical niche in musical/visual composition that sits above simple data equivalence (“bytes are bytes”) and advances towards the interplay of compositional structures that can be passed back and forth between different media.