Machine Listening as Sonification

Machine listening takes place through sonification. Sound is treated as data by a computer that listens by deconstructing and reconstructing sound. To better explore the aesthetic, relational and ontological aspects of machine listening, this article reflects upon the Fourier analysis, which is vital for machine learning algorithms. It then outlines the listening modes articulated by French composer Pierre Schaeffer and updates them for the new material conditions of contemporary listening. It proposes that a new mode, identified while working with sonification, be added to Schaeffer’s classic array. It explores non-human listening among machines that listen with other concerns beyond the human need to interpret content. Thus, this article makes a particular strategic move: it centres around machine listening, which enables computers to perform analyses of a soundscape, and resynthesis, a mode of sonification that treats sound as data, to reintroduce the ‘sound object’ nature of resynthesised sounds. It looks at sonification through discourse analysis and media archaeology, and gives importance to experiments in art that privilege sensorial and affective dimensions often ignored by scientific approaches. It proposes that thinking about machine listening through sonification can assist in developing sensibilities that are more responsive to the present sonic ecologies between human and non-human listeners.