Controllable Music Generation via MIDI-DDSP

Hena Ghonia, Krishna Maneesha Dendukuri

Keywords: DDSP, Music Synthesis, Generative Model, Music, Audio

Abstract: Recently, there has been a lot of fascinating work focusing on making music generation for a larger and more general audience. However, these models could be of great help to the artists if they can intervene into the generation process at multiple levels in order to control what notes are played and how they are performed. We hence dive deeper into MIDI-DDSP that helps with high-fidelity generations using an interpretable hierarchy with several degrees of granularity, also allowing creators of varied musical experiences to produce music.

Blogpost Url: https://iclr-blogposts.github.io/staging/blog/2023/controllable-music-generation-via-midi-ddsp

ICLR Papers: https://openreview.net/forum?id=UseMOjWENv, https://openreview.net/forum?id=B1x1ma4tDr

ID Of The Authors Of The ICLR Paper: ~Yusong_Wu1, ~Ethan_Manilow1, ~Cheng-Zhi_Anna_Huang1, ~Jesse_Engel1, ~Adam_Roberts1

Conflict Of Interest: Yes