MusicLM

MusicLM is a text-to-music model from Google that generates music from text descriptions like "a calming violin melody backed by a distorted guitar riff".

It builds on AudioLM, modelling music as a hierarchy of discrete audio tokens: semantic tokens for long-term structure, and acoustic tokens from the SoundStream codec for the fine audio details.

From paper MusicLM: Generating Music From Text.