How to create music from text with Google’s MusicLM

137

Have you ever wanted to create music from your own ideas or descriptions? If so, you might be interested in MusicLM, a new experimental AI tool from Google that can turn text into music.

MusicLM is a generative model that can produce high-fidelity music at 24 kHz while being consistent over several minutes and faithful to a text-conditioning signal(google-research.github.io). For example, you can type in “a calming violin melody backed by a distorted guitar riff” and MusicLM will generate a song that matches your description.

To try MusicLM, you need to sign up for AI Test Kitchen, a platform where you can test out various AI experiments from Google. You can access AI Test Kitchen on the web, Android or iOS(blog.google). Once you sign up, you can type in any prompt you like and MusicLM will create two versions of the song for you. You can listen to both and give a trophy to the track that you like better, which will help improve the model(blog.google).

MusicLM is based on a hierarchical sequence-to-sequence model that uses semantic tokens to represent musical concepts such as instruments, genres and emotions(google-research.github.io). It was trained on a large dataset of music-text pairs called MusicCaps, which contains rich text descriptions provided by human experts(google-research.github.io).

To address these issues, Google has implemented several safeguards, such as filtering out any generated music that matches existing songs, adding disclaimers to inform users about the limitations and risks of using MusicLM, and providing feedback mechanisms for users to report any inappropriate or harmful content(google-research.github.io).

Check: How to Signup/Login Google Bard AI and How to Use Bard AI

Google has also been working with musicians like Dan Deacon and hosting workshops to see how this technology can empower the creative process. They have showcased some examples of how MusicLM can generate music from rich captions, long prompts or story mode(google-research.github.io)(blog.google).

Whether you’re a professional musician or just starting out, MusicLM is an experimental tool that can help you express your creativity. Sign up to test MusicLM today and see what kind of music you can create from text!

Here are some possible steps for creating music from text with Google’s MusicLM:

  1. Sign up for AI Test Kitchen on the web, Android or iOS.
  1. Type in a text prompt that describes the kind of music you want to create, such as “a soothing piano piece with rain sounds”.
  1. Wait for MusicLM to generate two versions of the song for you.
  1. Listen to both versions and give a trophy to the one that you like better.
  1. Repeat the process with different prompts or melodies until you are satisfied with your music.

Conclusion:

MusicLM is an AI tool that can create music from text. You can try it by signing up for AI Test Kitchen and typing in any prompt. MusicLM is fun, creative and innovative, but also ethically challenging. Sign up to test MusicLM today and create your own music from text!