Rather than merely copying human musical compositions, the OpenAI team has developed a neural network called JukeBox. The result is music that sounds like a mushy version of familiar songs. It’s quite an impressive feat, considering that the researchers chose music as a challenging domain. While the results are far from perfect, the music produced by JukeBox contains recognizable chords, melodies, and even words.
The process of generating a new song starts with a prior model that learns how music is structured. The top-level Transformer model trains on the distribution of compressed audio tokens. By learning how these audio tokens are distributed, the researchers are able to steer the Jukebox model to play songs of any style. In addition to training the model on music, OpenAI developed a lyric encoder. The new lyric decoder adds query-using layers to the music decoder. The VQ-VAE model, which is trained on 256 NVIDIA V100 graphics cards, contains over 2 million parameters.
To see the sample of OpenAI Jukebox, visit the official website of the project and check out their demos. You can hear some of their songs and decide for yourself if they are a good fit for your taste. If you like what you hear, you’ll want to use the OpenAI Jukebox. You’ll be glad you did. It’s a fascinating and frightening process to hear music without the human element.
Using this program, you can create your own original song. The OpenAI code for the project is available here. It takes about three hours to render 20 seconds of audio. Then, you’ll need a GPU capable of more than 10,000 watts. The NVIDIA Tesla V100 GPU is a $10,000 GPU, but it’s still possible to experiment with short samples in Google Colab. You must note, however, that the platform is limited in memory.
OpenAI has launched a machine learning framework called Jukebox. It uses a neural network to generate music. The framework can generate rudimentary song samples. The software also generates human voices and lyrics. The project is publicly available on GitHub. The developers also included a tool for exploring generated samples. It’s a fun project, and it’s already generating great results! If you’re interested, you can check out Jukebox and make your own music!