Renderu.com
10.0 KPosts
68.3 KFollowers
31.8 MVisits

The Adobe tool that creates music based on textual descriptions

Soft

The generative AI tool from Adobe, called Project Music GenAI Control, is in early stages of development and is designed for creating and editing music. It allows generating music based on textual prompts and then provides fine control for editing the audio according to one's needs.

With Project Music GenAI Control, generative AI becomes your collaborator. It assists people in creating music for their projects, whether they are TV presenters, podcasters, or anyone else in need of sound with the right mood, tone, and length," says Nicholas Bryan, Senior Research Scientist at Adobe Research and one of the creators of the technology. Using a simple user interface, you can transform the generated audio based on the melody you've chosen as an example (foundation), adjust the tempo, structure, and repeating patterns of the musical piece, choose when to increase or decrease the sound intensity, extend the length of the track, remix a segment, or generate a seamlessly looping cycle.

2.png

"Instead of manually slicing existing music to create intros, bumpers, and background sound, Project Music GenAI Control helps users create exactly the fragments they need, solving all workflow issues. "One of the remarkable features of these tools is that they are not just for creating sound - they elevate it, giving creatives the same level of deep control over shaping, tuning, and editing their audio. It's a kind of music management at the pixel level," explains Bryan.

3.png

Project Music GenAI Control is being developed in collaboration with colleagues from the University of California, San Diego, including Zachary Novak, Julian McAuley, and Taylor Berg-Kirkpatrick, as well as colleagues from the School of Computer Science at Carnegie Mellon University, including Shi-Lun Wu, Chris Donahue, and Shinji Watanabe.
As for the legal aspect, Adobe aims to address these issues by developing its tools based on licensed or public domain data to avoid intellectual property violations. The company is also working on watermarking technology that will enable the clear identification of music created using Project Music GenAI Control.

352
Comments:33
post date All languages Only English