There are plenty of music editing and creation tools that utilize GenAI, but Adobe wants to put its own spin on the concept.
Today at Hot Pod Summit in Brooklyn, Adobe announced Project Music GenAI Control. It is a platform that generates audio from text descriptions (such as “happy dance” or “sad jazz”) or reference melodies and allows users to customize the results within it. Workflow.
Project Music GenAI Control allows users to adjust tempo, intensity, repeat patterns, structure, and more. Alternatively, you can extend the track to any length to remix your music or create infinite loops.
Project Music GenAI Control was developed in collaboration with researchers at the University of California and Carnegie Mellon University and will be made publicly available in the future. But for now, it's firmly in the research phase, Gautam Mysore, Adobe's head of audio and video AI research, said during a Hot His Pod panel discussion. The platform doesn't even have a UI yet.
“Now we really understand that AI can sit in the director’s seat and generate music and do a lot of different things with AI,” Mysore added. “[The tool is] I'm generating music, but it's [also] These different forms of control are provided so you can experiment with things. You don't have to be a composer, but you can put your musical ideas out there. ”
As music, artwork, and text created by AI proliferates, GenAI music tools (and GenAI tools in general) are raising ethical and legal concerns.
Using GenAI, homemade tracks that evoke familiar sounds, lyrics, and vocals that can be passed off as authentic, or at least close enough, are going viral. The music label immediately issued a deletion order citing copyright reasons. However, it remains unclear whether “deepfake” music infringes on the intellectual property of artists, labels, and other rights holders, especially in the case of GenAI music tools trained on copyrighted content. Not.
A federal judge ruled in August that AI-generated art cannot be protected by copyright. However, the U.S. Copyright Office has not yet taken an exceptionally strong stance and has only recently begun soliciting public input on copyright issues related to AI. It's also unclear whether users could be charged with violating copyright law if they try to commercialize music created in the style of another artist.
Mysore said Adobe generally develops GenAI tools on data that is under license or in the public domain to avoid potential conflicts with intellectual property issues. (Whether that's the case with Project Music GenAI Control, however, is a mother's opinion.) He added that Adobe is working on watermarking technology to identify audio produced with Project Music GenAI Control. , also acknowledged that it is a work in progress.
“Adobe is taking a particularly responsible approach, [these things,]” added Mysore. “I think there are a lot of really great musicians creating this content.” [they and tools like Project Music GenAI Control] They will coexist. You'll also come up with new musical ideas. ”