Stability AI, known for its AI art generator Stable Diffusion, has launched Stable Audio Open, a free and open source model for creating short audio clips.
Stable audio is turned on Allows users to generate high-quality audio samples for use in sound design. It uses simple text descriptions to create clips up to 47 seconds long.
It is designed for creating sound effects, drum beats, instrument riffs, atmospheres, and other production elements commonly used in music and sound design.
The open source model enables users to fine-tune the product with their own custom audio data. This allows musicians such as drummers to train the model on their own drum recordings to generate new, unique beats in their own style.
The release of Stable Audio Open comes on Stable Audio 1.0 September 2023. Time Magazine’s Best Inventions of 2023, Allows users to create short audio clips based on text descriptions.
The latest iteration, Stable Audio 2.0, announced in April this year. This update provides artists and musicians with a wider range of creative tools and the ability to produce complete music tracks.
“Our commercially stable audio products generate high-quality, complete tracks with coherent musical structures of up to three minutes, as well as advanced features such as audio-to-audio generation and coherent multi-part musical compositions.”
Stable artificial intelligence
Stable Audio Open, meanwhile, is designed for shorter audio clips and production elements. While it can produce short snippets of music, it’s not optimized for creating complete songs, melodies, or vocals.
Stability AI said in a statement: “Our commercial Stable Audio products produce high-quality, complete tracks with coherent musical structures up to three minutes in length, and feature advanced features such as audio-to-audio generation and coherent multi-part musical compositions. .
Stable Audio Open model weights can be downloaded at: Face hugging, a machine learning model platform. Stability AI encourages sound designers, musicians, developers, and anyone interested in audio to explore the model’s capabilities and provide feedback.
The release of Stable Audio Open comes amid growing debate over the use of artificial intelligence in the music industry, particularly around copyright.
Ed Newton-RexStability AI’s former vice president of audio resigned at the end of 2023, citing disagreements over the use of copyrighted material in training data sets.
Newton-Rex said: “Billion-dollar companies are training artificial intelligence models on creators’ works without permission, and then using these models to create new content, which in many cases can be compared with the original work. Works compete.
Newton-Rex, who helped develop Stable Audio, said in a public resignation letter: “I don’t understand how this can be accepted in a society that has an established creative arts economy where creators rely on copyright.”
Stability AI says its new model was trained on a dataset of audio clips free voice and free music archives,.
“This allows us to create an open audio model while respecting creators’ rights,” the company said.
global music business
