OpenAI Developing Generative Music Tool - AI Music News

OpenAI's New Music Generation Tool

According to a report published by The Information, OpenAI is currently developing a novel tool capable of creating music from both textual descriptions and audio inputs.

This forthcoming technology is envisioned to enhance existing video content with musical scores, or to provide instrumental backing, such as guitar accompaniment, to pre-recorded vocals. Details regarding the release timeline remain uncertain.

Potential Integration and Availability

It is currently unknown whether OpenAI intends to release this music generation capability as a separate, independent product. Alternatively, it could be integrated directly into existing OpenAI platforms like ChatGPT and their video generation application, Sora.

Data Training and Collaboration

To facilitate the training of this new model, OpenAI is reportedly collaborating with students from the prestigious Juilliard School. These students are involved in the annotation of musical scores, providing valuable training data for the system.

Previous and Current Audio Focus

While OpenAI has previously experimented with generative music models, these were developed prior to the widespread adoption of ChatGPT. Recent efforts have concentrated on audio models specializing in text-to-speech and speech-to-text functionalities.

Competitive Landscape

OpenAI is not alone in the development of generative music technologies. Other prominent companies, including Google and Suno, are also actively pursuing similar advancements in the field.

TechCrunch has contacted OpenAI seeking further clarification and comment on this developing story.