music generation
Music generation is when an artificial intelligence creates new music, including vocals and lyrics, on its own based on a text description or other guidance.
In plain terms
Imagine you have a band that has listened to every possible style and can play anything you ask. You type: 'cheerful summer pop song about Lake Balaton, female vocals,' and within a minute or two the recording is ready. Music-generating AI works roughly like this.
You can quickly and cheaply create music for ads, videos, podcasts, or games with it, and it is also good for testing song ideas and personalized greeting songs. You do not need to read sheet music or play an instrument because you formulate the request in plain language.
A streaming service's recommendation system selects from existing songs, while music generation produces a recording that did not exist before. The system does not splice together song fragments: it learned from vast amounts of music how a song is typically structured and creates new material from this knowledge.
How it works
- Training: the model processes enormous amounts of music, often together with associated descriptions (style, mood, instruments), and learns the patterns of rhythm, melody, harmony, and sound.
- Request: you specify in text what you want, for example genre, mood, tempo, instruments, or even lyrics. Some tools also allow you to provide a hummed melody or a sample recording.
- Generation: the model assembles the sound step by step by breaking it into small units, or gradually 'cleans' the music starting from noise, while continuously adapting to your request.
- Audio rendering: the internal, compressed representation is turned into a playable audio file; many tools include sung vocals as well.
- Refinement: if you are not satisfied, you can request a new version, extend the song, replace a part, or split it into separate tracks to continue in a music editing program.
An everyday example
You are looking for background music for a video of your family holiday, but the video-sharing platform would block your favorite hit for legal reasons. In a music-generation app you type "laid-back, acoustic guitar summer tune, 60 seconds" and use the resulting music under the video.
Who is affected
A common misconception
Limits and risks
- The origin of training data is legally disputed: publishers and rights management organizations have filed multiple lawsuits against music-generation companies for using their recordings without permission.
- The output sometimes strikingly resembles an existing song or an artist's voice, and this can be infringing even if you did not intend to copy.
- Details are difficult to control precisely: with longer songs, the structure may fall apart, sung lyrics may become blurred, and you may get different results for the same request each time.
- It can mimic the voices of real singers, creating opportunities for deception and abuse.
Similar, but not the same
- speech synthesis – Speech synthesis reads written text aloud in a human voice, while music generation creates melody, rhythm, instrumentation, and even vocals.
- recommendation system – A recommendation system selects from existing songs for you, while music generation creates a new song.
- voice cloning – Voice cloning replicates a specific person's voice, while music generation produces a complete musical work, for which a real person's voice is not required.
Related concepts
generative AI, audio generation, generative media
text-to-music, singing voice synthesis, lyrics generation
image generation, video generation, speech synthesis, voice cloning, diffusion model
A brief history
One of the first computer-composed works was the 1957 Illiac Suite, which produced sheet music rather than sound. Among neural models generating finished audio recordings, OpenAI Jukebox appeared in 2020, followed in 2023 by Google's MusicLM and Meta's MusicGen, text-to-music systems. The technology truly reached the general public in 2024, when applications like Suno and Udio enabled anyone to create full songs with vocals.
Where things stand
Apps that turn text into complete songs with vocals are available to anyone, and machine-made music has appeared in large volumes on streaming services. Some of the copyright disputes ended in licensing agreements with the major labels, but the legal situation is still open on many questions.
In the news
- Eminem's publisher and the Elvis estate both sue AI music platform SunoNov 7, 2026 · Jog
- UMG and Sony ask court to make DistroKid hand over AI music upload data in Suno caseOct 19, 2026 · Jog
- Man who defrauded streaming royalties with AI music and bots gets 18 months in prisonOct 7, 2026 · Jog
- Universal and Sony file new copyright lawsuit against SunoSep 21, 2026 · Jog
- Universal Music Group sues DistroKid over AI-generated musicSep 15, 2026 · Jog
- UMG and Sony file second lawsuit against Suno over new modelSep 14, 2026 · Jog
- Canada's largest music rights group sues AI music generatorSep 14, 2026 · Jog
- Suno pulls Mary J. Blige ad calling its AI music generator 'pretty dope'Aug 31, 2026 · Marketing
Also known as
music generation · MI-zene · AI-zene · AI-generated music · generative music · music generation · AI music · text-to-music
Sources
- Agostinelli et al.: MusicLM: Generating Music From Text (arXiv, 2023)
- Dhariwal et al.: Jukebox: A Generative Model for Music (arXiv, 2020)
This entry was machine-edited and has undergone machine expert review; the “In the news” section updates automatically from Agent Age stories.