Media & Design

AI Music Generation

Last updated 2026-09-19

What's new

2026-09-19
  • OpenAI is pursuing AI that can help build better AI, a process called recursive self-improvement (AI improving itself over time), which could speed up AI development beyond human control.
  • New research systems, like Dream RSI (a tool that improves how AI searches for solutions), are already showing pieces of recursive self-improvement, with AI handling tasks like finding bugs and writing code much faster than humans.
  • Dream RSI improves AI's problem-solving strategy by learning from past attempts, reducing the number of trials needed to find solutions, and even outperforming other systems in tasks like math optimization and chip design.
  • While AI is getting better at research tasks, humans still hold an advantage in judging which experiments are worth pursuing, a skill that might keep them relevant in AI development for now.
2026-09-16
  • AI agents can create their own languages, like "at D8FB," which humans can't understand, making it hard to monitor and control them.
  • This happens when agents communicate under pressure, like in a medical emergency for an alien, and their language drifts away from human language.
  • Researchers built a tool called Glossogen (a platform for studying AI agent communication) to study this, aiming to involve experts from various fields to understand and address the safety implications.
  • If agents develop their own languages, it could undermine monitoring, interpretability, and interoperability, making it harder to trust and use them safely.
2026-08-31
  • OpenAI's CEO, Sam Altman, predicts the company will have an internal system it considers artificial general intelligence (AGI, AI that can perform any intellectual task a human can) by the end of 2026, with their upcoming Astra model already showing advanced capabilities in research, coding, and cybersecurity.
  • China is making significant strides in AI and robotics, with Unitree unveiling a humanoid robot capable of impressive physical feats, and Bite Dance reportedly training a massive AI model with 10 trillion parameters.
  • OpenAI is developing a portable, screenless AI device called Joanie IV, and Warmwind has launched autonomous cloud AI workers that can operate normal software visually.
  • AI agents are now auditing scientific literature and finding errors that humans had previously missed, demonstrating the potential for AI to enhance productivity and accuracy in various fields.
2026-08-25
  • Always double-check AI’s answers—don’t trust flashy outputs blindly; verify facts and sources yourself.
  • Clean, accurate data is crucial—messy data gives wrong answers faster, even with AI.
  • Use AI for judgment and flexibility, but stick to simple automation for tasks with clear rules.
  • Combine both approaches: let automation handle facts, then use AI to explain or interpret the results.

Key points

What it is

  • AI music generation is using artificial intelligence to create songs, beats, or soundscapes.
  • It shows how advanced AI models have become and the challenges they still face.
  • AI music tools can create professional-sounding songs on regular computers, often for free.
  • It highlights the shift to "agentic AI" (AI that acts on goals) and the need for human input and judgment.

How to use it

  • Start by writing a text prompt (a short description) that sets the style and provide input lyrics.
  • Use settings like CFG (how literally the AI follows your prompt) and the number of steps (higher quality but takes longer) for more control.
  • Edit segments manually after generation to adjust the track, and iterate by building, listening, tweaking, and refining.
  • Use pitch detection (if available) to make the AI sing more accurately.

Watch out for

  • Don't blindly trust the output; develop taste and judgment to decide what deserves your signature.
  • Always apply a feedback loop to train the system to understand your musical taste.
  • Iterate fast and avoid endless tweaks, knowing when to stop is just as important as starting.
  • Listen critically for subtle "AI giveaways" (signs that the music is AI-generated), especially in genres like ambient or guitar-driven pieces.

Tools named

  • Minimax Music (an open-source AI music tool), ElevenLabs Music V2 (an AI music tool that pushes believability)

Lesson 1: What is AI Music Generation and why it matters

AI music generation is the use of artificial intelligence to create songs, beats, or soundscapes. It matters for AI development because it demonstrates how far generative models have come and highlights key challenges in the field. A model like Minimax Music shows practical progress—it’s open-source, only 2.5 GB in size, and can create clean, professional-sounding songs on consumer hardware, running offline for free. Tools like ElevenLabs Music V2 also push believability, though listeners can still notice subtle “AI giveaways” depending on the genre and how the model’s architecture works.

Why does this matter for AI development? First, it shows the shift from simple answers to agentic AI (systems that act on goals). Music generation isn’t just about one output; it’s about following context and using tools to turn a rough idea into a finished track. Second, it exposes a major pitfall: training on AI-generated content can “degrade fast” if the data isn’t good enough. This is a core concern for developers using synthetic data versus real human input. Finally, it underscores the need for human taste and judgment—AI can produce output, but trusting it blindly makes people less productive, as 77% of employees using AI report. In music, a human still shapes the idea, the genre, and the final feel. AI music generation is a concrete example that models are powerful but fragile without proper workflows and oversight.

Sources

Lesson 2: How to use AI Music Generation: step-by-step

To make a song with AI music generation, start by writing a text prompt (a short description) that sets the style. For example, you might type "a warm mid-tempo reggae groove driven by a deep melodic bassline." Along with that, provide input lyrics, like "The drums are beating through the morning light." The AI then generates a full song with vocals from just those two pieces.

If you want more control over the output, look for settings in your tool. One key setting is CFG (how literally the AI follows your prompt). If the song doesn’t match your description, raise the CFG number to make it more faithful. Another setting is the number of steps—more steps usually mean higher quality but take longer to generate.

Some tools, like Minimax music, are open-source and can run offline on your own computer. The smallest model is only 2.5 GB, so it fits on consumer hardware. You can also edit segments manually after generation, as one user did by dragging parts of the track to adjust them.

For a song titled "While My Guitar Gently Speaks," you could prompt with a gentle, acoustic-driven vibe and lyrics like "while my guitar gently speaks." If your tool offers pitch detection, you can use it to make the AI sing more accurately. The key is to iterate—build a rough version, listen, tweak the prompt or settings, and refine until it sounds right.

Sources

Lesson 3: Best practices and pitfalls

AI music tools can produce impressive results, but beginners often trip on the same pitfalls. The biggest mistake is blindly trusting the output. As AI improves, it gets easier to say "that's good enough," but remember your name is attached to the work. If it's bad, you take the blame. Develop taste and judgment; decide what deserves your signature. Always apply a feedback loop: if the AI writes something and you change five things, tell it, "Here are five things I changed. Here's why." Update your instructions so the next version is closer to your preference. This trains the system to understand your musical taste.

Another best practice is iterating fast. Don't plan the perfect track. Build an ugly version quickly, see what breaks, and fix it. Knowing when to stop iterating is just as important—there's no such thing as a finished product, so avoid endless tweaks.

You can also have AI check its own work. Don't be the first set of eyes; get another AI to review the output and feed that feedback back. This produces a more polished result. When generating, provide concrete context like "a warm mid-tempo reggae groove driven by a deep melodic bassline" plus input lyrics. Finally, listen critically. Subtle "AI giveaways" exist—you can hear them with headphones—so pay attention to believability, especially in genres like ambient or guitar-driven pieces like "While My Guitar Gently Weeps."

Sources