Models & Comparisons

Elevenlabs (topic)

Last updated 2026-07-31

What's new

2026-07-31
  • Morgan Stanley has developed an "auto research agent" (a computer program that automates research tasks) to improve financial predictions using AI models like Opus 4.5 and Claude Code.
  • This agent can handle tasks from start to finish, like analyzing data, creating tests, and running experiments, all based on simple instructions in plain language.
  • The system is designed to work with various AI models and improve as those models get better, aiming to maximize profits and integrate smoothly with existing tools.
  • They've released a first version called Alpha Lab 1.0, with all code open-sourced on GitHub, and are now working on improvements based on initial results and failures.

Key points

What it is

  • ElevenLabs is an AI voice platform that creates natural-sounding voice agents (AI programs that can talk like humans) for customer conversations.
  • It shifts AI from text-only to voice-driven, making interactions feel more lifelike and practical for customer service, virtual assistants, or accessibility tools.
  • Unlike simple chatbots, ElevenLabs agents can handle phone calls, in-person kiosks, or voice-activated support.
  • It allows developers to create AI that talks to users in a human-like way, making interactions less robotic and more natural.

How to use it

  • Start by creating a new voice in ElevenLabs and provide a sample recording for voice cloning (copying a person's speaking style).
  • Define your problem (e.g., needing natural-sounding narration) and prepare your script using a tool like Claude (an AI assistant).
  • Follow the step-by-step process: create a new voice, upload a 30-second audio clip, paste your script, and generate the audio.
  • For multi-step workflows, generate audio in ElevenLabs first, then import it into a video tool like HeyGen (a video creation platform).

Watch out for

  • Audio quality may drop when exporting from ElevenLabs to other tools, so always test your exported audio in its intended environment.
  • Use a multi-stage workflow and have a second AI tool review the output to catch mistakes like off-sounding voices or branding inconsistencies.
  • Ensure high-quality input data for voice cloning, as poor quality leads to poor results (garbage in, garbage out).
  • ElevenLabs has strict monetization rules, and revenue sharing may not generate significant income.

Tools named

  • ElevenLabs (AI voice platform for creating natural-sounding voice agents), Claude (AI assistant for writing scripts), HeyGen (video creation platform)

Lesson 1: What is Elevenlabs (topic) and why it matters

ElevenLabs is an AI voice platform that lets you build real-time, natural-sounding voice agents—think of it as giving AI a human-like voice for customer conversations. Unlike a simple chat bot tucked in a website corner, ElevenLabs agents can talk to people naturally, using uploaded business knowledge to answer questions or handle tasks. For AI development, this matters because voice is becoming a key interface for practical AI agents (programs that autonomously complete tasks). The platform allows developers to create customer experience-focused agents that can actually speak, not just type. This shifts AI from a text-only tool to one that can handle phone calls, in-person kiosks, or voice-activated support. In a landscape where many companies claim "AI agent" but deliver clunky chat, ElevenLabs offers a more polished, voice-driven alternative. For beginners, this means you can design an AI that talks to users in a lifelike way, making interactions feel less robotic and more natural. It moves AI development beyond coding and into real-world communication, which is critical for applications like customer service, virtual assistants, or accessibility tools. Understanding ElevenLabs helps you see how voice can make AI more practical and human-centered, a growing focus in the field.

Sources

Lesson 2: How to use Elevenlabs (topic): step-by-step

To start using ElevenLabs, go to the platform and click voices, then create a new voice. You will provide a sample of the voice you want to clone—this is called voice cloning (copying a person's speaking style). ElevenLabs is mostly audio, so you feed it a short recording, and the model learns that voice's tone and inflection.

First, define your problem: you need natural-sounding narration, but standard text-to-speech sounds robotic. ElevenLabs solves this by generating audio that sounds phenomenal compared to raw outputs from other tools.

Next, prepare your script. Use a tool like Claude to write the script and structure it with beats (key points to cover). For example, ask Claude for an intro and for help filling gaps. Then copy that script into ElevenLabs.

Step by step: 1) Go to Voices and create a new voice. 2) Upload a 30-second audio clip of the target speaker. 3) Paste your script into the text box. 4) Click generate. The model will read the script in the cloned voice.

For multi-step workflows, some creators generate audio in ElevenLabs first, then import that audio into a video tool like HeyGen, because ElevenLabs sounds better than raw generation. You can also use ElevenLabs to build voice agents (automated phone or chat voices) by configuring a system prompt and first message inside the platform.

Example: If you need a video voiceover, write the script in Claude, create the voice in ElevenLabs, generate the audio, then combine with visuals. The audio output will match the cloned voice's natural rhythm.

Sources

Lesson 3: Best practices and pitfalls

ElevenLabs has a common problem: audio that sounds great inside the platform can sound poor when exported to other tools. One creator noted that a voice "in 11 Labs, it sounds phenomenal" but after moving it to another app, the quality dropped noticeably. To avoid this pitfall, always test your exported audio in its intended environment before finalizing a project.

A best practice is to use a multi-stage workflow. Generate your initial audio in ElevenLabs, then have a second AI tool review the output. As one guide explains, "make AI check its own work before you do" — feed that feedback back into the tool to "make an even better version." This catches mistakes like off-sounding voices or branding inconsistencies, which can often be "fixed up on a second pass."

Another key mistake is ignoring the quality of your input data. When training an LLM (large language model) from scratch, ElevenLabs emphasizes that you need "very high-quality label data" and a QA (quality assurance) process because "if your QA is not good, you get fired." The same principle applies to voice cloning: garbage in, garbage out.

Finally, remember that ElevenLabs has strict monetization rules. While they offer revenue sharing, one experienced user warns "I never made more than a few hundred bucks off it" despite having one of the most popular voices on the platform for years. Do not expect significant income from sharing your voice clones.

Sources