Product launch · XiaoHu explains

Tongyi releases Qwen-Audio-3.0-TTS, a speech model that can speak 16 languages and 20 dialects from a single voice sample

Speaker similarity ranks first across all 16 languages, and it still works when the reference audio has background noise. This round only ships as an API — no weights.
60-second rundown
  • Clone someone's voice and have it speak another language, and the timbre often turns into a different person entirely; add a bit of noise or echo to the reference clip and the whole thing falls apart.
  • Tongyi Lab has released Qwen-Audio-3.0-TTS in two tiers — Flash and Plus — accessed through Alibaba Cloud Bailian's API, with Flash hitting first-packet latency in the low hundreds of milliseconds.
  • One reference clip can speak across 16 languages without the voice drifting: on CV3-Eval, it ranks first in speaker similarity across all 16 languages, with Plus averaging 82.75 (out of 100 — the closer to 100, the more it sounds like the original speaker).
  • Pronunciation accuracy isn't a clean sweep: average word error rate lands at 3.87 (Flash) and 3.96 (Plus), lowest in 10 of the 16 languages, with rivals beating it on the remaining 6.
  • Writing tags like [angry] or [giggles] straight into the text controls emotion and sound effects — 31 of them are documented officially. But this generation doesn't ship weights; running it locally still means falling back to the Qwen3-TTS open-sourced in January.
This is a product launch page — the benchmark and comparison numbers come from the releasing team, who also picked the eval sets and rivals. This piece adds context pulled from Alibaba Cloud's API docs, the arXiv paper, and the HuggingFace model hub; sources are listed at the bottom.
Launch

Tongyi just released a speech model that speaks 16 languages

Tongyi Lab launched the text-to-speech model Qwen-Audio-3.0-TTS on July 20.

It ships in two tiers: Flash chases speed, with first-packet latency (the wait between sending a request and hearing the first sound) down in the low hundreds of milliseconds — built for voice assistants and customer service, where the audio needs to start playing while it's still generating. Plus chases quality, prioritizing timbre fidelity and natural delivery — built for audiobooks and voiceover work.
🎙Why it's worth a listen: feed it one reference clip and have it speak 16 languages, and speaker similarity ranks first across all 16 languages, averaging 82.75. It also covers 20 Chinese dialect regions and can generate up to 3 minutes of continuous audio in one go.

Listen to it first. The clips below are the same voice speaking across languages: the reference is one line of Chinese, then the model reads out English, Japanese, and Korean using that voice. Don't worry about whether the pronunciation is correct — just listen for whether it still sounds like the same person.

One voice, three languages
Reference audio one line of Chinese, that's all it gets
加菲迪曾经代表巴西国家足球队。
Generated · English
Many Christians are well-educated, but cannot rise to positions of responsibility.
Generated · Japanese
歴史的世界においては、過去は単に過ぎ去ったものではない、プラトンのいう如く非有が有である。
Generated · Korean
가을철 들면서부터 덕호는 읍의 출입이 잦아졌다.
Audio pulled from the launch page's Cross-lingual In-context Generation section, transcoded to mp3 here for easier loading.

Of the 16 supported languages, 7 are new this generation, clustered around Southeast Asia and the Middle East:

16 languages · ★ marks the 7 new additions
Chinese · English · Japanese · Korean
German · French · Spanish · Italian
Russian · Portuguese ★
Arabic ★ · Indonesian ★ · Malay ★
Thai ★ · Vietnamese ★ · Filipino ★

None of these were supported by the earlier open-source model, so products targeting Southeast Asia now have an option they didn't before.

Keeping the voice steady across languages is hard because timbre and pronunciation habits are tangled together. When a model learns someone's voice, it tends to learn their native accent as a package deal — switch to another language, and the pronunciation has to reorganize itself, dragging the timbre along with it.

Dialects

It can speak 20 regional Chinese dialects

This is the easiest one for Chinese readers to judge for themselves, since you can usually tell right away when something sounds off. Give it a dialect reference clip, and it uses that same voice to read a different dialect passage.

Cantonese
Reference audio
Generated
乜部手机又窒下窒下噉嘅?揿嚟揿去都冇反应,真系迟早畀佢激死!
Shanghainese
Reference audio
Generated
今朝银行扣房贷了,每个月工资大半侪拨了伊拉。迭个日子阿里一天是个头啊?
The launch page gives one sample pair for each of its 20 dialect regions; these are just two of them. The text is straight from the launch page — everyday grumbling, not news-anchor delivery.

The 20 dialect regions on the launch page span this range:

Northeast
Northeastern Mandarin
North China
Hebei · Shanxi
Shandong · Qingdao
Northwest
Shaanxi · Gansu
Ningxia
Central China
Henan · Hubei
Hunan
East China
Shanghainese · Hangzhou
Ningbo · Jiangxi
Southwest
Sichuan · Chongqing
Guizhou · Yunnan
South China
Cantonese
Dirty reference audio

It can still clone a voice from a noisy reference clip

In the real world, reference audio rarely comes at studio quality. Record something on your phone in an office and you pick up AC hum and keyboard clatter; record it in a conference room and the room's echo sits on top of the voice. Both used to wreck the cloning results.

The old fix was to add a pre-processing step: run noise reduction to clean up the reference clip before feeding it into the cloning pipeline. The problem is that noise reduction erases timbre detail along with the noise — the cleaner it scrubs, the more the voice sounds sanded down, and the clone ends up sounding less like the original speaker, not more.

The old approach

Noisy reference audio → run it through a noise-reduction module → clone. Noise reduction is a separate step that has no idea it needs to preserve timbre, so scrubbing the noise wipes out timbre detail with it.

This time

Training used noisy, reverberant reference audio from the start, so speech enhancement is baked directly into the cloning pipeline. At inference time there's no separate denoising pass to switch on — the model suppresses reverb and noise on its own while keeping the timbre intact.

The difference is audible in this next set. The reference clip is a noticeably noisy Chinese recording, with three outputs from the model itself and a comparison model.

Cloning results from a noisy reference clip
Reference audio noisy
Qwen-Audio-3.0-TTS
帆船在平静的海面上缓缓移动,白色的帆被夕阳染成了金色。船员们站在甲板上,沉默地望着远处逐渐清晰的海岸线。
CosyVoice 3.0-1.5B comparison
Comparison sample chosen by the releasing team, taken from the launch page's Acoustic Robustness section, noisy·zh set.

The launch page tests three kinds of degraded input: noise, reverb, and muffled reference audio (like phone-call bandwidth with the high frequencies cut off).

Controllability

You can direct it with plain-language instructions

Controlling tone used to mean tweaking a pile of acoustic parameters — pitch, speed multiplier, energy envelope. This generation gives you two layers of control, neither of which touches a parameter.

Layer one: natural-language instructions
A single sentence describing the character, emotion, setting, and pace sets the tone for the whole passage. It takes instructions in both Chinese and English.
Layer two: tags written into the text
Drop a bracketed tag into the text to control the delivery from that point onward, or to insert a single laugh or intake of breath at that exact spot.

Describe the effect you want in a sentence

Instructions can be casual or structured. Samples on the launch page range from everyday phrasing like Please read this gently and slowly, like a bedtime story. to structured setups like Character: female morning-radio music host. Setting: opening the show, upbeat but restrained energy. Style: bright, warm, light rhythm. Pace: slightly fast. It also accepts JSON, for example {"speed": "fast", "volume": "loud", "rhythm": "urgent"}.

Instruction: read gently and slowly, like a bedtime story
Reference audio its original delivery
Generated from the instruction
孩子,睡吧。月亮婆婆已经出来了。窗外的风轻轻地吹,像在唱着摇篮曲。

Insert a tag to control one specific spot

The instruction sets the overall tone; tags control specific spots. There are two kinds: control tags set an emotion or style that holds from where the tag appears until the next control tag shows up, or until the sentence gets auto-split for running too long; sound-effect tags drop in a single sound effect at that exact position without touching the emotion around it.

Tag: [excited]
Reference audio
Generated from tagged text
[excited] 哇!快看外面的雪!积雪已经有十几厘米厚了,我们赶紧下楼去堆雪人、打雪仗吧!
Copy-paste ready

Alibaba Cloud's API docs publish the full tag table: 24 control tags plus 7 sound-effect tags, 31 total. The launch page separately claims 86 new fine-grained tags this generation — the two numbers don't line up, and the gap isn't explained in either place.

Control tags (affect delivery going forward)Meaning
[sad] [crying]Sad / tearful
[angry] [shouting]Angry / shouting
[deep and loud shouting]Deep, loud shouting
[excited] [amazed]Excited / amazed
[panicked] [trembling]Panicked / trembling
[sarcastic] [scornful]Sarcastic / scornful
[curious] [serious]Curious / serious
[bored] [tired]Bored / tired
[empathetic] [reluctantly]Empathetic / reluctant
[mischievously]Mischievous
[whispers] [asmr]Whispering / ASMR-soft
[singing]Singing
[like dracula]Dracula-style, deep and eerie
[very slowly] [very fast]Very slow / very fast pace
Sound-effect tags (insert at that exact spot)Meaning
[gasp]Sharp intake of breath
[sighing]Sigh
[clears throat]Throat clear
[giggles]Giggle
[laughing]Laugh
[cough]Cough
[snorts]Snort
Mixing both tag types
[excited]What a beautiful day today![laughing]Let's go out and have fun together!
Switching emotion mid-passage
[serious]Please pay attention to the safety precautions.[excited]Alright, let's get started now!

One limitation worth flagging: tags only work in unidirectional streaming mode — meaning the full text is sent up front and the audio streams back. If you want two-way real-time conversation where audio plays while you're still typing, tags won't work there.

Mechanism

How it gets both fast and stable

The part that makes it fast is carried over from the previous generation; what's actually new this time is the training pipeline. Two separate things to look at.

Slicing one second into 12.5 chunks

Generating speech takes two steps: first chop the audio into small discrete units, then generate those units one chunk at a time, and finally reconstruct the sound wave from them. How densely it's chopped is the frame rate. A higher frame rate means more chunks to generate per second, which means slower generation; drop the frame rate and there are fewer steps, so it's naturally faster. This generation runs at 12.5 Hz — 12.5 chunks per second.

An analogy

Think of it like turning a recording into stop-motion animation: one second built from 25 frames versus 12. Fewer frames draw faster, but each frame has to carry more information or the motion starts to jump. That's the hard part of dropping the frame rate — fewer chunks means it's easier to lose content and timbre.

Here's how each frame carries more information: 16 layers of encoding are stacked onto every chunk, trading depth for density, using layer count to catch the detail that a lower frame rate would otherwise drop. This tokenizer isn't new to this release either — it was already in use back in January's Qwen3-TTS, and it was open-sourced alongside that model; its technical report cites a first-packet time of 97 milliseconds.

Same one second of speech, sliced into how many chunks Higher frame rate More generation steps 12.5 Hz What this generation uses 1 second Half the chunks means half the generation steps
Illustrative diagram showing the relationship between frame rate and generation steps. The top row uses a common reference rate around 25 Hz for comparison; the bottom row is the 12.5 Hz this generation actually runs at.

Making up the loss in five steps

The speed gained by dropping the frame rate has to be paid back through the training pipeline, in content accuracy and voice stability. That pipeline is what's actually new this round. Two components to separate first: the LM decides, from the text, which speech units to say; the FM turns those units back into audible sound waves. One reads the sheet music and picks which notes to play; the other actually plays them.

The five-step arc is "train each piece on its own first, then join them and train together, then circle back and patch each one's specific weak spot." The first two steps lay the foundation; the last three are targeted fixes — the LM's weak spot is mispronunciation and stiff delivery, the FM's weak spot is collapsing on dirty reference audio and not preserving timbre well enough.

1
Pretrain LM and FM separately
The two components train on their own first, without constraining each other.
2
Joint training, annealed with high-quality data at the end
The two components are joined and trained together; the final stretch switches to high-quality data to lift overall quality.
Fixes: overall coordination
3
LM reinforcement learning
Specifically fixes pronunciation accuracy and how natural the delivery sounds.
Targets: pronunciation accuracy · natural delivery
4
FM robustness training
Trained on noisy, reverberant reference audio so it can still produce clean output from dirty input.
Fixes: dirty reference audio
5
FM reinforcement learning
Fixes the sound quality itself and how faithfully the timbre is reproduced.
Fixes: audio quality · timbre fidelity

Beyond these five steps, the launch page mentions two more supporting capabilities: a reproducible speaker fine-tuning pipeline for adapting the model to a specific voice, and vocoder super-resolution for outputting 48 kHz audio. The launch notes mark 48 kHz output as coming soon; the preset voice library covering all 16 languages is already live, so you can pick a built-in voice without cloning one first.

Benchmarks

Where it wins, and where it loses

Benchmarks ran on CV3-Eval across all 16 languages, against MiniMax-Speech-2.8-HD-API, ElevenLabs-v3-API, DotsTTS-SOAR (10-step sampling), VoxCPM2, and the company's own Qwen3-TTS-1.7B-Base open-sourced back in January. Two radar charts — farther from the center is better.

Word error rate radar chart across 16 languages on CV3-Eval
Content accuracy (word error rate; radial scale runs from 16 at the center out to 1.45 at the edge — lower is better, so farther out is better). The thick red line is Qwen-Audio-3.0-TTS, hugging the outer edge on most languages, though the dark blue MiniMax line pushes past it on several axes — the gap between the two is razor-thin and hard to eyeball apart on more than one axis. The purple DotsTTS and yellow-green Qwen3-TTS lines collapse toward the center on several spokes, corresponding to languages they don't support. Image source: launch page.
Speaker similarity radar chart across 16 languages on CV3-Eval
Speaker similarity (radial scale runs from 60 at the center out to 90.76 at the edge — higher means it sounds more like the original speaker). The red line sits on the outermost edge across all 16 languages. The green ElevenLabs line hugs the innermost black baseline ring the whole way around, suggesting its score sits at or below the chart's display floor; the launch page doesn't specify the test conditions for this metric. Image source: launch page.
Who the six lines on both charts represent
Qwen-Audio-3.0-TTS (thick red line)
MiniMax-Speech-2.8-HD-API
ElevenLabs-v3-API
DotsTTS-SOAR (10-step sampling)
VoxCPM2
Qwen3-TTS-1.7B-Base (their own previous generation)
3.87
Flash's average word error rate, lowest in 10 of 16 languages
3.96
Plus's average word error rate
82.75
Plus's average speaker similarity, first place across all 16 languages
80.44
Flash's average speaker similarity

Timbre fidelity is where it pulls ahead by the widest margin — a clean sweep across all 16 languages. Pronunciation accuracy isn't a clean win: the launch page's claim is that Flash and Plus combined take the lowest word error rate in 10 of the 16 languages, with the other 6 going to rivals. Worth noting: the chart above only plots a single Qwen-Audio-3.0-TTS line without splitting Flash from Plus, so that 10-versus-6 breakdown can't actually be read off the chart itself.

How it ranks on third-party leaderboards

The two charts above are the releasing team's own benchmarks. The third-party evaluator Artificial Analysis also runs a leaderboard based on blind human pairwise comparisons, scored as Elo ratings. On its July 14 "provider's own voices" sub-leaderboard, Qwen-Audio-3.0-TTS-Plus takes first place.

Top 15 on Artificial Analysis's text-to-speech arena leaderboard
Top 15 on Artificial Analysis's text-to-speech arena leaderboard (provider's own voices sub-leaderboard). First place at 1236 is only 2 points ahead of second-place Simba 3.2's 1234, and their error bars overlap — the leaderboard itself marks both in the 1-2 rank range. Image source: Artificial Analysis official account, 2026-07-14.

That first place needs some context: 1236 versus second-place Simba 3.2's 1234 is only a 2-point gap, and the two error bars overlap — the leaderboard itself lists both in the 1-2 rank range. Further down are Google's Gemini 3.1 Flash TTS (1214) and Cartesia's Sonic 3.5 (1207). ElevenLabs's Eleven v3 sits at 12th place with 1174.

The same leaderboard also supplies two numbers the launch page never mentions: generation speed and price.

ModelEloGeneration speedPrice (per million characters)
Qwen-Audio-3.0-TTS-Plus123616 chars/sec$27.59
Simba 3.2 (SpeechifyAI)123430.2 chars/sec$10.00
Gemini 3.1 Flash TTS (Google)121427 chars/sec$18.31
Sonic 3.5 (Cartesia)1207120 chars/sec$39.00

On generation speed it comes in dead last on this list: 16 characters per second, nearly half of Simba's, and about a seventh-and-a-half of Sonic 3.5's. On price it costs more than double Simba, about 50% more than Gemini, but roughly 30% less than Sonic 3.5. So that first-place ranking is bought with quality — it doesn't hold an edge on speed or price.

How to use it

How you can actually use it right now

Access runs through Alibaba Cloud Bailian, with model names qwen-audio-3.0-tts-flash and qwen-audio-3.0-tts-plus, over a WebSocket protocol. Official sample code is provided in six languages: Python, Java, Go, C#, PHP, and Node.js.

One thing is easy to mix up. Tongyi open-sourced a full Qwen3-TTS lineup back in January, with weights on HuggingFace you can download and run locally; Qwen-Audio-3.0-TTS was not open-sourced alongside this release — searching HuggingFace for that name turns up nothing. Here's how the two generations relate:

 Qwen3-TTSQwen-Audio-3.0-TTS
Release dateJanuary 2026July 2026
How to get itDownload weights from HuggingFaceAPI access only
LicenseApache 2.0Cloud service terms
Sizes0.6B / 1.7B, two sizesFlash / Plus, two service tiers
Languages1016, plus 20 Chinese dialect regions
Best forLocal deployment, modifying the model, keeping data in-houseOut-of-the-box results, dialect and multilingual coverage, comfortable calling the cloud

If you want to run it locally, what's downloadable right now is still January's lineup. Its 1.7B-CustomVoice version has already crossed 2 million downloads on HuggingFace, and the community has produced various quantized versions in GGUF, MLX, and other formats.

🧰 Try it · Qwen-Audio-3.0-TTS
PricePlus runs $27.59 per million characters (per third-party leaderboard data)
RequirementsNeeds an Alibaba Cloud account; set the model name to qwen-audio-3.0-tts-flash or qwen-audio-3.0-tts-plus. No weights available — for local use, fall back to January's open-sourced Qwen3-TTS

One step the demos earlier in this piece skip over: you can't just drop a reference clip straight into a synthesis request. To use your own voice, you first need to register the audio as a custom voice through the voice cloning feature to get a voice ID, then set voice to that ID at synthesis time. Calling it directly, voice is set to the name of a preset system voice.

1
Register the voice first
Upload a reference clip through the voice cloning feature to get a voice ID.
2
Use that ID at synthesis time
Set the voice parameter to the voice ID, and model to the matching model name.
3
Want a dialect? Write it into the instruction
If you want a cloned voice to speak a regional dialect, just say so directly in the instruction — for example, "please say this in Henan dialect."
Source
Qwen-Audio-3.0-TTSTongyi Lab Qwen Audio / Token Foundry team·Launch page·2026-07-20
Editor's note
Both radar charts are taken from the launch page, which plots only a single Qwen-Audio-3.0-TTS line without splitting Flash from Plus — so the launch team's claim that "10 of 16 languages had the lowest word error rate," which is attributed to the two tiers combined, can't actually be read off the chart axis by axis; this piece's description of the chart sticks strictly to what the single plotted curve shows. The arena leaderboard image and its Elo, generation speed, and price figures come from Artificial Analysis's official account, posted 2026-07-14. The full list of 31 tags, the unidirectional-streaming limitation, and the API model names come from Alibaba Cloud's documentation; the comparison of open-source status across the two generations was checked against the HuggingFace model hub by this site. The frame-rate comparison diagram was drawn by this site to illustrate the mechanism; the 25 Hz in the top row is a common reference rate used for comparison. Audio samples are taken from the launch page, transcoded to mp3 here for easier loading in China.