Skip to content

Add Irodori-TTS MeanFlow support - #1083

Merged
0xShug0 merged 2 commits into
mainfrom
feature/irodori-meanflow
Oct 25, 2026
Merged

0xShug0 merged 2 commits into
mainfrom
feature/irodori-meanflow

Conversation

@0xShug0

@0xShug0 0xShug0 commented Oct 25, 2026

Copy link
Copy Markdown
Owner

Summary

  • Add Irodori-TTS v4.1 Small MeanFlow support, selected automatically from checkpoint metadata, with four sampling steps by default.
  • Keep MeanFlow conditioning and sampling policy in a dedicated model-local implementation, reusing the existing DiT graphs. RF checkpoints retain their existing sampler and 40-step default.
  • Remove redundant attention K/V copies and retain MF graphs across requests when mem_saver=false.
  • Add standalone Q8_0/F16 GGUF conversion, packages, and documentation.

Performance

CUDA RTX 5090, Q8_0 packages, 12 threads. Each version ran the same 20 Japanese inputs (563–1,959 characters) in one session, covering no-reference speech, voice cloning, and voice design, with matched texts and seeds. Sampling, text chunking, duration prediction, and memory-saving defaults were left unchanged.

Version Sampling steps End-to-end RTF ↓ Peak VRAM
Main RF (4efa3959) 40 0.02815 6,712 MiB
PR RF 40 0.02660 6,712 MiB
PR MeanFlow 4 0.00964 6,706 MiB

MeanFlow is approximately 2.92× faster than main RF in this run, with essentially unchanged peak VRAM. RF uses the v4 Small checkpoint; MeanFlow uses the distinct v4.1 Small MF checkpoint.

RTF is total session.wall_ms divided by total audio duration, including the first request and excluding model loading. Each version produced 5,227.16 seconds of audio. VRAM was sampled throughout each session at 20 ms intervals. These are single matched sequences, not statistically repeated benchmarks.

@0xShug0
0xShug0 merged commit 44c566f into main Oct 25, 2026
7 checks passed
@0xShug0
0xShug0 deleted the feature/irodori-meanflow branch October 25, 2026 19:52
cunba-ai pushed a commit to cunba-ai/audio.cpp that referenced this pull request Oct 28, 2026
…d staging) + Earshot VAD + BreezeTTS CUDA opts + Echo-TTS CFG + /health version

Upstream commits 899d84a..71f42b8 (22):
- fix HIP VMM access updates for growing pools (0xShug0#1059)
- gguf: numeric array metadata in one bulk fread (0xShug0#1072)
- Echo-TTS optional Joint-CFG (0xShug0#773); Sway time scheduling later
- validated HIP VMM defaults in Arch AMD installer (0xShug0#1080)
- HIP argsort extended to large rows (0xShug0#1076)
- Irodori-TTS MeanFlow support (0xShug0#1083)
- assets: direct uploads preserved in weight-norm tensor views (0xShug0#1081)
- HIP device weight uploads staged through bounded host buffer (0xShug0#1070)
- empty/null speech voice values treated as omitted (0xShug0#1086)
- redundant VoxCPM2 KV cache staging/reset avoided (0xShug0#1085)
- Drama3 device sampling default off (0xShug0#1087)
- Studio LoRA controls + shared adapter groups (0xShug0#1088)
- Arena styling alignment (0xShug0#1089)
- Earshot VAD native C++ port (0xShug0#1095)
- ASR VAD chunking loads any built-in VAD family (0xShug0#1096)
- /health reports build version + git commit (0xShug0#1097)
- BreezeTTS opt-in fused depth graph CUDA (0xShug0#1090); bf16 rounding fusion in rms_norm/add/SwiGLU (0xShug0#1091); batch-2 CFG decode (0xShug0#1092); option names normalized
- ci: best-effort HIP test release binaries (0xShug0#1100)
- Echo-TTS Sway time scheduling (0xShug0#1105)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant