TechSinger: Technique Controllable Multilingual Singing Voice Synthesis via Flow Matching

Authors

  • Wenxiang Guo Zhejiang University
  • Yu Zhang Zhejiang University
  • Changhao Pan Zhejiang University
  • Rongjie Huang Zhejiang University
  • Li Tang Zhejiang University
  • Ruiqi Li Zhejiang University
  • Zhiqing Hong Zhejiang University
  • Yongqi Wang Zhejiang University
  • Zhou Zhao Zhejiang University

DOI:

https://doi.org/10.1609/aaai.v39i22.34571

Abstract

Singing voice synthesis has made remarkable progress in generating natural and high-quality voices. However, existing methods rarely provide precise control over vocal techniques such as intensity, mixed voice, falsetto, bubble, and breathy tones, thus limiting the expressive potential of synthetic voices. We introduce TechSinger, an advanced system for controllable singing voice synthesis that supports five languages and seven vocal techniques. TechSinger leverages a flow-matching-based generative model to produce singing voices with enhanced expressive control over various techniques. To enhance the diversity of training data, we develop a technique detection model that automatically annotates datasets with phoneme-level technique labels. Additionally, our prompt-based technique prediction model enables users to specify desired vocal attributes through natural language, offering fine-grained control over the synthesized singing. Experimental results demonstrate that TechSinger significantly enhances the expressiveness and realism of synthetic singing voices, outperforming existing methods in terms of audio quality and technique-specific control.

Downloads

Published

2025-04-11

How to Cite

Guo, W., Zhang, Y., Pan, C., Huang, R., Tang, L., Li, R., … Zhao, Z. (2025). TechSinger: Technique Controllable Multilingual Singing Voice Synthesis via Flow Matching. Proceedings of the AAAI Conference on Artificial Intelligence, 39(22), 23978–23986. https://doi.org/10.1609/aaai.v39i22.34571

Issue

Section

AAAI Technical Track on Natural Language Processing I