A deep learning toolkit for Text-to-Speech generation that supports synthesizing speech in over 1100 languages, training new models, and voice cloning. It can be installed via pip or Docker and operated through a CLI, Python library, or a web-based GUI server.
Project overview
It provides pretrained models for over 1100 languages alongside tools for voice cloning, voice conversion, and model training.
Project type
Model Runtime · Audio & Speech
Use cases
Audio & Speech
Deployment
Refer to project documentation
License
MPL-2.0
Best for
Developers, AI engineers, and researchers who need to synthesize speech, train TTS models, or perform voice conversion using a Python library or CLI.
Key capabilities
Synthesizes speech from text using pretrained or custom models, supporting over 1100 languages.
Provides tools and a Trainer API to train new models and fine-tune existing Text-to-Speech models efficiently.
Clones voices using speaker embeddings or reference audio, enabling unconstrained voice cloning with compatible models like XTTS and Bark.
Converts the voice from a source audio file to match a target voice using models like FreeVC.
Provides a built-in server to run TTS models and synthesize speech over HTTP, exposed via a web GUI.
Offers utilities under the dataset_analysis module for curating Text2Speech datasets.
Includes various Text2Spec models like Tacotron, Glow-TTS, FastPitch, and more.
Includes various vocoder models like MelGAN, HiFiGAN, WaveRNN, and more to convert spectrograms to audio.
Limitations and risks
The project is tested primarily on Ubuntu 18.04. Running on Windows requires following manual setup instructions.
Getting started
Install the library easily via PyPI using pip. A first successful synthesis can be achieved by running the command tts --text "Text for TTS" --out_path output/path/speech.wav.
Evidence and sources
GitHub project description: 🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production
README: 🐸TTS is a library for advanced Text-to-Speech generation.