MycroftAI
/
mimic2
mirror of https://github.com/MycroftAI/mimic2.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity

Merge branch 'master' of https://github.com/MycroftAI/mimic2

pull/15/head
Michael Nguyen 2018-07-11 16:13:11 -05:00
parent 925dbb613c 485715a35a
commit 3ea41b8820
1 changed files with 26 additions and 5 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

31
README.md
View File

@ -4,10 +4,9 @@ This is a fork of [keithito/tacotron](https://github.com/keithito/tacotron)
with changes specific to Mimic 2 applied.
## Background
Earlier this year, Google published a paper, [Tacotron: A Fully End-to-End Text-To-Speech Synthesis Model](https://arxiv.org/pdf/1703.10135.pdf),
Google published a paper, [Tacotron: A Fully End-to-End Text-To-Speech Synthesis Model](https://arxiv.org/pdf/1703.10135.pdf),
where they present a neural text-to-speech model that learns to synthesize speech directly from
(text, audio) pairs. However, they didn't release their source code or training data. This is an
attempt to provide an open-source implementation of the model described in their paper.
@ -16,11 +15,28 @@ The quality isn't as good as Google's demo yet, but hopefully it will get there
Pull requests are welcome!
## Quick Start
### Installing dependencies
#### using docker (recommended)
1. make sure you have docker installed
1. Build Docker
the Dockerfile comes with a gpu option or cpu option. If you want to use the GPU in docker make sure you have [nvidia-docker](https://github.com/NVIDIA/nvidia-docker) installed
gpu: `docker build -t mycroft/mimic2:gpu -f gpu.Dockerfile .`
cpu: `docker build -t mycroft/mimic2:gpu -f cpu.Dockerfile .`
2. Run Docker
gpu: `nvidia-docker run -it -p 3000:3000 mycroft/mimic2:gpu`
cpu: `docker run -it -p 3000:3000 mycroft/mimic2:cpu`
#### manually
1. Install Python 3.
2. Install the latest version of [TensorFlow](https://www.tensorflow.org/install/) for your platform. For better
@ -33,6 +49,7 @@ Pull requests are welcome!
### Using a pre-trained model
**NOTE this model will only work if you switch out the LocationSensitiveAttention layer for the BahdanauAttention layer in tacotron.py
1. **Download and unpack a model**:
```
@ -44,7 +61,7 @@ Pull requests are welcome!
python3 demo_server.py --checkpoint /tmp/tacotron-20170720/model.ckpt
```
3. **Point your browser at localhost:9000**
3. **Point your browser at localhost:3000**
* Type what you want to synthesize
@ -58,6 +75,7 @@ Pull requests are welcome!
The following are supported out of the box:
* [LJ Speech](https://keithito.com/LJ-Speech-Dataset/) (Public Domain)
* [Blizzard 2012](http://www.cstr.ed.ac.uk/projects/blizzard/2012/phase_one) (Creative Commons Attribution Share-Alike)
* [M-ailabs](http://www.m-ailabs.bayern/en/the-mailabs-speech-dataset/)
You can use other datasets if you convert them to the right format. See [TRAINING_DATA.md](TRAINING_DATA.md) for more info.
@ -85,12 +103,15 @@ Pull requests are welcome!
|- lab
|- wav
```
For M-AILABS follow the directory structure from [here](http://www.m-ailabs.bayern/en/the-mailabs-speech-dataset/)
3. **Preprocess the data**
```
python3 preprocess.py --dataset ljspeech
```
* Use `--dataset blizzard` for Blizzard data
* other datasets can be used i.e. `--dataset blizzard` for Blizzard data
* for the mailabs dataset, do `preprocess.py --help` for options. Also note that mailabs uses sample_size of 16000
4. **Train a model**
```