Make your own simple model

[JRMeyer]

>>> Freegs_Box
[February 20, 2021, 10:24am]

I'm already using deepspeech pre-trained English model from Mozilla, it
works fine. now I want to make my own simple model just to get an idea
of how it works. slash
i read the docs on here:
#> slash
but it was a bit unclear for me. I have installed DeepSpeech Training
Code and its dependencies...but I'm stuck at this part:
#common-voice-training-data>
I want to use my own dataset to create a simple model that recognize
numbers and some words in germany. i have the wave files of me saying
the words and numbers from 0 to 9 . what should I do now to turn this
into a model ready to be trained. slash
SW: slash
ubuntu 18.04 bionic slash
HW: slash
4gb ram slash
cpu i5 10gen slash
no GPU

[This is an archived TTS discussion thread from discourse.mozilla.org/t/make-your-own-simple-model]

[JRMeyer]

>>> othiele
[February 20, 2021, 11:10am]

1. Put all audios in one dir.

2. Create 3 files for train/dev/test with 85/10/5 that are like xxx.csv
with a header line:

wav_filename, wav_filesize,transcript

3. Fill in the splits for the 3 files. Filename includes the path
relative from where you are calling DS.

4. Size is the size as in ls -la

Post if you have any other questions.

[Archived Post]

[JRMeyer]

>>> lissyx
[February 20, 2021, 8:27pm]

> no GPU

You will likely have difficulties to train anything.

[Archived Post]

[JRMeyer]

>>> Freegs_Box
[February 23, 2021, 11:48am]

> Create 3 files for train/dev/test with 85/10/5 that are like xxx.csv
> with a header line:

i have created the files in xx.tsv format is that okay? slash
next, I do not know what do you mean by 85/10/5. please be more
specific, I'm a total nobe to deepspeech.

> You will likely have difficulties to train anything.

i have 11 wav.files so as you see its a very small dataset consist on
numbers from 0 to 9 and a hallo word. can my CPU do the work?

[Archived Post]

[JRMeyer]

>>> lissyx
[February 23, 2021, 11:56am]

> next, I do not know what do you mean by 85/10/5. please be more
> specific, I'm a total nobe to deepspeech.

this is unrelated to deepspeech, it's that you need to split your
training data by 85% / 10% / 5%

> i have 11 wav.files so as you see its a very small dataset consist on
> numbers from 0 to 9 and a hallo word. can my CPU do the work?

Yes, but then such a small amount of data will not allow you to train
anything useful.

[Archived Post]

[JRMeyer]

>>> Freegs_Box
[February 23, 2021, 1:01pm]

> this is unrelated to deepspeech, it's that you need to split your
> training data by 85% / 10% / 5%

and you mean by that, spliting my 11 wav.files data, like 6 wav.files in
train.tsv & 3 wav.files in dev.tsv, & 2 wav.files in test.tsv.

can you lpease help me understand why i should do that. and how this
would help in my training.

> Yes, but then such a small amount of data will not allow you to train
> anything useful.

you are right, I'm only trying to understand how the system works using
small datasets and recognizing from the same wave files I sued in
training to get accurate results.

[Archived Post]

[JRMeyer]

>>> lissyx
[February 23, 2021, 1:03pm]

> can you lpease help me understand why i should do that. and how this
> would help in my training.

This is out of the scope of deepspeech, you need to read about machine
learning and how to make a training

> you are right, I'm only trying to understand how the system works
> using small datasets and recognizing from the same wave files I sued
> in training to get accurate results.

If you don't care about the model really being efficient, then it's
good, this volume of data will allow you to perform training on CPU.
Just don't have expectations on the model quality.

[Archived Post]

[JRMeyer]

>>> Freegs_Box
[February 23, 2021, 1:43pm]

> This is out of the scope of deepspeech, you need to read about machine
> learning and how to make a training

thank you for your help, I'm new to machine learning and I love it and I
will learn more about it.

> If you don't care about the model really being efficient, then it's
> good, this volume of data will allow you to perform training on CPU.
> Just don't have expectations on the model quality.

I do care about the model to be efficient, but in my case, I'm in the
learning stage. once I know how it works on a small set dataset, i will
start a medium project with a decent dataset.

slash [UPDATE slash ] slash
I have done working on data, all files are ready for training slash
I'm following
HTML
playbook from the beginning.

my dataset directory:

rootlocalhost:/DeepSpeech/data# ls
alphabet.txt dev.tsv lm README.rst ted train.tsv
clips invalidated.tsv other.tsv smoke_test test.tsv validated.tsv
rootlocalhost:/DeepSpeech/data#

when i run the import_cv2.py i get this error:

rootlocalhost:/DeepSpeech# bin/import_cv2.py DeepSpeech/data
Traceback (most recent call last):
File 'bin/import_cv2.py', line 15, in
import progressbar
ImportError: No module named progressbar
rootlocalhost:/DeepSpeech#

tried installing progressbar but the error remains:

rootlocalhost:/DeepSpeech/data# apt install progressbar
Reading package lists... Done
Building dependency tree
Reading state information... Done
E: Unable to locate package progressbar
rootlocalhost:/DeepSpeech/data#

[Archived Post]

[JRMeyer]

>>> lissyx
[February 23, 2021, 1:43pm]

> I'm following

> HTML playbook from the beginning.

It looks like you have not properly followed the playbook requirements
on Docker.

cc [ slash kathyreid](

[Archived Post]

[JRMeyer]

>>> Freegs_Box
[February 23, 2021, 1:47pm]

yes im not using docker, do i have to use docker? is it required to get
this working?

[Archived Post]

[JRMeyer]

>>> lissyx
[February 23, 2021, 1:49pm]

Yes, please follow the playbook in a consistent manner.

[Archived Post]

[JRMeyer]

>>> Freegs_Box
[February 23, 2021, 1:50pm]

ok i will do so, thank you for bieng so patient with me. i really
apreciate it. will follow the docker way and give updates.

[Archived Post]

[JRMeyer]

>>> kreid
[February 23, 2021, 2:19pm]

[ slash Freegs_Box](
PlayBook walks you through building a Docker image, and running a Docker
container to do the training. Let me know if you get stuck!

[Archived Post]

[JRMeyer]

>>> Freegs_Box
[February 23, 2021, 2:28pm]

honestly im new to docker, i really need help. im
#making-training-files-available-to-the-docker-container)
on the PlayBook trying set up docker. but I didn't get the meaning of
this sentence slash [ Copy or extract them to the directory you specified in
your bind mount . slash ] slash
how to set up docker for DeepSeech project?

[Archived Post]

[JRMeyer]

>>> kreid
[February 23, 2021, 2:32pm]

OK, first step, which directory did you use for your bind mount?

[Archived Post]

[JRMeyer]

>>> Freegs_Box
[February 23, 2021, 2:37pm]

> bind mount

thas the problem, i dont know what it was meant by bind mount. is it
the deepspeech directroy

[Archived Post]

[JRMeyer]

>>> kreid
[February 23, 2021, 2:47pm]

OK, so this command for spinning up a Docker container from an image:

$ docker run -it slash
--entrypoint /bin/bash slash
--name deepspeech-training slash
--gpus all slash
--mount type=bind,source='$(pwd)'/deepspeech-data,target=/DeepSpeech/deepspeech-data slash
7cdc0bb1fe2a

specifies a bind mount. This is a directory on your system that Docker
can read from, and write to.

Did you create a directory called deepspeech-data on your system? If
so, this is where you need to store the files for training so that
DeepSpeech can access them from within the Docker container.

[Archived Post]

[JRMeyer]

>>> Freegs_Box
[February 23, 2021, 3:00pm]

> Did you create a directory called deepspeech-data on your system? If
> so, this is where you need to store the files for training so that
> DeepSpeech can access them from within the Docker container.

i went to the root directory and created a new folder and renamed it to
deepspeech-data

[Archived Post]

[JRMeyer]

>>> kreid
[February 23, 2021, 3:06pm]

Right, so the deepspeech-data directory that you created is what is
specified in the --bind-mount parameter when spinning up a Docker
container. It should be available within the Docker container from
/DeepSpeech/deepspeech-data.

Are you receiving an error message at all? Did you install Docker OK?
And did you pull down the mozilla/deepspeech-train:latest Docker
image?

[Archived Post]

[JRMeyer]

>>> Freegs_Box
[February 23, 2021, 3:24pm]

> Are you receiving an error message at all? Did you install Docker OK?
> And did you pull down the mozilla/deepspeech-train:latest Docker
> image?

yes I have docker installed slash
docker 19.03.13 from Canonical✓ installed

as for DeepSpeech, I have installed it directly on my ubuntu system, it
was for testing pre-trained English models and it was working well. is
the docker version different? slash
do i need to install deepspeech inside docker container slash
when I run the above code that is what I get, but I think I'm not
meeting all the requirements. and that is why the code doesnt work.

rootlocalhost:~# docker run -it slash
> --entrypoint /bin/bash slash
> --name deepspeech-training slash
> --gpus all slash
> --mount type=bind,source='$(pwd)'/deepspeech-data,target=/DeepSpeech/deepspeech-data slash
> 7cdc0bb1fe2a
Unable to find image '7cdc0bb1fe2a:latest' locally
docker: Error response from daemon: pull access denied for 7cdc0bb1fe2a, repository does not exist or may require 'docker login': denied: requested access to the resource is denied.

[next page
→

[Archived Post]