Is the english dictionary US or GB

[NathanTech7713]

Subject basically sums it up but:

1. Is it US english or GB english and
2. 2. If it is one or the other, how hard of a time would it be to separate those into two separate dictionaries?

Thanks

[barrust]

The English dictionary is built off of this data set. I do not believe it distinguishes between the different flavors, but I could be wrong.

As for how to separate them (assuming they are the same) is unknown. Not sure if there is an easy method unless the sources were separated out.

[davebulaval]

To improve dictionary quality, we could consider using recent huge dataset like GigaWord (~4 M documents) or the insanely huge The Pile (825 GO) dataset.

The latter is more diverse (medical document, emails, etc.).

I have a script that can run both dataset and output a JSON dict.