one spoken language can be written in multiple scripts, so it will be detected as a different alphabet/language
look at the alphabet.rs to understand what languages have already defined alphabets. Some of them need validation
Separates words in text (from iterator CharIndices
), and detects language of words by used alphabets (chars).
Warning: can return words with chars from the Unicode private area (for Yoruba
or Nuer
language)
Alpha version (Work In Progress)