v0.0.5

SequenceTokenizers v0.0.5

Diff since v0.0.4

Handle transforming back with zero tokens which should get decoded correct to unk symbol instead of zero indexing error.

Release v0.0.4

• Fixed return type to be Float32 for the SequenceTokenizer
• Updated compatibility
• Manually triggered release

Full Changelog: v0.0.2...v0.0.4

v0.0.2

SequenceTokenizers v0.0.2

Diff since v0.0.1

v0.0.1

SequenceTokenizers v0.0.1

Merged pull requests:

• CompatHelper: add new compat entry for OneHotArrays at version 0.2, (keep existing compat) (#3) (@github-actions[bot])