Skip to content

1.3.2: Token2IndexwithHash

Compare
Choose a tag to compare
@SoluMilken SoluMilken released this 12 Mar 06:47
· 114 commits to master since this release

Add a new operation: Token2IndexwithHash.

This operation maps input tokens to indices given token2index dictionary.
If the token is not in the given dictionary, we hash the token and mod it with
the size of the dictionary.