georg-jung / FastBertTokenizer

Fast and memory-efficient library for WordPiece tokenization as it is used by BERT.
41Updated 4 months ago

Related projects

Alternatives and complementary repositories for FastBertTokenizer