lucidrains / nim-tokenizer

Implementation of a simple BPE tokenizer, but in Nim
21Updated last year

Related projects

Alternatives and complementary repositories for nim-tokenizer