ash-01xor / bpe.cLinks
Simple Byte pair Encoding mechanism used for tokenization process . written purely in C
☆134Updated 10 months ago
Alternatives and similar repositories for bpe.c
Users that are interested in bpe.c are comparing it to the libraries listed below
Sorting:
- The Tensor (or Array)☆443Updated last year
- UNet diffusion model in pure CUDA☆648Updated last year
- Fast bare-bones BPE for modern tokenizer training☆164Updated 2 months ago
- The Multilayer Perceptron Language Model☆562Updated last year
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.