ash-01xor / bpe.cLinks
Simple Byte pair Encoding mechanism used for tokenization process . written purely in C
☆133Updated 8 months ago
Alternatives and similar repositories for bpe.c
Users that are interested in bpe.c are comparing it to the libraries listed below
Sorting:
- The Tensor (or Array)☆437Updated 10 months ago
- The Multilayer Perceptron Language Model☆553Updated 11 months ago
- UNet diffusion model in pure CUDA☆610Updated last year
- Alex Krizhevsky's original code from Google Code☆194Updated 9 years ago
- Fast bare-bones BPE for modern tokenizer training☆159Updated 2 weeks ago
- Simple MPI implementation for prototyping or learning☆259Updated 2 weeks ago
- The Autograd Engine☆620Updated 10 months ago
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆188Updated last month
- Implementation of Diffusion Transformer (DiT) in JAX☆278Updated last year
- Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)☆150Updated last year
- An implementation of the transformer architecture onto an Nvidia CUDA kernel☆187Updated last year
- Learning about CUDA by writing PTX code.☆133Updated last year
- A really tiny autograd engine☆94Updated last month
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Updated 3 months ago
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆561Updated 3 weeks ago
- Following master Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish☆173Updated 11 months ago
- Inference of Mamba models in pure C☆188Updated last year
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆375Updated 4 months ago
- Normalized Transformer (nGPT)☆184Updated 7 months ago
- pytorch from scratch in pure C/CUDA and python☆40Updated 9 months ago
- ☆160Updated last year
- This repository contain the simple llama3 implementation in pure jax.☆67Updated 4 months ago
- An extension of the nanoGPT repository for training small MOE models.☆160Updated 4 months ago
- RWKV in nanoGPT style☆191Updated last year
- ☆179Updated 6 months ago
- Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.☆50Updated last year
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs☆424Updated this week
- (WIP) A small but powerful, homemade PyTorch from scratch.☆555Updated this week
- Learnings and programs related to CUDA☆411Updated last week
- small auto-grad engine inspired from Karpathy's micrograd and PyTorch☆272Updated 7 months ago