ash-01xor / bpe.c
Simple Byte pair Encoding mechanism used for tokenization process . written purely in C
☆129Updated 5 months ago
Alternatives and similar repositories for bpe.c:
Users that are interested in bpe.c are comparing it to the libraries listed below
- The Tensor (or Array)☆429Updated 8 months ago
- A really tiny autograd engine☆92Updated last year
- Alex Krizhevsky's original code from Google Code☆191Updated 9 years ago
- Implementation of Diffusion Transformer (DiT) in JAX☆272Updated 10 months ago
- An implementation of the transformer architecture onto an Nvidia CUDA kernel☆179Updated last year
- The Multilayer Perceptron Language Model☆543Updated 8 months ago
- Learning about CUDA by writing PTX code.☆128Updated last year
- UNet diffusion model in pure CUDA☆602Updated 9 months ago
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆177Updated last week
- Fast bare-bones BPE for modern tokenizer training☆154Updated 3 weeks ago
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆530Updated this week
- ☆155Updated 3 months ago
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆65Updated 3 weeks ago
- The Autograd Engine☆597Updated 7 months ago
- Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)☆148Updated 10 months ago
- Following master Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish☆174Updated 8 months ago
- RWKV in nanoGPT style☆189Updated 10 months ago
- A c/c++ implementation of micrograd: a tiny autograd engine with neural net on top.☆67Updated last year
- pytorch from scratch in pure C/CUDA and python☆40Updated 6 months ago
- This repository contain the simple llama3 implementation in pure jax.☆63Updated 2 months ago
- Solve puzzles to improve your tinygrad skills!☆122Updated last month
- Learnings and programs related to CUDA☆378Updated 2 months ago
- Tensor library with autograd using only Rust's standard library☆67Updated 9 months ago
- Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.☆51Updated last year
- ☆153Updated last year
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆337Updated last month
- ☆51Updated last week
- Solve puzzles. Learn CUDA.☆63Updated last year
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆96Updated last month
- Inference of Mamba models in pure C☆187Updated last year