Fast bare-bones BPE for modern tokenizer training
☆181Jun 23, 2025Updated last year
Alternatives and similar repositories for bpeasy
Users that are interested in bpeasy are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆12Sep 30, 2015Updated 11 years ago
- Simple Byte pair Encoding mechanism used for tokenization process . written purely in C☆158Nov 11, 2024Updated 2 years ago
- JAX implementation ViT-VQGAN☆68Jul 23, 2022Updated 4 years ago
- ####### ALERT! #########: my fork of the project has moved:☆20Dec 23, 2016Updated 9 years ago
- ScriptBots is an Open Source Evolutionary Artificial Life Simulation of Predator-Prey dynamics, written by Andrej Karpathy.☆21May 15, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- RuLES: a benchmark for evaluating rule-following in language models☆259Feb 24, 2025Updated last year
- The official PyTorch implementation of Google's Gemma models☆5,711May 30, 2025Updated last year
- Google+ Blog☆18Oct 9, 2011Updated 15 years ago
- Pure Python version of the mlabwrap Python to Matlab bridge☆34Nov 21, 2019Updated 6 years ago
- UNet diffusion model in pure CUDA☆668Jun 28, 2024Updated 2 years ago
- A benchmark to evaluate language models on questions I've previously asked them to solve.☆1,070Apr 27, 2025Updated last year
- Teardown of Google Glass☆43Jan 11, 2014Updated 12 years ago
- Implementation of Diffusion Transformer (DiT) in JAX☆323Jun 11, 2024Updated 2 years ago
- A basic implementation of convolutional neural nets☆61Apr 20, 2014Updated 12 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆608Aug 14, 2026Updated 3 months ago
- Artificial Life simulator using canvas. Based on https://github.com/karpathy/scriptsbots☆81Jun 7, 2016Updated 10 years ago
- gpt-2 from scratch in mlx☆438Jun 12, 2024Updated 2 years ago
- Simple MPI implementation for prototyping or learning☆331Aug 6, 2025Updated last year
- ScriptBots is an Open Source Evolutionary Artificial Life Simulation of Predator-Prey dynamics, written by Andrej Karpathy.☆68Feb 18, 2011Updated 15 years ago
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆981Nov 16, 2025Updated last year
- Benchmark testbed for assessing the performance of optimisation algorithms☆88Jan 7, 2015Updated 11 years ago
- Code for the paper "Getting the most out of your tokenizer for pre-training and domain adaptation"☆22Feb 14, 2024Updated 2 years ago
- Fine-tune mistral-7B on 3090s, a100s, h100s☆741Oct 11, 2023Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- useful scripts to work with Twitter + Python. Requires the tweepy library.☆96Nov 29, 2012Updated 13 years ago
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆367Nov 2, 2025Updated last year
- Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.☆11,059Jul 1, 2024Updated 2 years ago
- Game making library for using Canvas element☆117Oct 17, 2023Updated 3 years ago
- All stories and comments posted on Hacker News upto May 29, 2014☆137Oct 30, 2018Updated 8 years ago
- Implements SFO minibatch optimizer in Python and MATLAB, and reproduces figures from paper.☆139May 17, 2021Updated 5 years ago
- Implementing DeepSeek R1's GRPO algorithm from scratch☆1,920Apr 18, 2025Updated last year
- My hybrid TTS network that combines, VALL-E, VoiceBox, SpeechFlow, Seamless and TortoiseTTS into one☆27Aug 5, 2024Updated 2 years ago
- Schedule-Free Optimization in PyTorch☆2,337Jul 28, 2026Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Cramming the training of a (BERT-type) language model into limited compute.☆1,370Jun 13, 2024Updated 2 years ago
- GPT for FACodec☆13Mar 25, 2024Updated 2 years ago
- ☆18Feb 16, 2024Updated 2 years ago
- Adversarial networks in TensorFlow☆176Oct 25, 2016Updated 10 years ago
- Artificial Life simulator using canvas. Based on https://github.com/karpathy/scriptsbots☆126May 27, 2012Updated 14 years ago
- A collection of Pythonic subword tokenisers and text preprocessing tools.☆15Updated this week
- Train to 94% on CIFAR-10 in <6.3 seconds on a single A100. Or ~95.79% in ~110 seconds (or less!)☆1,318Dec 18, 2024Updated last year
Are these results useful?