gautierdag / bpeasyLinks
Fast bare-bones BPE for modern tokenizer training
☆156Updated 2 months ago
Alternatives and similar repositories for bpeasy
Users that are interested in bpeasy are comparing it to the libraries listed below
Sorting:
- Manage scalable open LLM inference endpoints in Slurm clusters☆257Updated 10 months ago
- ☆92Updated last year
- A puzzle to learn about prompting☆127Updated 2 years ago
- RuLES: a benchmark for evaluating rule-following in language models☆224Updated 3 months ago
- NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day☆254Updated last year
- ☆267Updated 10 months ago
- Extract full next-token probabilities via language model APIs☆248Updated last year
- JAX implementation of the Llama 2 model☆217Updated last year
- ☆130Updated 2 months ago
- ☆159Updated this week
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆126Updated 3 weeks ago
- git extension for {collaborative, communal, continual} model development☆212Updated 6 months ago
- An interactive exploration of Transformer programming.☆264Updated last year
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆100Updated 2 months ago
- Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)☆189Updated last year
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆230Updated 7 months ago
- Website for hosting the Open Foundation Models Cheat Sheet.☆267Updated 3 weeks ago
- code for training & evaluating Contextual Document Embedding models☆191Updated 2 weeks ago
- Accelerate, Optimize performance with streamlined training and serving options with JAX.☆274Updated this week
- ☆78Updated 10 months ago
- Experiments for efforts to train a new and improved t5☆76Updated last year
- ☆188Updated 3 months ago
- Simple Transformer in Jax☆137Updated 11 months ago
- seqax = sequence modeling + JAX☆155Updated last month
- Sparsify transformers with SAEs and transcoders☆547Updated this week
- Puzzles for exploring transformers☆347Updated 2 years ago
- Scaling Data-Constrained Language Models☆334Updated 8 months ago
- supporting pytorch FSDP for optimizers☆79Updated 5 months ago
- A repository for research on medium sized language models.☆495Updated 3 weeks ago
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆200Updated 5 months ago