srush / GPTWorld
A puzzle to learn about prompting
☆127Updated last year
Alternatives and similar repositories for GPTWorld:
Users that are interested in GPTWorld are comparing it to the libraries listed below
- Puzzles for exploring transformers☆343Updated last year
- Extract full next-token probabilities via language model APIs☆241Updated last year
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆105Updated 5 months ago
- ☆428Updated 6 months ago
- A MAD laboratory to improve AI architecture designs 🧪☆111Updated 4 months ago
- Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)☆189Updated 10 months ago
- Understand and test language model architectures on synthetic tasks.☆192Updated last month
- seqax = sequence modeling + JAX☆154Updated 2 weeks ago
- Simple Transformer in Jax☆136Updated 10 months ago
- RuLES: a benchmark for evaluating rule-following in language models☆221Updated 2 months ago
- Website for hosting the Open Foundation Models Cheat Sheet.☆267Updated last week
- ☆128Updated 3 weeks ago
- ☆78Updated 9 months ago
- Resources for skilling up in AI alignment research engineering. Covers basics of deep learning, mechanistic interpretability, and RL.☆209Updated last year
- Fast bare-bones BPE for modern tokenizer training☆154Updated 3 weeks ago
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆123Updated last year
- Solve puzzles. Learn CUDA.☆63Updated last year
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆82Updated last year
- An interactive exploration of Transformer programming.☆262Updated last year
- Resources from the EleutherAI Math Reading Group☆53Updated last month
- JAX implementation of the Llama 2 model☆218Updated last year
- ☆216Updated 9 months ago
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆197Updated 4 months ago
- MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…☆170Updated this week
- Repository for the paper Stream of Search: Learning to Search in Language☆145Updated 2 months ago
- A curated reading list of research in Adaptive Computation, Inference-Time Computation & Mixture of Experts (MoE).☆143Updated 3 months ago
- git extension for {collaborative, communal, continual} model development☆211Updated 5 months ago
- ☆72Updated 2 months ago
- A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning☆139Updated this week
- ☆92Updated last year