srush / GPTWorldLinks
A puzzle to learn about prompting
☆135Updated 2 years ago
Alternatives and similar repositories for GPTWorld
Users that are interested in GPTWorld are comparing it to the libraries listed below
Sorting:
- Puzzles for exploring transformers☆384Updated 2 years ago
- Extract full next-token probabilities via language model APIs☆248Updated last year
- RuLES: a benchmark for evaluating rule-following in language models☆246Updated 10 months ago
- Website for hosting the Open Foundation Models Cheat Sheet.☆269Updated 8 months ago
- Functional local implementations of main model parallelism approaches☆95Updated 2 years ago
- Solve puzzles. Learn CUDA.☆63Updated 2 years ago
- Fast bare-bones BPE for modern tokenizer training☆175Updated 6 months ago
- Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*☆86Updated 2 years ago
- ☆151Updated 4 months ago
- A reading list of relevant papers and projects on foundation model annotation☆28Updated 10 months ago
- Simple Transformer in Jax☆142Updated last year
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆185Updated 6 months ago
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Updated last year
- An interactive exploration of Transformer programming.☆271Updated 2 years ago
- Project 2 (Building Large Language Models) for Stanford CS324: Understanding and Developing Large Language Models (Winter 2022)☆105Updated 2 years ago
- Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)☆198Updated last year
- Understand and test language model architectures on synthetic tasks.☆249Updated last week
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆83Updated 2 years ago
- ☆92Updated last year
- Keeping language models honest by directly eliciting knowledge encoded in their activations.☆216Updated last week
- Long context evaluation for large language models☆225Updated 10 months ago
- NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day☆259Updated 2 years ago
- Draw more samples☆198Updated last year
- Scaling is a distributed training library and installable dependency designed to scale up neural networks, with a dedicated module for tr…☆66Updated 2 months ago
- MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…☆183Updated 2 months ago
- JAX implementation of the Llama 2 model☆215Updated last year
- Public Inflection Benchmarks☆68Updated last year
- ☆116Updated last week
- ☆288Updated last year
- git extension for {collaborative, communal, continual} model development☆217Updated last year