sangmichaelxie / cs324_p2
Project 2 (Building Large Language Models) for Stanford CS324: Understanding and Developing Large Language Models (Winter 2022)
☆103Updated 2 years ago
Alternatives and similar repositories for cs324_p2:
Users that are interested in cs324_p2 are comparing it to the libraries listed below
- NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day☆255Updated last year
- A puzzle to learn about prompting☆124Updated last year
- Functional local implementations of main model parallelism approaches☆95Updated 2 years ago
- Website for hosting the Open Foundation Models Cheat Sheet.☆265Updated 3 weeks ago
- Code repository for the c-BTM paper☆106Updated last year
- ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward exp…☆217Updated 11 months ago
- Fast bare-bones BPE for modern tokenizer training☆151Updated 5 months ago
- [NeurIPS 2023] Learning Transformer Programs☆159Updated 10 months ago
- ☆165Updated last year
- ☆92Updated last year
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆82Updated last year
- RuLES: a benchmark for evaluating rule-following in language models☆220Updated last month
- ☆67Updated 7 months ago
- Simple and efficient pytorch-native transformer training and inference (batched)☆71Updated 11 months ago
- Functional Benchmarks and the Reasoning Gap☆84Updated 6 months ago
- Understand and test language model architectures on synthetic tasks.☆185Updated 3 weeks ago
- ☆48Updated last year
- An interactive exploration of Transformer programming.☆261Updated last year
- The GitHub repo for Goal Driven Discovery of Distributional Differences via Language Descriptions☆69Updated 2 years ago
- A set of scripts and notebooks on LLM finetunning and dataset creation☆105Updated 6 months ago
- ReLM is a Regular Expression engine for Language Models☆103Updated last year
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆72Updated 7 months ago
- Evaluating LLMs with CommonGen-Lite☆89Updated last year
- Experiments for efforts to train a new and improved t5☆77Updated 11 months ago
- ☆150Updated last year
- A MAD laboratory to improve AI architecture designs 🧪☆108Updated 3 months ago
- ☆263Updated 2 months ago
- Scaling Data-Constrained Language Models☆335Updated 6 months ago
- Just a bunch of benchmark logs for different LLMs☆119Updated 8 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆103Updated 4 months ago