hadasah / btm
☆71Updated 6 months ago
Related projects ⓘ
Alternatives and complementary repositories for btm
- Language models scale reliably with over-training and on downstream tasks☆94Updated 7 months ago
- ☆38Updated 6 months ago
- some common Huggingface transformers in maximal update parametrization (µP)☆76Updated 2 years ago
- SILO Language Models code repository☆80Updated 8 months ago
- ☆50Updated last year
- Experiments for efforts to train a new and improved t5☆76Updated 6 months ago
- Retrieval as Attention☆82Updated last year
- Code repository for the c-BTM paper☆105Updated last year
- ☆127Updated last month
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆56Updated 2 months ago
- ☆23Updated 3 months ago
- [ICML 2023] Exploring the Benefits of Training Expert Language Models over Instruction Tuning☆97Updated last year
- ☆31Updated last year
- ☆50Updated last week
- The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"☆109Updated last year
- Code for Zero-Shot Tokenizer Transfer☆115Updated 2 weeks ago
- A framework for few-shot evaluation of autoregressive language models.☆23Updated 10 months ago
- Function Vectors in Large Language Models (ICLR 2024)☆116Updated 3 weeks ago
- ☆45Updated 9 months ago
- ☆46Updated last month
- Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"☆78Updated 8 months ago
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆41Updated 9 months ago
- ☆148Updated 9 months ago
- DEMix Layers for Modular Language Modeling☆53Updated 3 years ago
- Pretraining Efficiently on S2ORC!☆136Updated 2 weeks ago
- ☆93Updated last year
- A fusion of a linear layer and a cross entropy loss, written for pytorch in triton.☆54Updated 3 months ago
- AI Logging for Interpretability and Explainability🔬☆87Updated 5 months ago
- PASTA: Post-hoc Attention Steering for LLMs☆107Updated 2 months ago
- NanoGPT-like codebase for LLM training☆73Updated this week