zphang / minimal-opt
☆67Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for minimal-opt
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆92Updated last year
- ☆73Updated last year
- A minimal PyTorch Lightning OpenAI GPT w DeepSpeed Training!☆111Updated last year
- Official code and model checkpoints for our EMNLP 2022 paper "RankGen - Improving Text Generation with Large Ranking Models" (https://arx…☆136Updated last year
- ☆93Updated last year
- The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".☆68Updated 10 months ago
- some common Huggingface transformers in maximal update parametrization (µP)☆76Updated 2 years ago
- A diff tool for language models☆42Updated 10 months ago
- ☆16Updated last year
- Automatic metrics for GEM tasks☆61Updated 2 years ago
- Apps built using Inspired Cognition's Critique.☆58Updated last year
- ☆95Updated last year
- DEMix Layers for Modular Language Modeling☆53Updated 3 years ago
- ☆46Updated this week
- ☆71Updated 6 months ago
- A library to create and manage configuration files, especially for machine learning projects.☆77Updated 2 years ago
- ☆44Updated last year
- The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…☆66Updated last year
- Experiments with generating opensource language model assistants☆97Updated last year
- SILO Language Models code repository☆80Updated 8 months ago
- [ICML 2023] Exploring the Benefits of Training Expert Language Models over Instruction Tuning☆97Updated last year
- Implementation of Marge, Pre-training via Paraphrasing, in Pytorch☆75Updated 3 years ago
- Code accompanying our papers on the "Generative Distributional Control" framework☆117Updated last year
- 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.☆82Updated 2 years ago
- ☆34Updated 6 months ago
- ☆76Updated 11 months ago
- ☆31Updated last year
- ☆50Updated last year