AI21Labs / lm-evaluation
Evaluation suite for large-scale language models.
☆124Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for lm-evaluation
- A diff tool for language models☆42Updated 10 months ago
- ☆76Updated 11 months ago
- Open source library for few shot NLP☆77Updated last year
- ☆86Updated 2 years ago
- A framework for few-shot evaluation of autoregressive language models.☆101Updated last year
- Experiments with generating opensource language model assistants☆97Updated last year
- Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)☆60Updated last year
- For experiments involving instruct gpt. Currently used for documenting open research questions.☆71Updated 2 years ago
- XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale☆153Updated 11 months ago
- ☆97Updated 2 years ago
- The Python library with command line tools to interact with Dynabench(https://dynabench.org/), such as uploading models.☆55Updated 2 years ago
- This project studies the performance and robustness of language models and task-adaptation methods.☆141Updated 6 months ago
- A library to create and manage configuration files, especially for machine learning projects.☆77Updated 2 years ago
- ☆230Updated 4 years ago
- ☆73Updated last year
- Tools for managing datasets for governance and training.☆78Updated 3 weeks ago
- ☆64Updated 2 years ago
- Implementation of Marge, Pre-training via Paraphrasing, in Pytorch☆75Updated 3 years ago
- ☆46Updated this week
- ☆44Updated last year
- The official code of LM-Debugger, an interactive tool for inspection and intervention in transformer-based language models.☆172Updated 2 years ago
- ☆67Updated 2 years ago
- Apps built using Inspired Cognition's Critique.☆58Updated last year
- ☆95Updated last year
- A library for finding knowledge neurons in pretrained transformer models.☆151Updated 2 years ago
- Question-answers, collected from Google☆124Updated 3 years ago
- ☆131Updated last year
- ☆86Updated 2 years ago
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆92Updated last year
- Helper scripts and notes that were used while porting various nlp models☆44Updated 2 years ago