AI21Labs / lm-evaluation
Evaluation suite for large-scale language models.
☆125Updated 3 years ago
Alternatives and similar repositories for lm-evaluation
Users that are interested in lm-evaluation are comparing it to the libraries listed below
Sorting:
- A diff tool for language models☆42Updated last year
- A framework for few-shot evaluation of autoregressive language models.☆103Updated 2 years ago
- Apps built using Inspired Cognition's Critique.☆58Updated 2 years ago
- ☆97Updated 2 years ago
- ☆78Updated last year
- Pipeline for pulling and processing online language model pretraining data from the web☆177Updated last year
- ARCHIVED. Please use https://docs.adapterhub.ml/huggingface_hub.html || 🔌 A central repository collecting pre-trained adapter modules☆68Updated 11 months ago
- This project studies the performance and robustness of language models and task-adaptation methods.☆150Updated 11 months ago
- ☆90Updated 2 years ago
- Experiments with generating opensource language model assistants☆97Updated 2 years ago
- ☆67Updated 2 years ago
- Used for adaptive human in the loop evaluation of language and embedding models.☆309Updated 2 years ago
- The Python library with command line tools to interact with Dynabench(https://dynabench.org/), such as uploading models.☆55Updated 2 years ago
- ☆97Updated 2 years ago
- Implementation of Marge, Pre-training via Paraphrasing, in Pytorch☆76Updated 4 years ago
- 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.☆82Updated 3 years ago
- For experiments involving instruct gpt. Currently used for documenting open research questions.☆71Updated 2 years ago
- XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale☆154Updated last year
- A framework for building semantic parsers (including neural module networks) with AllenNLP, built by the authors of AllenNLP☆108Updated 3 years ago
- LM Pretraining with PyTorch/TPU☆134Updated 5 years ago
- Automatic metrics for GEM tasks☆66Updated 2 years ago
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆93Updated 2 years ago
- Techniques used to run BLOOM at inference in parallel☆37Updated 2 years ago
- Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)☆61Updated last year
- ☆44Updated 6 months ago
- Python Research Framework☆106Updated 2 years ago
- Question-answers, collected from Google☆129Updated 3 years ago
- Official code and model checkpoints for our EMNLP 2022 paper "RankGen - Improving Text Generation with Large Ranking Models" (https://arx…☆136Updated last year
- ☆76Updated 3 years ago
- ☆72Updated last year