AI21Labs / lm-evaluation
Evaluation suite for large-scale language models.
☆125Updated 3 years ago
Alternatives and similar repositories for lm-evaluation:
Users that are interested in lm-evaluation are comparing it to the libraries listed below
- A diff tool for language models☆42Updated last year
- A framework for few-shot evaluation of autoregressive language models.☆104Updated last year
- ☆77Updated last year
- Implementation of Marge, Pre-training via Paraphrasing, in Pytorch☆75Updated 4 years ago
- Helper scripts and notes that were used while porting various nlp models☆46Updated 3 years ago
- ☆90Updated 2 years ago
- XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale☆154Updated last year
- The Python library with command line tools to interact with Dynabench(https://dynabench.org/), such as uploading models.☆55Updated 2 years ago
- Apps built using Inspired Cognition's Critique.☆58Updated 2 years ago
- Pipeline for pulling and processing online language model pretraining data from the web☆177Updated last year
- For experiments involving instruct gpt. Currently used for documenting open research questions.☆71Updated 2 years ago
- ☆97Updated 2 years ago
- Code and data to support the paper "PAQ 65 Million Probably-Asked Questions andWhat You Can Do With Them"☆202Updated 3 years ago
- Official code and model checkpoints for our EMNLP 2022 paper "RankGen - Improving Text Generation with Large Ranking Models" (https://arx…☆136Updated last year
- Experiments with generating opensource language model assistants☆97Updated last year
- Python tools for processing the stackexchange data dumps into a text dataset for Language Models☆81Updated last year
- ☆44Updated 5 months ago
- ☆72Updated last year
- ☆97Updated 2 years ago
- This repository contains the code for "Generating Datasets with Pretrained Language Models".☆188Updated 3 years ago
- Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)☆61Updated last year
- Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.☆180Updated 2 years ago
- Parallel data preprocessing for NLP and ML.☆34Updated 5 months ago
- ☆148Updated 4 years ago
- Open source library for few shot NLP☆78Updated last year
- Official repository with code and data accompanying the NAACL 2021 paper "Hurdles to Progress in Long-form Question Answering" (https://a…☆46Updated 2 years ago
- Techniques used to run BLOOM at inference in parallel☆37Updated 2 years ago
- Find and fix bugs in natural language machine learning models using adaptive testing.☆183Updated 11 months ago
- ☆96Updated last year
- SQuARE: Software for question answering research.☆75Updated 10 months ago