iNeil77 / vllm-code-harnessLinks
Run code inference-only benchmarks quickly using vLLM
☆10Updated 3 months ago
Alternatives and similar repositories for vllm-code-harness
Users that are interested in vllm-code-harness are comparing it to the libraries listed below
Sorting:
- ☆38Updated last year
- M2D2: A Massively Multi-domain Language Modeling Dataset (EMNLP 2022) by Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer☆54Updated 2 years ago
- Implementation of the paper "Fine-Tuning Transformers: Vocabulary Transfer" https://arxiv.org/pdf/2112.14569.pdf☆20Updated 3 years ago
- Code & data for EMNLP 2020 paper "MOCHA: A Dataset for Training and Evaluating Reading Comprehension Metrics".☆16Updated 3 years ago
- Official repository for our EACL 2023 paper "LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization" (https…☆44Updated 10 months ago
- ☆97Updated 2 years ago
- A highly sophisticated sequence-to-sequence model for code generation☆40Updated 3 years ago
- Follow the Wisdom of the Crowd: Effective Text Generation via Minimum Bayes Risk Decoding☆18Updated 2 years ago
- The evaluation pipeline for the 2024 BabyLM Challenge.☆31Updated 7 months ago
- ☆44Updated 7 months ago
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆72Updated last year
- Repository for the "Understanding and Mitigating Language Confusion in LLMs" paper☆26Updated last year
- ☆48Updated last year
- Code for Zero-Shot Tokenizer Transfer☆133Updated 5 months ago
- [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners☆116Updated 9 months ago
- State of What Art? A Call for Multi-Prompt LLM Evaluation☆15Updated 11 months ago
- Automatic metrics for GEM tasks☆66Updated 2 years ago
- The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".☆70Updated last year
- Apps built using Inspired Cognition's Critique.☆58Updated 2 years ago
- Repository collecting resources and best practices to improve experimental rigour in deep learning research.☆27Updated 2 years ago
- Query-focused summarization data☆42Updated 2 years ago
- ☆72Updated 2 years ago
- ☆12Updated last year
- Research code for the paper "How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models"☆27Updated 3 years ago
- ☆16Updated 4 years ago
- Code for "Tracing Knowledge in Language Models Back to the Training Data"☆38Updated 2 years ago
- The LM Contamination Index is a manually created database of contamination evidences for LMs.☆78Updated last year
- Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"☆58Updated 2 years ago
- DEMix Layers for Modular Language Modeling☆53Updated 3 years ago
- An unofficial implementation of the Infini-gram model proposed by Liu et al. (2024)☆33Updated last year