terryyz / llm-benchmarkLinks
A list of LLM benchmark frameworks.
☆70Updated last year
Alternatives and similar repositories for llm-benchmark
Users that are interested in llm-benchmark are comparing it to the libraries listed below
Sorting:
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆135Updated last year
- Open Implementations of LLM Analyses☆106Updated 10 months ago
- Evaluating LLMs with CommonGen-Lite☆91Updated last year
- Benchmark baseline for retrieval qa applications☆116Updated last year
- Data preparation code for Amber 7B LLM☆91Updated last year
- Benchmarking LLMs with Challenging Tasks from Real Users☆239Updated 10 months ago
- [ICLR 2024] Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation☆175Updated last year
- Evaluating LLMs with fewer examples☆161Updated last year
- LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)☆141Updated 9 months ago
- The official repo for "LLoCo: Learning Long Contexts Offline"☆118Updated last year
- RepoQA: Evaluating Long-Context Code Understanding☆115Updated 10 months ago
- 🔧 Compare how Agent systems perform on several benchmarks. 📊🚀☆100Updated last month
- Spherical Merge Pytorch/HF format Language Models with minimal feature loss.☆136Updated last year
- The official evaluation suite and dynamic data release for MixEval.☆245Updated 9 months ago
- Official repo for "Make Your LLM Fully Utilize the Context"☆253Updated last year
- CRUXEval: Code Reasoning, Understanding, and Execution Evaluation☆152Updated 10 months ago
- Code accompanying "How I learned to start worrying about prompt formatting".☆109Updated 2 months ago
- FuseAI Project☆87Updated 7 months ago
- Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"☆116Updated 11 months ago
- A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.☆122Updated 6 months ago
- Meta-CoT: Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models☆97Updated last year
- Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"☆135Updated last year
- ☆202Updated last year
- EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…☆239Updated 10 months ago
- The code and data for "MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark" [NeurIPS 2024]☆283Updated 6 months ago
- Official repo of Respond-and-Respond: data, code, and evaluation☆103Updated last year
- Astraios: Parameter-Efficient Instruction Tuning Code Language Models☆62Updated last year
- ☆113Updated 3 months ago
- ☆96Updated 11 months ago
- ☆85Updated 2 years ago