Alternatives and similar repositories for llm-benchmark

Users that are interested in llm-benchmark are comparing it to the libraries listed below

• withmartian / routerbench
  The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
  ☆128Updated last year
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated 9 months ago
• imagination-research / sot
  [ICLR 2024] Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation
  ☆171Updated last year
• bigcode-project / astraios
  Astraios: Parameter-Efficient Instruction Tuning Code Language Models
  ☆58Updated last year
• togethercomputer / Llama-2-7B-32K-Instruct
  ☆84Updated last year
• aymeric-roucher / agent_reasoning_benchmark
  🔧 Compare how Agent systems perform on several benchmarks. 📊🚀
  ☆98Updated 8 months ago
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆138Updated 8 months ago
• jeffreysijuntan / lloco
  The official repo for "LLoCo: Learning Long Contexts Offline"
  ☆117Updated last year
• evalplus / repoqa
  RepoQA: Evaluating Long-Context Code Understanding
  ☆111Updated 8 months ago
• InternLM / SWE-Fixer
  ☆104Updated 2 months ago
• LLM360 / Analysis360
  Open Implementations of LLM Analyses
  ☆105Updated 9 months ago
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆242Updated 8 months ago
• uclaml / Rephrase-and-Respond
  Official repo of Respond-and-Respond: data, code, and evaluation
  ☆103Updated 11 months ago
• allenai / CommonGen-Eval
  Evaluating LLMs with CommonGen-Lite
  ☆90Updated last year
• UbiquitousLearning / SLM_Survey
  ☆95Updated 9 months ago
• matthewrenze / self-reflection
  Self-Reflection in LLM Agents: Effects on Problem-Solving Performance
  ☆77Updated 7 months ago
• facebookresearch / cruxeval
  CRUXEval: Code Reasoning, Understanding, and Execution Evaluation
  ☆149Updated 9 months ago
• Digitous / LLM-SLERP-Merge
  Spherical Merge Pytorch/HF format Language Models with minimal feature loss.
  ☆132Updated last year
• akjindal53244 / Arithmo
  Small and Efficient Mathematical Reasoning LLMs
  ☆71Updated last year
• Anni-Zou / Meta-CoT
  Meta-CoT: Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models
  ☆97Updated last year
• ytyz1307zzh / RefAug
  Code for EMNLP 2024 paper "Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning"
  ☆55Updated 9 months ago
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆229Updated 8 months ago
• 18907305772 / FuseAI
  FuseAI Project
  ☆87Updated 5 months ago
• neulab / gemini-benchmark
  ☆149Updated last year
• theblackcat102 / evol-dataset
  evol augment any dataset online
  ☆59Updated last year
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆160Updated last year
• Moocember / Optimization-by-PROmpting
  ☆78Updated last year
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆91Updated last year
• kyegomez / Lets-Verify-Step-by-Step
  "Improving Mathematical Reasoning with Process Supervision" by OPENAI
  ☆111Updated this week
• yueyu1030 / AttrPrompt
  [NeurIPS 2023] This is the code for the paper `Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias`.
  ☆150Updated last year