Alternatives and similar repositories for llm-benchmark:

Users that are interested in llm-benchmark are comparing it to the libraries listed below

• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆133Updated 5 months ago
• facebookresearch / cruxeval
  CRUXEval: Code Reasoning, Understanding, and Execution Evaluation
  ☆135Updated 6 months ago
• bigcode-project / astraios
  Astraios: Parameter-Efficient Instruction Tuning Code Language Models
  ☆57Updated last year
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆77Updated 6 months ago
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆137Updated 5 months ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆73Updated 5 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆150Updated last year
• evalplus / repoqa
  RepoQA: Evaluating Long-Context Code Understanding
  ☆107Updated 5 months ago
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆42Updated last year
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆221Updated 5 months ago
• jeffreysijuntan / lloco
  The official repo for "LLoCo: Learning Long Contexts Offline"
  ☆116Updated 10 months ago
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆76Updated last year
• matthewrenze / self-reflection
  Self-Reflection in LLM Agents: Effects on Problem-Solving Performance
  ☆66Updated 4 months ago
• swj0419 / detect-pretrain-code-contamination
  ☆74Updated last year
• wang-research-lab / agentinstruct
  Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"
  ☆106Updated 7 months ago
• bigcode-project / bigcode-analysis
  Repository for analysis and experiments in the BigCode project.
  ☆117Updated last year
• TIGER-AI-Lab / LongICLBench
  Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]
  ☆105Updated last month
• dust-tt / llama-ssp
  Experiments on speculative sampling with Llama models
  ☆125Updated last year
• myscale / Retrieval-QA-Benchmark
  Benchmark baseline for retrieval qa applications
  ☆108Updated last year
• allenai / CommonGen-Eval
  Evaluating LLMs with CommonGen-Lite
  ☆89Updated last year
• sambanova / toolbench
  ToolBench, an evaluation suite for LLM tool manipulation capabilities.
  ☆150Updated last year
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated 8 months ago
• my-other-github-account / llm-humaneval-benchmarks
  ☆84Updated last year
• akjindal53244 / Arithmo
  Small and Efficient Mathematical Reasoning LLMs
  ☆71Updated last year
• CodeEditorBench / CodeEditorBench
  ☆44Updated 10 months ago
• sail-sg / sailcraft
  🚢 Data Toolkit for Sailor Language Models
  ☆88Updated last month
• togethercomputer / Llama-2-7B-32K-Instruct
  ☆84Updated last year
• ntunlp / ExecEval
  A distributed, extensible, secure solution for evaluating machine generated code with unit tests in multiple programming languages.
  ☆52Updated 5 months ago
• withmartian / routerbench
  The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
  ☆116Updated 10 months ago
• msclar / formatspread
  Code accompanying "How I learned to start worrying about prompt formatting".
  ☆105Updated 6 months ago