Alternatives and similar repositories for llm_benchmarks

Users that are interested in llm_benchmarks are comparing it to the libraries listed below

• magpie-align / magpie
  [ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data …
  ☆708Updated 2 months ago
• llm-as-a-judge / Awesome-LLM-as-a-judge
  ☆349Updated this week
• NiuTrans / ABigSurveyOfLLMs
  A collection of 150+ surveys on LLMs
  ☆301Updated 3 months ago
• THUDM / LongBench
  LongBench v2 and LongBench (ACL 2024)
  ☆888Updated 4 months ago
• mlfoundations / evalchemy
  Automatic evals for LLMs
  ☆407Updated this week
• huggingface / Math-Verify
  ☆744Updated last month
• FudanDNN-NLP / RAG
  This is an implementation of the paper: Searching for Best Practices in Retrieval-Augmented Generation (EMNLP2024)
  ☆320Updated 5 months ago
• allenai / reward-bench
  RewardBench: the first evaluation tool for reward models.
  ☆590Updated this week
• TIGER-AI-Lab / MMLU-Pro
  The code and data for "MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark" [NeurIPS 2024]
  ☆247Updated 3 months ago
• tianyi-lab / Reflection_Tuning
  [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
  ☆353Updated 9 months ago
• liyucheng09 / Selective_Context
  Compress your input to ChatGPT or other LLMs, to let them process 2x more content and save 40% memory and GPU time.
  ☆383Updated last year
• xfactlab / orpo
  Official repository for ORPO
  ☆453Updated last year
• shmsw25 / FActScore
  A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic…
  ☆351Updated last month
• declare-lab / instruct-eval
  This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.
  ☆547Updated last year
• lmmlzn / Awesome-LLMs-Datasets
  Summarize existing representative LLMs text datasets.
  ☆1,278Updated 2 months ago
• jlko / semantic_uncertainty
  Codebase for reproducing the experiments of the semantic uncertainty paper (short-phrase and sentence-length experiments).
  ☆322Updated last year
• coree / awesome-rag
  A curated list of retrieval-augmented generation (RAG) in large language models
  ☆276Updated 3 months ago
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆242Updated 6 months ago
• fate-ubw / RAGLAB
  [EMNLP 2024: Demo Oral] RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation
  ☆299Updated 7 months ago
• wasiahmad / Awesome-LLM-Synthetic-Data
  A reading list on LLM based Synthetic Data Generation 🔥
  ☆1,287Updated 2 weeks ago
• TIGER-AI-Lab / LongRAG
  Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".
  ☆231Updated 9 months ago
• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆1,574Updated last week
• zhilizju / Awesome-instruction-tuning
  A curated list of awesome instruction tuning datasets, models, papers and repositories.
  ☆335Updated last year
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆281Updated 7 months ago
• hkust-nlp / deita
  Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]
  ☆555Updated 5 months ago
• google-research / distilling-step-by-step
  ☆539Updated last year
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆618Updated this week
• voidism / DoLa
  Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"
  ☆493Updated 4 months ago
• yixuantt / MultiHop-RAG
  Repository for "MultiHop-RAG: A Dataset for Evaluating Retrieval-Augmented Generation Across Documents" (COLM 2024)
  ☆324Updated 2 months ago
• ZigeW / data_management_LLM
  Collection of training data management explorations for large language models
  ☆325Updated 10 months ago