Alternatives and similar repositories for llm-benchmarker-suite

Users that are interested in llm-benchmarker-suite are comparing it to the libraries listed below

• terryyz / llm-benchmark
  A list of LLM benchmark frameworks.
  ☆73Updated last year
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆255Updated last year
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆321Updated last month
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆277Updated last year
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆250Updated last year
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆94Updated last year
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆77Updated last year
• Leeroo-AI / mergoo
  A library for easily merging multiple LLM experts, and efficiently train the merged LLM.
  ☆507Updated last year
• tianyi-lab / Reflection_Tuning
  [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
  ☆366Updated last year
• promptslab / LLMtuner
  FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)
  ☆246Updated 2 years ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆280Updated last year
• Pints-AI / 1.5-Pints
  A compact LLM pretrained in 9 days by using high quality data
  ☆339Updated 10 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆169Updated last year
• wang-research-lab / agentinstruct
  Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"
  ☆120Updated 3 months ago
• SalesforceAIResearch / SFR-RAG
  ☆82Updated 3 months ago
• illuin-tech / vidore-benchmark
  Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.
  ☆259Updated 3 weeks ago
• spcl / MRAG
  Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"
  ☆239Updated 4 months ago
• microsoft / llm-data-creation
  Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"
  ☆137Updated 2 years ago
• aymeric-roucher / agent_reasoning_benchmark
  🔧 Compare how Agent systems perform on several benchmarks. 📊🚀
  ☆103Updated 6 months ago
• apple / ml-superposition-prompting
  ☆147Updated last year
• argilla-io / notus
  Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…
  ☆169Updated 2 years ago
• h2oai / h2o-LLM-eval
  Large-language Model Evaluation framework with Elo Leaderboard and A-B testing
  ☆52Updated last year
• myscale / Retrieval-QA-Benchmark
  Benchmark baseline for retrieval qa applications
  ☆120Updated last year
• anyscale / llm-router
  Tutorial for building LLM router
  ☆244Updated last year
• stephenleo / llm-structured-output-benchmarks
  Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…
  ☆184Updated last year
• golololologol / LLM-Distillery
  A pipeline for LLM knowledge distillation
  ☆112Updated 10 months ago
• ibm-granite / granite-3.0-language-models
  ☆270Updated 7 months ago
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆288Updated this week
• writer / writing-in-the-margins
  ☆120Updated last year
• TIGER-AI-Lab / LongRAG
  Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".
  ☆242Updated last year