Alternatives and similar repositories for llm-benchmarker-suite

Users that are interested in llm-benchmarker-suite are comparing it to the libraries listed below

• illuin-tech / vidore-benchmark
  Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.
  ☆249Updated 3 months ago
• deep-diver / llamaduo
  [ACL'25] Official Code for LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs
  ☆314Updated 4 months ago
• spcl / MRAG
  Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"
  ☆232Updated last month
• Leeroo-AI / mergoo
  A library for easily merging multiple LLM experts, and efficiently train the merged LLM.
  ☆495Updated last year
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆78Updated last year
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆305Updated last week
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆242Updated last year
• writer / writing-in-the-margins
  ☆120Updated last year
• microsoft / llm-data-creation
  Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"
  ☆135Updated 2 years ago
• promptslab / LLMtuner
  FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)
  ☆245Updated last year
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆253Updated last year
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆277Updated last year
• myeon9h / PlanRAG
  Repository for “PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makers”, NAACL24
  ☆150Updated last year
• h2oai / enterprise-h2ogpte
  Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform
  ☆91Updated 2 months ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆111Updated last year
• apple / ml-superposition-prompting
  ☆146Updated last year
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆275Updated last year
• terryyz / llm-benchmark
  A list of LLM benchmark frameworks.
  ☆72Updated last year
• patronus-ai / Lynx-hallucination-detection
  ☆43Updated last year
• aymeric-roucher / agent_reasoning_benchmark
  🔧 Compare how Agent systems perform on several benchmarks. 📊🚀
  ☆102Updated 3 months ago
• swj0419 / detect-pretrain-code-contamination
  ☆78Updated last year
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆93Updated last year
• TIGER-AI-Lab / LongRAG
  Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".
  ☆242Updated last year
• wang-research-lab / agentinstruct
  Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"
  ☆116Updated last month
• tianyi-lab / Reflection_Tuning
  [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
  ☆363Updated last year
• argilla-io / notus
  Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…
  ☆169Updated last year
• dsdanielpark / open-llm-datasets
  Repository for organizing datasets and papers used in Open LLM.
  ☆101Updated 2 years ago
• pacman100 / LLM-Workshop
  LLM Workshop by Sourab Mangrulkar
  ☆396Updated last year
• khaimt / qa_expert
  This repo is for handling Question Answering, especially for Multi-hop Question Answering
  ☆67Updated last year
• togethercomputer / Llama-2-7B-32K-Instruct
  ☆85Updated 2 years ago