Alternatives and similar repositories for benchmark_agents

Users that are interested in benchmark_agents are comparing it to the libraries listed below

• aymeric-roucher / agent_reasoning_benchmark
  🔧 Compare how Agent systems perform on several benchmarks. 📊🚀
  ☆103Updated 6 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆51Updated last year
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆77Updated last year
• kumar-shridhar / Screws
  SCREWS: A Modular Framework for Reasoning with Revisions
  ☆27Updated 2 years ago
• togethercomputer / Llama-2-7B-32K-Instruct
  ☆84Updated 2 years ago
• patronus-ai / Lynx-hallucination-detection
  ☆43Updated last year
• vibrantlabsai / nemesis
  Reward Model framework for LLM RLHF
  ☆62Updated 2 years ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆80Updated last year
• githubpradeep / notebooks
  ☆55Updated 5 months ago
• akjindal53244 / Arithmo
  Small and Efficient Mathematical Reasoning LLMs
  ☆73Updated 2 years ago
• microsoft / llm-data-creation
  Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"
  ☆137Updated 2 years ago
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆126Updated 3 months ago
• geronimi73 / phi2-finetune
  ☆86Updated 2 years ago
• argilla-io / notus
  Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…
  ☆169Updated 2 years ago
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆72Updated last year
• rashmimarganiatgithub / LLMS_Library_2023
  LLM_library is a comprehensive repository serves as a one-stop resource hands-on code, insightful summaries.
  ☆69Updated 2 years ago
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆108Updated 4 months ago
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆277Updated last year
• allenai / CommonGen-Eval
  Evaluating LLMs with CommonGen-Lite
  ☆94Updated last year
• AntonioGr7 / pratical-llms
  A collection of hand on notebook for LLMs practitioner
  ☆51Updated last year
• TIGER-AI-Lab / StructLM
  Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)
  ☆76Updated last year
• wang-research-lab / agentinstruct
  Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"
  ☆120Updated 3 months ago
• mickymultani / RAG-with-Cross-Encoder-Reranker
  Testing speed and accuracy of RAG with, and without Cross Encoder Reranker.
  ☆50Updated 2 years ago
• Rachnog / intro_to_llm_agents
  Simple introduction to LLM Agents
  ☆140Updated last year
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆112Updated last year
• azharlabs / large-models
  ☆16Updated 2 years ago
• SalesforceAIResearch / SFR-RAG
  ☆82Updated 3 months ago
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆60Updated last year
• pacman100 / peft-codegen-25
  ☆23Updated 2 years ago
• Anni-Zou / Meta-CoT
  Meta-CoT: Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models
  ☆101Updated 2 years ago