Alternatives and similar repositories for benchmark_agents

Users that are interested in benchmark_agents are comparing it to the libraries listed below

• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated last year
• explodinggradients / nemesis
  Reward Model framework for LLM RLHF
  ☆61Updated 2 years ago
• microsoft / llm-data-creation
  Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"
  ☆135Updated last year
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆78Updated 9 months ago
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆105Updated 8 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated 10 months ago
• boschresearch / switchprompt
  Resources related to EACL 2023 paper "SwitchPrompt: Learning Domain-Specific Gated Soft Prompts for Classification in Low-Resource Domain…
  ☆52Updated 2 years ago
• patronus-ai / Lynx-hallucination-detection
  ☆41Updated last year
• kumar-shridhar / Screws
  SCREWS: A Modular Framework for Reasoning with Revisions
  ☆27Updated last year
• rashmimarganiatgithub / LLMS_Library_2023
  LLM_library is a comprehensive repository serves as a one-stop resource hands-on code, insightful summaries.
  ☆69Updated last year
• geronimi73 / phi2-finetune
  ☆88Updated last year
• apple / ml-superposition-prompting
  ☆145Updated last year
• TIGER-AI-Lab / StructLM
  Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)
  ☆75Updated 9 months ago
• qcri / LLMeBench
  Benchmarking Large Language Models
  ☆99Updated last month
• swj0419 / detect-pretrain-code-contamination
  ☆77Updated last year
• krypticmouse / matryoshka-representation-learning
  PyTorch implementation for MRL
  ☆19Updated last year
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆65Updated last year
• trapoom555 / Language-Model-STS-CFT
  Improving Text Embedding of Language Models Using Contrastive Fine-tuning
  ☆64Updated last year
• argilla-io / notus
  Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…
  ☆168Updated last year
• Rachnog / intro_to_llm_agents
  Simple introduction to LLM Agents
  ☆139Updated last year
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆59Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆110Updated 10 months ago
• mickymultani / RAG-with-Cross-Encoder-Reranker
  Testing speed and accuracy of RAG with, and without Cross Encoder Reranker.
  ☆48Updated last year
• aymeric-roucher / agent_reasoning_benchmark
  🔧 Compare how Agent systems perform on several benchmarks. 📊🚀
  ☆100Updated last week
• ibm-self-serve-assets / SuperKnowa
  Build Enterprise RAG (Retriver Augmented Generation) Pipelines to tackle various Generative AI use cases with LLM's by simply plugging co…
  ☆113Updated last year
• rasbt / low-rank-adaptation-blog
  ☆29Updated 2 years ago
• wang-research-lab / agentinstruct
  Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"
  ☆115Updated 11 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆80Updated last year
• togethercomputer / Llama-2-7B-32K-Instruct
  ☆85Updated last year
• XZhang97666 / AlpaCare
  ☆91Updated 6 months ago