aymeric-roucher / benchmark_agentsLinks
☆27Updated last year
Alternatives and similar repositories for benchmark_agents
Users that are interested in benchmark_agents are comparing it to the libraries listed below
Sorting:
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆77Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆51Updated last year
- Codebase accompanying the Summary of a Haystack paper.☆80Updated last year
- Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"☆137Updated 2 years ago
- Resources related to EACL 2023 paper "SwitchPrompt: Learning Domain-Specific Gated Soft Prompts for Classification in Low-Resource Domain…☆52Updated 2 years ago
- Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…☆169Updated 2 years ago
- ☆78Updated 2 years ago
- Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)☆75Updated last year
- Reward Model framework for LLM RLHF☆62Updated 2 years ago
- Code for NeurIPS LLM Efficiency Challenge☆60Updated last year
- ☆86Updated 2 years ago
- SCREWS: A Modular Framework for Reasoning with Revisions☆27Updated 2 years ago
- 🔧 Compare how Agent systems perform on several benchmarks. 📊🚀☆103Updated 5 months ago
- ☆43Updated last year
- ☆55Updated last year
- A set of scripts and notebooks on LLM finetunning and dataset creation☆115Updated last year
- Mixing Language Models with Self-Verification and Meta-Verification☆112Updated last year
- PyTorch implementation for MRL☆20Updated last year
- ☆23Updated 2 years ago
- Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub☆161Updated 2 years ago
- Small and Efficient Mathematical Reasoning LLMs☆73Updated 2 years ago
- ☆16Updated last year
- Using open source LLMs to build synthetic datasets for direct preference optimization☆72Updated last year
- ☆147Updated last year
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker☆126Updated 3 months ago
- Chunk your text using gpt4o-mini more accurately☆44Updated last year
- ☆50Updated last year
- Meta-CoT: Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models☆101Updated 2 years ago
- ☆53Updated 3 months ago
- Collection of resources for RL and Reasoning☆27Updated 11 months ago