aymeric-roucher / benchmark_agentsLinks
☆27Updated last year
Alternatives and similar repositories for benchmark_agents
Users that are interested in benchmark_agents are comparing it to the libraries listed below
Sorting:
- Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"☆134Updated last year
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆78Updated 11 months ago
- Codebase accompanying the Summary of a Haystack paper.☆79Updated last year
- Reward Model framework for LLM RLHF☆61Updated 2 years ago
- Mixing Language Models with Self-Verification and Meta-Verification☆110Updated 9 months ago
- PyTorch implementation for MRL☆19Updated last year
- ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…☆113Updated last year
- 🔧 Compare how Agent systems perform on several benchmarks. 📊🚀☆102Updated 2 months ago
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker☆119Updated last week
- ☆78Updated 8 months ago
- ☆146Updated last year
- ☆43Updated last year
- ☆85Updated 2 years ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated last year
- LLM_library is a comprehensive repository serves as a one-stop resource hands-on code, insightful summaries.☆69Updated last year
- ☆88Updated last year
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆104Updated 2 weeks ago
- ☆23Updated 2 years ago
- Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.☆115Updated 2 months ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆33Updated 2 weeks ago
- Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…☆169Updated last year
- Meta-CoT: Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models☆99Updated last year
- Chunk your text using gpt4o-mini more accurately☆44Updated last year
- ☆80Updated last year
- Resources related to EACL 2023 paper "SwitchPrompt: Learning Domain-Specific Gated Soft Prompts for Classification in Low-Resource Domain…☆52Updated 2 years ago
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆36Updated 2 years ago
- ☆43Updated 3 weeks ago
- Improving Text Embedding of Language Models Using Contrastive Fine-tuning☆64Updated last year
- SCREWS: A Modular Framework for Reasoning with Revisions☆27Updated 2 years ago
- ☆48Updated last year