aymeric-roucher / benchmark_agents
☆27Updated last year
Alternatives and similar repositories for benchmark_agents:
Users that are interested in benchmark_agents are comparing it to the libraries listed below
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute …☆49Updated 9 months ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆76Updated 6 months ago
- ☆48Updated 5 months ago
- ☆16Updated last year
- ☆24Updated last year
- SCREWS: A Modular Framework for Reasoning with Revisions☆27Updated last year
- Using open source LLMs to build synthetic datasets for direct preference optimization☆61Updated last year
- PyTorch implementation for MRL☆18Updated last year
- ☆52Updated 2 months ago
- Improving Text Embedding of Language Models Using Contrastive Fine-tuning☆63Updated 8 months ago
- Reward Model framework for LLM RLHF☆61Updated last year
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆42Updated last year
- Question Answer Generation App using Mistral 7B, Langchain, and FastAPI.☆65Updated last year
- ☆20Updated last year
- ☆84Updated last year
- GenAI Experimentation☆58Updated this week
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆66Updated 5 months ago
- Evaluating LLMs with CommonGen-Lite☆89Updated last year
- Examples of RAG using LangChain with local LLMs - Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B☆38Updated last year
- Testing speed and accuracy of RAG with, and without Cross Encoder Reranker.☆48Updated last year
- ☆75Updated last year
- Chunk your text using gpt4o-mini more accurately☆44Updated 8 months ago
- EMNLP 2024 "Re-reading improves reasoning in large language models". Simply repeating the question to get bidirectional understanding for…☆25Updated 4 months ago
- Scripts, notebooks, and articles about data science in general.☆47Updated last year
- ☆20Updated 3 years ago
- A collection of hand on notebook for LLMs practitioner☆47Updated 3 months ago
- ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…☆101Updated last year
- Mixing Language Models with Self-Verification and Meta-Verification☆104Updated 4 months ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Updated last year
- Set of scripts to finetune LLMs☆37Updated last year