ibm-self-serve-assets / JudgeIt-LLM-as-a-JudgeLinks
Automation Framework using LLM-as-a-judge to Scale Eval of Gen AI solutions (RAG, Multi-turn, Query Rewrite, Text2SQL etc.); that is a good proxy for human judgement.
☆29Updated 6 months ago
Alternatives and similar repositories for JudgeIt-LLM-as-a-Judge
Users that are interested in JudgeIt-LLM-as-a-Judge are comparing it to the libraries listed below
Sorting:
- ☆76Updated 6 months ago
- Repository for “PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makers”, NAACL24☆142Updated last year
- Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"☆135Updated last year
- Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"☆220Updated last month
- 🔧 Compare how Agent systems perform on several benchmarks. 📊🚀☆98Updated 8 months ago
- 🔎 A deep-dive into HyDE for Advanced LLM RAG + 💡 Introducing AutoHyDE, a semi-supervised framework to improve the effectiveness, covera…☆32Updated last year
- DSPY on action with OpenSource LLMs.☆72Updated last year
- ☆145Updated 11 months ago
- Blended RAG: Improving RAG (Retriever-Augmented Generation) Accuracy with Semantic Search and Hybrid Query-Based Retrievers☆69Updated 2 months ago
- ☆23Updated 6 months ago
- Official repository for RAGViz: Diagnose and Visualize Retrieval-Augmented Generation [EMNLP 2024]☆85Updated 6 months ago
- ☆94Updated 3 months ago
- Codebase accompanying the Summary of a Haystack paper.☆79Updated 9 months ago
- ☆47Updated 9 months ago
- ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…☆107Updated last year
- Self-Reflection in LLM Agents: Effects on Problem-Solving Performance☆77Updated 7 months ago
- Lighter, cheaper and faster RAG toolkit (Graph RAG) supported by TargetPilot☆47Updated last month
- Lean implementation of various multi-agent LLM methods, including Iteration of Thought (IoT)☆115Updated 5 months ago
- ☆75Updated 10 months ago
- Large-language Model Evaluation framework with Elo Leaderboard and A-B testing☆52Updated 8 months ago
- This is the repo for the LegalBench-RAG Paper: https://arxiv.org/abs/2408.10343.☆105Updated last month
- ☆31Updated last year
- [EMNLP 2024 Findings] OneGen: Efficient One-Pass Unified Generation and Retrieval for LLMs.☆148Updated 8 months ago
- Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".☆235Updated 10 months ago
- ☆96Updated 10 months ago
- LLM reads a paper and produce a working prototype☆58Updated 3 months ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆73Updated 2 weeks ago
- Automatic Prompt Optimization☆39Updated last year
- This is the official repo for the paper HiRAG: Retrieval-Augmented Generation with Hierarchical Knowledge.☆198Updated 3 weeks ago
- Large Language Model (LLM) powered evaluator for Retrieval Augmented Generation (RAG) pipelines.☆29Updated last year