sujitpal / llm-rag-eval
Large Language Model (LLM) powered evaluator for Retrieval Augmented Generation (RAG) pipelines.
☆24Updated 10 months ago
Alternatives and similar repositories for llm-rag-eval:
Users that are interested in llm-rag-eval are comparing it to the libraries listed below
- ☆48Updated 4 months ago
- Measuring RAG solutions throughput and latency☆15Updated 7 months ago
- LLM reads a paper and produce a working prototype☆51Updated last week
- ☆50Updated 4 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 8 months ago
- Codebase accompanying the Summary of a Haystack paper.☆75Updated 6 months ago
- ☆41Updated 3 months ago
- ☆29Updated last year
- ☆21Updated 4 months ago
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆74Updated this week
- Simple examples using Argilla tools to build AI☆53Updated 4 months ago
- Testing speed and accuracy of RAG with, and without Cross Encoder Reranker.☆48Updated last year
- ☆15Updated 5 months ago
- RAG example using DSPy, Gradio, FastAPI☆76Updated 11 months ago
- Very minimal (and stateless) agent framework☆41Updated 2 months ago
- 🔧 Compare how Agent systems perform on several benchmarks. 📊🚀☆89Updated 5 months ago
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆91Updated last month
- Explore the use of DSPy for extracting features from PDFs 🔎☆39Updated last year
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆55Updated 6 months ago
- Lean implementation of various multi-agent LLM methods, including Iteration of Thought (IoT)☆106Updated last month
- ☆45Updated 11 months ago
- ☆76Updated 9 months ago
- ☆45Updated 5 months ago
- Includes examples on how to evaluate LLMs☆21Updated 4 months ago
- A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments☆73Updated 5 months ago
- ☆24Updated 6 months ago