sujitpal / llm-rag-eval
Large Language Model (LLM) powered evaluator for Retrieval Augmented Generation (RAG) pipelines.
☆23Updated 10 months ago
Alternatives and similar repositories for llm-rag-eval:
Users that are interested in llm-rag-eval are comparing it to the libraries listed below
- LLM reads a paper and produce a working prototype☆48Updated last month
- Measuring RAG solutions throughput and latency☆15Updated 7 months ago
- ☆50Updated 3 months ago
- 🔧 Compare how Agent systems perform on several benchmarks. 📊🚀☆87Updated 4 months ago
- ☆41Updated 2 months ago
- ☆76Updated 9 months ago
- RAG example using DSPy, Gradio, FastAPI☆75Updated 11 months ago
- ☆48Updated 4 months ago
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆72Updated last week
- Deep Research through Multi-Agents, using GraphRAG☆62Updated 4 months ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- ☆33Updated 8 months ago
- ☆15Updated 5 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆55Updated 6 months ago
- Testing speed and accuracy of RAG with, and without Cross Encoder Reranker.☆48Updated last year
- Function Calling Benchmark & Testing☆83Updated 8 months ago
- Codebase accompanying the Summary of a Haystack paper.☆75Updated 5 months ago
- ☆54Updated 3 months ago
- Lean implementation of various multi-agent LLM methods, including Iteration of Thought (IoT)☆104Updated last month
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 8 months ago
- ☆29Updated 11 months ago
- LlamaWorksDB is a Retrieval Augmented Generation (RAG) product designed to interact with the documentation of various products such as Ll…☆15Updated 10 months ago
- ☆18Updated 4 months ago
- Writing Blog Posts with Generative Feedback Loops!☆47Updated 11 months ago