mddunlap924 / LangChain-SynData-RAG-EvalLinks
LangChain, Llama2-Chat, and zero- and few-shot prompting are used to generate synthetic datasets for IR and RAG system evaluation
☆37Updated last year
Alternatives and similar repositories for LangChain-SynData-RAG-Eval
Users that are interested in LangChain-SynData-RAG-Eval are comparing it to the libraries listed below
Sorting:
- ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…☆108Updated last year
- This repository implements the chain of verification paper by Meta AI☆176Updated last year
- Source code of the paper: RetrievalQA: Assessing Adaptive Retrieval-Augmented Generation for Short-form Open-Domain Question Answering [F…☆67Updated last year
- Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.☆114Updated last month
- 🔧 Compare how Agent systems perform on several benchmarks. 📊🚀☆100Updated 3 weeks ago
- Codebase accompanying the Summary of a Haystack paper.☆79Updated 11 months ago
- ☆145Updated last year
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker☆114Updated this week
- Testing speed and accuracy of RAG with, and without Cross Encoder Reranker.☆48Updated last year
- Writing Blog Posts with Generative Feedback Loops!☆50Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated last year
- Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…☆174Updated 11 months ago
- Create a knowledge graph out of unstructed legal text - use said knowledge graph in a graph augmented retrieval augmented generation pipe…☆56Updated 11 months ago
- Explore the use of DSPy for extracting features from PDFs 🔎☆46Updated last year
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆78Updated 10 months ago
- Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"☆135Updated last year
- ☆42Updated last year
- Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph☆147Updated last year
- Knowledge Graph Retrieval Augmented Generation (KG-RAG) Eval Datasets☆172Updated last year
- Sample notebooks and prompts for LLM evaluation☆138Updated 2 months ago
- Official Repo for CRMArena and CRMArena-Pro☆109Updated 2 months ago
- Repository for “PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makers”, NAACL24☆145Updated last year
- Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.☆168Updated last year
- ☆76Updated 7 months ago
- A semantic research engine to get relevant papers based on a user query. Application frontend with Chainlit Copilot. Observability with L…☆83Updated last year
- ☆23Updated 7 months ago
- This is the repo for the LegalBench-RAG Paper: https://arxiv.org/abs/2408.10343.☆124Updated 3 months ago
- This repo is the central repo for all the RAG Evaluation reference material and partner workshop☆74Updated 4 months ago
- Blended RAG: Improving RAG (Retriever-Augmented Generation) Accuracy with Semantic Search and Hybrid Query-Based Retrievers☆69Updated 3 months ago
- Dense X Retrieval: What Retrieval Granularity Should We Use?☆160Updated last year