mddunlap924 / LangChain-SynData-RAG-EvalLinks
LangChain, Llama2-Chat, and zero- and few-shot prompting are used to generate synthetic datasets for IR and RAG system evaluation
☆37Updated 2 years ago
Alternatives and similar repositories for LangChain-SynData-RAG-Eval
Users that are interested in LangChain-SynData-RAG-Eval are comparing it to the libraries listed below
Sorting:
- Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.☆116Updated 4 months ago
- This repository implements the chain of verification paper by Meta AI☆182Updated 2 years ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆51Updated last year
- ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…☆114Updated last year
- ☆148Updated last year
- Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph☆147Updated last year
- Source code of the paper: RetrievalQA: Assessing Adaptive Retrieval-Augmented Generation for Short-form Open-Domain Question Answering [F…☆69Updated last year
- Codebase accompanying the Summary of a Haystack paper.☆79Updated last year
- A semantic research engine to get relevant papers based on a user query. Application frontend with Chainlit Copilot. Observability with L…☆82Updated last year
- Testing speed and accuracy of RAG with, and without Cross Encoder Reranker.☆50Updated last year
- ☆65Updated last year
- Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"☆137Updated 2 years ago
- Writing Blog Posts with Generative Feedback Loops!☆50Updated last year
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆78Updated last year
- A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…☆160Updated last week
- Build Enterprise RAG (Retriver Augmented Generation) Pipelines to tackle various Generative AI use cases with LLM's by simply plugging co…☆116Updated last year
- Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.☆167Updated last year
- ☆43Updated last year
- Repository for “PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makers”, NAACL24☆152Updated last year
- Mistral + Haystack: build RAG pipelines that rock 🤘☆106Updated last year
- Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…☆179Updated last year
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker☆124Updated last month
- Sample notebooks and prompts for LLM evaluation☆156Updated last month
- ☆20Updated last year
- Large-language Model Evaluation framework with Elo Leaderboard and A-B testing☆52Updated last year
- ☆101Updated 8 months ago
- Chunk your text using gpt4o-mini more accurately☆44Updated last year
- ☆23Updated 11 months ago
- ☆38Updated last year
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆78Updated last year