mddunlap924 / LangChain-SynData-RAG-Eval
LangChain, Llama2-Chat, and zero- and few-shot prompting are used to generate synthetic datasets for IR and RAG system evaluation
☆32Updated 9 months ago
Related projects: ⓘ
- 🤓 A collection of AWESOME structured summaries of Large Language Models (LLMs)☆19Updated last year
- ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…☆91Updated 5 months ago
- Source code of the paper: RetrievalQA: Assessing Adaptive Retrieval-Augmented Generation for Short-form Open-Domain Question Answering [F…☆57Updated 3 months ago
- Codebase accompanying the Summary of a Haystack paper.☆65Updated 2 months ago
- StructuredRAG Benchmarker☆85Updated last week
- Truth Forest: Toward Multi-Scale Truthfulness in Large Language Models through Intervention without Tuning☆40Updated 9 months ago
- This is an implementation of the paper: Searching for Best Practices in Retrieval-Augmented Generation☆157Updated 3 weeks ago
- Reward Model framework for LLM RLHF☆56Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆48Updated 2 months ago
- Public code repo for paper "SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales"☆82Updated 2 months ago
- Knowledge Graph Retrieval Augmented Generation (KG-RAG) Eval Datasets☆111Updated 5 months ago
- Tutorial for DSPy☆18Updated 4 months ago
- ☆69Updated last month
- A semantic research engine to get relevant papers based on a user query. Application frontend with Chainlit Copilot. Observability with L…☆74Updated 4 months ago
- Examples of RAG using LangChain with local LLMs - Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B☆32Updated 8 months ago
- ☆45Updated 3 months ago
- Source code for our paper: "SelfGoal: Your Language Agents Already Know How to Achieve High-level Goals".☆62Updated 2 months ago
- "Enhancing LLM Factual Accuracy with RAG to Counter Hallucinations: A Case Study on Domain-Specific Queries in Private Knowledge-Bases" b…☆35Updated 6 months ago
- This repository implements the chain of verification paper by Meta AI☆151Updated 11 months ago
- Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"☆68Updated last week
- Code and resources showcasing the Retrieval-Augmented Generation (RAG) technique, a solution for enhancing data freshness in Large Langua…☆38Updated last year
- Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.☆91Updated last week
- Sample notebooks and prompts for LLM evaluation☆104Updated 5 months ago
- Contains Google Colab or Jupyter notebooks, as well as other associated files for my Medium blogposts.☆33Updated 3 months ago
- demo app for Knowledge Graph Build with LLM LlamaIndex and NebulaGraph☆48Updated 2 months ago
- RAG with Knowledge Graph☆32Updated 6 months ago
- ☆40Updated 6 months ago
- Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…☆117Updated 3 weeks ago
- ☆82Updated 3 weeks ago
- Resources for our paper: "EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms"☆73Updated 2 months ago