amazon-science / auto-rag-eval

Related projects ⓘ

Alternatives and complementary repositories for auto-rag-eval

• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆122Updated 7 months ago
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆78Updated 3 months ago
• chentong0 / factoid-wiki
  Dense X Retrieval: What Retrieval Granularity Should We Use?
  ☆131Updated 10 months ago
• ParticleMedia / RAGTruth
  Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"
  ☆114Updated last month
• neulab / ragged
  Retrieval Augmented Generation Generalized Evaluation Dataset
  ☆51Updated last month
• predlico / ARAGOG
  ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…
  ☆96Updated 6 months ago
• ServiceNow / TapeAgents
  TapeAgents is a framework that facilitates all stages of the LLM Agent development lifecycle
  ☆121Updated this week
• yixuantt / MultiHop-RAG
  Repository for "MultiHop-RAG: A Dataset for Evaluating Retrieval-Augmented Generation Across Documents" (COLM 2024)
  ☆194Updated 3 months ago
• amazon-science / RefChecker
  RefChecker provides automatic checking pipeline and benchmark dataset for detecting fine-grained hallucinations generated by Large Langua…
  ☆300Updated this week
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆128Updated this week
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆72Updated last month
• carriex / recomp
  RECOMP: Improving Retrieval-Augmented LMs with Compression and Selective Augmentation.
  ☆96Updated 4 months ago
• SALT-NLP / demonstrated-feedback
  ☆111Updated last month
• apple / ml-superposition-prompting
  ☆131Updated 3 months ago
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆261Updated 3 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆239Updated 2 weeks ago
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆114Updated this week
• patronus-ai / financebench
  ☆100Updated 2 months ago
• amazon-science / RAGChecker
  RAGChecker: A Fine-grained Framework For Diagnosing RAG
  ☆531Updated last month
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆105Updated last week
• AIR-Bench / AIR-Bench
  AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark
  ☆105Updated 3 weeks ago
• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆88Updated 8 months ago
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆142Updated last month
• facebookresearch / tart
  Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.
  ☆160Updated last year
• docugami / KG-RAG-datasets
  Knowledge Graph Retrieval Augmented Generation (KG-RAG) Eval Datasets
  ☆126Updated 7 months ago
• HuskyInSalt / CRAG
  Corrective Retrieval Augmented Generation
  ☆293Updated last month
• nlpyang / geval
  Code for paper "G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment"
  ☆258Updated 9 months ago
• stanford-futuredata / ARES
  Automated Evaluation of RAG Systems
  ☆482Updated last week
• kamalkraj / e5-mistral-7b-instruct
  Finetune mistral-7b-instruct for sentence embeddings
  ☆70Updated 6 months ago
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆202Updated 3 months ago