Alternatives and similar repositories for LLMEvaluation

Users that are interested in LLMEvaluation are comparing it to the libraries listed below

• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆305Updated 4 months ago
• apple / ml-superposition-prompting
  ☆146Updated last year
• quotient-ai / judges
  A small library of LLM judges
  ☆301Updated 3 months ago
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆153Updated last week
• predlico / ARAGOG
  ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…
  ☆114Updated last year
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆122Updated 2 weeks ago
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆297Updated last year
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆126Updated 2 years ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated last year
• stephenleo / llm-structured-output-benchmarks
  Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…
  ☆179Updated last year
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆275Updated last year
• deep-diver / llamaduo
  [ACL'25] Official Code for LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs
  ☆314Updated 4 months ago
• patronus-ai / financebench
  ☆225Updated 11 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆50Updated last year
• KarelDO / xmc.dspy
  In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.
  ☆442Updated last year
• MoritzLaurer / synthetic-data-blog
  This is the reproduction repository for my 🤗 Hugging Face blog post on synthetic data
  ☆68Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆111Updated last year
• rungalileo / hallucination-index
  Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.
  ☆115Updated 3 months ago
• PrithivirajDamodaran / Route0x
  Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da
  ☆117Updated 7 months ago
• MoritzLaurer / zeroshot-classifier
  Notebooks for training universal 0-shot classifiers on many different tasks
  ☆136Updated 10 months ago
• PAIR-code / llm-comparator
  LLM Comparator is an interactive data visualization tool for evaluating and analyzing LLM responses side-by-side, developed by the PAIR t…
  ☆495Updated 9 months ago
• patronus-ai / Lynx-hallucination-detection
  ☆43Updated last year
• illuin-tech / vidore-benchmark
  Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.
  ☆247Updated 3 months ago
• cvs-health / langfair
  LangFair is a Python library for conducting use-case level LLM bias and fairness assessments
  ☆241Updated 2 weeks ago
• microsoft / llm-data-creation
  Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"
  ☆134Updated 2 years ago
• ali-bahrainian / RAG_best_practices
  ☆96Updated 7 months ago
• naver / bergen
  Benchmarking library for RAG
  ☆239Updated last month
• mlabonne / llm-autoeval
  Automatically evaluate your LLMs in Google Colab
  ☆667Updated last year
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆264Updated 10 months ago
• jina-ai / correlations
  Simple UI for debugging correlations of text embeddings
  ☆299Updated 5 months ago