Alternatives and similar repositories for llm-comparator

Users that are interested in llm-comparator are comparing it to the libraries listed below

• alopatenko / LLMEvaluation
  A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…
  ☆164Updated 2 weeks ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆241Updated last year
• prometheus-eval / prometheus-eval
  Evaluate your LLM's response with Prometheus and GPT4 💯
  ☆1,029Updated 8 months ago
• stanford-futuredata / ARES
  Automated Evaluation of RAG Systems
  ☆683Updated 9 months ago
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆276Updated last year
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆253Updated 10 months ago
• mlabonne / llm-autoeval
  Automatically evaluate your LLMs in Google Colab
  ☆679Updated last year
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆320Updated this week
• deep-diver / llamaduo
  [ACL'25] Official Code for LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs
  ☆314Updated 5 months ago
• CYQIQ / MultiCoT
  Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph
  ☆148Updated last year
• arthur-ai / bench
  A tool for evaluating LLMs
  ☆428Updated last year
• KarelDO / xmc.dspy
  In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.
  ☆446Updated last year
• deepset-ai / haystack-cookbook
  👩🏻‍🍳 A collection of example notebooks using Haystack
  ☆517Updated last week
• ServiceNow / TapeAgents
  TapeAgents is a framework that facilitates all stages of the LLM Agent development lifecycle
  ☆302Updated 3 weeks ago
• quotient-ai / judges
  A small library of LLM judges
  ☆311Updated 5 months ago
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆423Updated last week
• rungalileo / hallucination-index
  Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.
  ☆116Updated 5 months ago
• stanford-oval / suql
  SUQL: Conversational Search over Structured and Unstructured Data with LLMs
  ☆295Updated 2 months ago
• google-deepmind / long-form-factuality
  Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".
  ☆663Updated this week
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆313Updated last year
• simbianai / taskgen
  Task-based Agentic Framework using StrictJSON as the core
  ☆462Updated last month
• tonywu71 / colpali-cookbooks
  Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻‍🍳
  ☆351Updated 7 months ago
• stephenleo / llm-structured-output-benchmarks
  Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…
  ☆183Updated last year
• google / lmeval
  ☆236Updated last month
• apple / ml-superposition-prompting
  ☆147Updated last year
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆159Updated 2 months ago
• rungalileo / agent-leaderboard
  Ranking LLMs on agentic tasks
  ☆207Updated last month
• AymenKallala / RAG_Maestro
  Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.
  ☆166Updated last year
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆587Updated last year
• microsoft / Trace
  End-to-end Generative Optimization for AI Agents
  ☆704Updated last month