Alternatives and similar repositories for llm-comparator

Users that are interested in llm-comparator are comparing it to the libraries listed below

• alopatenko / LLMEvaluation
  A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…
  ☆162Updated 2 weeks ago
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆419Updated this week
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆252Updated 10 months ago
• mlabonne / llm-autoeval
  Automatically evaluate your LLMs in Google Colab
  ☆675Updated last year
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆275Updated last year
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆314Updated last month
• quotient-ai / judges
  A small library of LLM judges
  ☆308Updated 4 months ago
• stanford-futuredata / ARES
  Automated Evaluation of RAG Systems
  ☆679Updated 8 months ago
• meta-llama / prompt-ops
  An open-source tool for LLM prompt optimization.
  ☆728Updated 3 weeks ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆239Updated last year
• ServiceNow / TapeAgents
  TapeAgents is a framework that facilitates all stages of the LLM Agent development lifecycle
  ☆300Updated this week
• google / lmeval
  ☆235Updated 3 weeks ago
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆125Updated last month
• prometheus-eval / prometheus-eval
  Evaluate your LLM's response with Prometheus and GPT4 💯
  ☆1,020Updated 7 months ago
• KarelDO / xmc.dspy
  In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.
  ☆444Updated last year
• wandb / wandbot
  wandbot is a technical support bot for Weights & Biases' AI developer tools that can run in Discord, Slack, ChatGPT and Zendesk
  ☆309Updated last month
• deep-diver / llamaduo
  [ACL'25] Official Code for LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs
  ☆314Updated 5 months ago
• IntelLabs / RAG-FiT
  Framework for enhancing LLMs for RAG tasks using fine-tuning.
  ☆758Updated 6 months ago
• argilla-io / synthetic-data-generator
  Build datasets using natural language
  ☆552Updated 3 months ago
• stanford-oval / suql
  SUQL: Conversational Search over Structured and Unstructured Data with LLMs
  ☆293Updated last month
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆308Updated last year
• neuml / annotateai
  📝 Automatically annotate papers using LLMs
  ☆391Updated 2 weeks ago
• lamini-ai / lamini-examples
  ☆164Updated 10 months ago
• philschmid / easyllm
  ☆468Updated last year
• tonywu71 / colpali-cookbooks
  Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻‍🍳
  ☆348Updated 6 months ago
• simbianai / taskgen
  Task-based Agentic Framework using StrictJSON as the core
  ☆462Updated 3 weeks ago
• ibm-granite / granite-3.0-language-models
  ☆267Updated 5 months ago
• predlico / ARAGOG
  ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…
  ☆114Updated last year
• ganarajpr / awesome-dspy
  An Awesome list of curated DSPy resources.
  ☆487Updated last week
• CYQIQ / MultiCoT
  Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph
  ☆148Updated last year