Alternatives and similar repositories for llm-comparator

Users that are interested in llm-comparator are comparing it to the libraries listed below

• prometheus-eval / prometheus-eval
  Evaluate your LLM's response with Prometheus and GPT4 💯
  ☆989Updated 4 months ago
• mlabonne / llm-autoeval
  Automatically evaluate your LLMs in Google Colab
  ☆659Updated last year
• ServiceNow / TapeAgents
  TapeAgents is a framework that facilitates all stages of the LLM Agent development lifecycle
  ☆296Updated 2 weeks ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆228Updated last year
• stanford-futuredata / ARES
  Automated Evaluation of RAG Systems
  ☆656Updated 5 months ago
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆276Updated last year
• alopatenko / LLMEvaluation
  A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…
  ☆140Updated last month
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆251Updated 7 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆297Updated 2 months ago
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆392Updated 2 weeks ago
• quotient-ai / judges
  A small library of LLM judges
  ☆282Updated last month
• Liyan06 / MiniCheck
  MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents [EMNLP 2024]
  ☆183Updated 3 weeks ago
• google-deepmind / long-form-factuality
  Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".
  ☆641Updated last month
• deep-diver / llamaduo
  [ACL'25] Official Code for LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs
  ☆314Updated 2 months ago
• google / lmeval
  ☆231Updated 2 months ago
• rungalileo / agent-leaderboard
  Ranking LLMs on agentic tasks
  ☆184Updated last week
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆282Updated 11 months ago
• microsoft / MS-MARCO-Web-Search
  A large-scale information-rich web dataset, featuring millions of real clicked query-document labels
  ☆342Updated 9 months ago
• argilla-io / synthetic-data-generator
  Build datasets using natural language
  ☆528Updated 4 months ago
• deepset-ai / haystack-cookbook
  👩🏻‍🍳 A collection of example notebooks using Haystack
  ☆501Updated 2 weeks ago
• stephenleo / llm-structured-output-benchmarks
  Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…
  ☆178Updated last year
• microsoft / Trace
  End-to-end Generative Optimization for AI Agents
  ☆645Updated last month
• jina-ai / correlations
  Simple UI for debugging correlations of text embeddings
  ☆291Updated 3 months ago
• wandb / wandbot
  wandbot is a technical support bot for Weights & Biases' AI developer tools that can run in Discord, Slack, ChatGPT and Zendesk
  ☆307Updated last month
• jina-ai / late-chunking
  Code for explaining and evaluating late chunking (chunked pooling)
  ☆452Updated 8 months ago
• patronus-ai / financebench
  ☆207Updated 9 months ago
• arthur-ai / bench
  A tool for evaluating LLMs
  ☆423Updated last year
• apple / ml-superposition-prompting
  ☆145Updated last year
• datadreamer-dev / DataDreamer
  DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models.   🤖💤
  ☆1,059Updated 7 months ago
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆117Updated this week