Alternatives and similar repositories for llm-comparator

Users that are interested in llm-comparator are comparing it to the libraries listed below

• prometheus-eval / prometheus-eval
  Evaluate your LLM's response with Prometheus and GPT4 💯
  ☆952Updated 2 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆282Updated 7 months ago
• alopatenko / LLMEvaluation
  A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…
  ☆122Updated last month
• huggingface / huggingface-llama-recipes
  ☆668Updated last month
• huggingface / cosmopedia
  ☆520Updated 7 months ago
• quotient-ai / judges
  A small library of LLM judges
  ☆216Updated last week
• mlabonne / llm-autoeval
  Automatically evaluate your LLMs in Google Colab
  ☆643Updated last year
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆552Updated last year
• ContextualAI / gritlm
  Generative Representational Instruction Tuning
  ☆654Updated 3 months ago
• potsawee / selfcheckgpt
  SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models
  ☆537Updated last year
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆246Updated 4 months ago
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆332Updated this week
• stanford-futuredata / ARES
  Automated Evaluation of RAG Systems
  ☆613Updated 2 months ago
• mlfoundations / evalchemy
  Automatic evals for LLMs
  ☆437Updated 2 weeks ago
• agent-husky / Husky-v1
  Code for Husky, an open-source language agent that solves complex, multi-step reasoning tasks. Husky v1 addresses numerical, tabular and …
  ☆345Updated last year
• run-llama / finetune-embedding
  Fine-Tuning Embedding for RAG with Synthetic Data
  ☆501Updated last year
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆259Updated 6 months ago
• argilla-io / synthetic-data-generator
  Build datasets using natural language
  ☆493Updated last month
• stephenleo / llm-structured-output-benchmarks
  Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…
  ☆173Updated 9 months ago
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆242Updated 8 months ago
• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆1,641Updated this week
• stanford-oval / suql
  SUQL: Conversational Search over Structured and Unstructured Data with LLMs
  ☆270Updated 3 weeks ago
• MinishLab / semhash
  Fast Semantic Text Deduplication & Filtering
  ☆738Updated 3 weeks ago
• castorini / rank_llm
  RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.
  ☆472Updated this week
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆135Updated 2 weeks ago
• AnswerDotAI / rerankers
  A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.
  ☆1,459Updated 3 weeks ago
• wandb / wandbot
  wandbot is a technical support bot for Weights & Biases' AI developer tools that can run in Discord, Slack, ChatGPT and Zendesk
  ☆301Updated this week
• whylabs / langkit
  🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…
  ☆921Updated 7 months ago
• arthur-ai / bench
  A tool for evaluating LLMs
  ☆419Updated last year
• IntelLabs / RAG-FiT
  Framework for enhancing LLMs for RAG tasks using fine-tuning.
  ☆741Updated last month