Alternatives and similar repositories for llm-comparator:

Users that are interested in llm-comparator are comparing it to the libraries listed below

• prometheus-eval / prometheus-eval
  Evaluate your LLM's response with Prometheus and GPT4 💯
  ☆854Updated 3 weeks ago
• stanford-futuredata / ARES
  Automated Evaluation of RAG Systems
  ☆532Updated 2 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆256Updated 3 months ago
• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆1,022Updated this week
• huggingface / cosmopedia
  ☆489Updated 2 months ago
• prometheus-eval / prometheus
  [ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically d…
  ☆295Updated last year
• ibm-granite / granite-3.0-language-models
  ☆243Updated last month
• mlabonne / llm-autoeval
  Automatically evaluate your LLMs in Google Colab
  ☆583Updated 8 months ago
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆269Updated 6 months ago
• metauto-ai / agent-as-a-judge
  🤠 Agent-as-a-Judge and DevAI dataset
  ☆313Updated last week
• IntelLabs / RAG-FiT
  Framework for enhancing LLMs for RAG tasks using fine-tuning.
  ☆522Updated last month
• AnswerDotAI / rerankers
  A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.
  ☆1,260Updated last week
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆493Updated 10 months ago
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆439Updated 3 weeks ago
• agent-husky / Husky-v1
  Code for Husky, an open-source language agent that solves complex, multi-step reasoning tasks. Husky v1 addresses numerical, tabular and …
  ☆332Updated 7 months ago
• TIGER-AI-Lab / LongRAG
  Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".
  ☆213Updated 5 months ago
• zorazrw / agent-workflow-memory
  AWM: Agent Workflow Memory
  ☆233Updated 2 months ago
• potsawee / selfcheckgpt
  SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models
  ☆491Updated 7 months ago
• xfactlab / orpo
  Official repository for ORPO
  ☆432Updated 7 months ago
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆249Updated last month
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆119Updated 2 months ago
• athina-ai / athina-evals
  Python SDK for running evaluations on LLM generated responses
  ☆255Updated 2 weeks ago
• jina-ai / late-chunking
  Code for explaining and evaluating late chunking (chunked pooling)
  ☆313Updated last month
• apple / ToolSandbox
  ☆151Updated 5 months ago
• ContextualAI / gritlm
  Generative Representational Instruction Tuning
  ☆588Updated last week
• huggingface / evaluation-guidebook
  Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…
  ☆971Updated 3 weeks ago
• tianyi-lab / Reflection_Tuning
  [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
  ☆347Updated 4 months ago
• apple / ml-superposition-prompting
  ☆137Updated 6 months ago
• argilla-io / distilabel
  Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…
  ☆2,064Updated this week
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆190Updated 3 months ago