LLM Comparator is an interactive data visualization tool for evaluating and analyzing LLM responses side-by-side, developed by the PAIR team.
☆525Feb 11, 2025Updated last year
Alternatives and similar repositories for llm-comparator
Users that are interested in llm-comparator are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Simple method to create notebook-ready visual analytics tools!☆32May 2, 2023Updated 3 years ago
- Visualize your text data with structured attributes☆34Apr 11, 2025Updated last year
- ☆23Jun 23, 2026Updated 4 months ago
- Interactively and visually explore large-scale image datasets used in machine learning using treemaps. VIS 2022☆49Jun 19, 2024Updated 2 years ago
- The Learning Interpretability Tool: Interactively analyze ML models to understand their behavior in an extensible and framework agnostic …☆3,671Oct 7, 2026Updated 3 weeks ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Explore 160+ notebook visual analytics tools in your browser!☆68Mar 29, 2024Updated 2 years ago
- vision-language study material☆10Jun 19, 2025Updated last year
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆3,451Updated this week
- Angler: Machine Translation Visualization (CHI 2023)☆68Sep 11, 2026Updated last month
- ☆210Jun 26, 2025Updated last year
- DSPy: The framework for programming—not prompting—language models☆38,904Updated this week
- Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets☆5,194Updated this week
- A unified evaluation framework for large language models☆2,820Feb 20, 2026Updated 8 months ago
- 자체 구축한 한국어 평가 데이터셋을 이용한 한국어 모델 평가☆31May 31, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,578Updated this week
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…☆31Aug 25, 2023Updated 3 years ago
- Open-source RAG evaluation through users' feedback☆222Apr 14, 2024Updated 2 years ago
- Alternative implementation of the coreference scorer for the CoNLL-2011/2012 shared tasks on coreference resolution☆11Apr 29, 2021Updated 5 years ago
- Structured Outputs☆16,003Sep 21, 2026Updated last month
- Streamlines and simplifies prompt design for both developers and non-technical users with a low code approach.☆1,162Feb 12, 2026Updated 8 months ago
- Model Alignment is a python library from the PAIR team that enable users to create model prompts through user feedback instead of manual …☆43Oct 30, 2025Updated last year
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆3,417Updated this week
- ☆12Aug 30, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Repository for Multililngual Generation, RAG evaluations, and surrogate judge training for Arena RAG leaderboard (NAACL'25)☆11Apr 10, 2025Updated last year
- Efficient vector database for hundred millions of embeddings.☆218May 17, 2024Updated 2 years ago
- The LLM Evaluation Framework☆19,272Updated this week
- Go ahead and axolotl questions☆12,667Updated this week
- Tools for merging pretrained large language models.☆7,430Updated this week
- Coreference databases and augmented corpora☆10Mar 10, 2020Updated 6 years ago
- The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build cu…☆10,790Updated this week
- Harness LLMs with Multi-Agent Programming☆4,125Updated this week
- This repository compiles code samples and notebooks demonstrating how to use Generative AI on Google Cloud Vertex AI.☆857Jan 6, 2026Updated 9 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 🤗 Benchmark Large Language Models Reliably On Your Data☆461Oct 14, 2026Updated 3 weeks ago
- General technology for enabling AI capabilities w/ LLMs and MLLMs☆4,484Sep 15, 2026Updated last month
- TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients. Published in Nature.☆3,787Jul 25, 2025Updated last year
- Your Personal Librarian Agent. Ask anything on your computer, organize files, remember important info and files.☆5,327Updated this week
- A library for generative social simulation☆1,854Updated this week
- Supercharge Your LLM Application Evaluations 🚀☆16,236Feb 24, 2026Updated 8 months ago
- structured outputs for llms☆14,094Updated this week