Alternatives and similar repositories for lmeval

Users that are interested in lmeval are comparing it to the libraries listed below

• rungalileo / agent-leaderboard
  Ranking LLMs on agentic tasks
  ☆211Updated 2 months ago
• jina-ai / correlations
  Simple UI for debugging correlations of text embeddings
  ☆305Updated 8 months ago
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆261Updated this week
• anyscale / llm-router
  Tutorial for building LLM router
  ☆244Updated last year
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆255Updated 11 months ago
• LLMSELECTOR / LLMSELECTOR
  ☆80Updated 4 months ago
• huggingface / gpt-oss-recipes
  Collection of scripts and notebooks for OpenAI's latest GPT OSS models
  ☆496Updated 5 months ago
• janhq / ReZero
  ☆159Updated 9 months ago
• aymeric-roucher / GAIA
  Beating the GAIA benchmark with Transformers Agents. 🚀
  ☆146Updated 11 months ago
• bentoml / llm-optimizer
  Benchmark and optimize LLM inference across frameworks with ease
  ☆161Updated 4 months ago
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆287Updated this week
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆426Updated last month
• NVlabs / UniversalDeepResearch
  Code to accompany the Universal Deep Research paper (https://arxiv.org/abs/2509.00244)
  ☆459Updated 5 months ago
• janhq / verifiers-deepresearch
  Verifiers for LLM Reinforcement Learning
  ☆81Updated 4 months ago
• argilla-io / synthetic-data-generator
  Build datasets using natural language
  ☆566Updated 4 months ago
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆107Updated 11 months ago
• jlscheerer / xtr-warp
  XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.
  ☆181Updated 9 months ago
• illuin-tech / vidore-benchmark
  Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.
  ☆259Updated 2 weeks ago
• huggingface / smol2operator
  ☆126Updated 4 months ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆239Updated last year
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆112Updated 9 months ago
• apple / ml-superposition-prompting
  ☆147Updated last year
• weaviate / gorilla
  Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.
  ☆140Updated 5 months ago
• huggingface / finepdfs
  Codebase for FinePDFs
  ☆174Updated last month
• ibm-granite / granite-3.0-language-models
  ☆270Updated 7 months ago
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆277Updated last year
• AnswerDotAI / fastdata
  ☆162Updated last year
• OpenPipe / open_deep_research_training
  Training setup for Langchain's Open Deep Research
  ☆74Updated 5 months ago
• chroma-core / context-rot
  This repository contains the toolkit for replicating results from our technical report.
  ☆200Updated 5 months ago
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆115Updated 9 months ago