Alternatives and similar repositories for lmeval

Users that are interested in lmeval are comparing it to the libraries listed below

• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆246Updated this week
• jina-ai / correlations
  Simple UI for debugging correlations of text embeddings
  ☆305Updated 6 months ago
• rungalileo / agent-leaderboard
  Ranking LLMs on agentic tasks
  ☆204Updated last month
• bentoml / llm-optimizer
  Benchmark and optimize LLM inference across frameworks with ease
  ☆150Updated 3 months ago
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆252Updated 10 months ago
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆272Updated last week
• OpenHands / software-agent-sdk
  A clean, modular SDK for building AI agents with OpenHands V1.
  ☆360Updated this week
• willkurt / token-explorer
  A simple tool that let's you explore different possible paths that an LLM might sample.
  ☆196Updated 7 months ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆235Updated last year
• OpenPipe / open_deep_research_training
  Training setup for Langchain's Open Deep Research
  ☆73Updated 3 months ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆239Updated last year
• alexzhang13 / rlm
  Super basic implementation (gist-like) of RLMs with REPL environments.
  ☆286Updated 2 months ago
• huggingface / gpt-oss-recipes
  Collection of scripts and notebooks for OpenAI's latest GPT OSS models
  ☆485Updated 4 months ago
• NVlabs / UniversalDeepResearch
  Code to accompany the Universal Deep Research paper (https://arxiv.org/abs/2509.00244)
  ☆451Updated 3 months ago
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆115Updated 8 months ago
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆111Updated 8 months ago
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆419Updated last week
• janhq / ReZero
  ☆159Updated 8 months ago
• LLMSELECTOR / LLMSELECTOR
  ☆79Updated 2 months ago
• weaviate / gorilla
  Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.
  ☆139Updated 4 months ago
• huggingface / finepdfs
  Codebase for FinePDFs
  ☆156Updated last month
• huggingface / skills
  ☆686Updated this week
• illuin-tech / vidore-benchmark
  Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.
  ☆254Updated 4 months ago
• obalcells / hallucination_probes
  Real-Time Detection of Hallucinated Entities in Long-Form Generation
  ☆273Updated last month
• SakanaAI / treequest
  A Tree Search Library with Flexible API for LLM Inference-Time Scaling
  ☆504Updated 2 weeks ago
• SalesforceAIResearch / SFR-RAG
  ☆81Updated last month
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆107Updated 9 months ago
• zai-org / ComplexFuncBench
  Complex Function Calling Benchmark.
  ☆159Updated 11 months ago
• huggingface / huggingface-gemma-recipes
  Inference, Fine Tuning and many more recipes with Gemma family of models
  ☆276Updated 5 months ago
• ArturTanona / grpo_unsloth_docker
  ☆57Updated 10 months ago