Alternatives and similar repositories for lmeval

Users that are interested in lmeval are comparing it to the libraries listed below

• rungalileo / agent-leaderboard
  Ranking LLMs on agentic tasks
  ☆207Updated last month
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆250Updated this week
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆253Updated 10 months ago
• jina-ai / correlations
  Simple UI for debugging correlations of text embeddings
  ☆306Updated 7 months ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆241Updated last year
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆237Updated last year
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆276Updated this week
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆423Updated last week
• LLMSELECTOR / LLMSELECTOR
  ☆79Updated 3 months ago
• jlscheerer / xtr-warp
  XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.
  ☆175Updated 8 months ago
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆107Updated 10 months ago
• OpenPipe / open_deep_research_training
  Training setup for Langchain's Open Deep Research
  ☆74Updated 4 months ago
• apple / ml-superposition-prompting
  ☆147Updated last year
• NVlabs / UniversalDeepResearch
  Code to accompany the Universal Deep Research paper (https://arxiv.org/abs/2509.00244)
  ☆456Updated 4 months ago
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆115Updated 9 months ago
• diffbot / diffbot-llm-inference
  DIffbot LLM Inference Server
  ☆222Updated 4 months ago
• huggingface / gpt-oss-recipes
  Collection of scripts and notebooks for OpenAI's latest GPT OSS models
  ☆494Updated 4 months ago
• bentoml / llm-optimizer
  Benchmark and optimize LLM inference across frameworks with ease
  ☆153Updated 3 months ago
• weaviate / gorilla
  Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.
  ☆140Updated 4 months ago
• QuixiAI / spectrum
  ☆138Updated 4 months ago
• willkurt / token-explorer
  A simple tool that let's you explore different possible paths that an LLM might sample.
  ☆199Updated 8 months ago
• flowaicom / flow-judge
  Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…
  ☆81Updated last year
• SalesforceAIResearch / SFR-RAG
  ☆82Updated 2 months ago
• huggingface / finepdfs
  Codebase for FinePDFs
  ☆159Updated 2 months ago
• janhq / verifiers-deepresearch
  Verifiers for LLM Reinforcement Learning
  ☆80Updated 4 months ago
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆276Updated last year
• vaughanlove / PromptBreeder
  Google Deepmind's PromptBreeder for automated prompt engineering implemented in langchain expression language.
  ☆163Updated last year
• ali-bahrainian / RAG_best_practices
  ☆104Updated 9 months ago
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆111Updated 8 months ago
• togethercomputer / open_deep_research
  Together Open Deep Research
  ☆356Updated 8 months ago