Alternatives and similar repositories for lmeval

Users that are interested in lmeval are comparing it to the libraries listed below

• jina-ai / correlations
  Simple UI for debugging correlations of text embeddings
  ☆299Updated 5 months ago
• rungalileo / agent-leaderboard
  Ranking LLMs on agentic tasks
  ☆199Updated 2 months ago
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆259Updated this week
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆111Updated 7 months ago
• bentoml / llm-optimizer
  Benchmark and optimize LLM inference across frameworks with ease
  ☆131Updated 2 months ago
• alexzhang13 / rlm
  Super basic implementation (gist-like) of RLMs with REPL environments.
  ☆248Updated 3 weeks ago
• huggingface / gpt-oss-recipes
  Collection of scripts and notebooks for OpenAI's latest GPT OSS models
  ☆477Updated 2 months ago
• aymeric-roucher / GAIA
  Beating the GAIA benchmark with Transformers Agents. 🚀
  ☆138Updated 8 months ago
• janhq / ReZero
  ☆158Updated 6 months ago
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆410Updated last month
• apple / ml-superposition-prompting
  ☆146Updated last year
• anyscale / llm-router
  Tutorial for building LLM router
  ☆235Updated last year
• LLMSELECTOR / LLMSELECTOR
  ☆79Updated last month
• NVlabs / UniversalDeepResearch
  Code to accompany the Universal Deep Research paper (https://arxiv.org/abs/2509.00244)
  ☆447Updated 2 months ago
• MinorJerry / OpenWebVoyager
  ☆84Updated last year
• weaviate / gorilla
  Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.
  ☆136Updated 2 months ago
• SalesforceAIResearch / promptomatix
  An Automatic Prompt Optimization Framework for Large Language Models
  ☆137Updated 3 months ago
• SalesforceAIResearch / SFR-RAG
  ☆79Updated last week
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆108Updated 8 months ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆220Updated last year
• illuin-tech / vidore-benchmark
  Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.
  ☆249Updated 3 months ago
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆251Updated 8 months ago
• OpenPipe / open_deep_research_training
  Training setup for Langchain's Open Deep Research
  ☆70Updated 2 months ago
• microsoft / lost_in_conversation
  Code that accompanies the public release of the paper Lost in Conversation (https://arxiv.org/abs/2505.06120)
  ☆178Updated 4 months ago
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆105Updated 6 months ago
• huggingface / finepdfs
  Codebase for FinePDFs
  ☆135Updated last week
• QuixiAI / spectrum
  ☆138Updated 2 months ago
• hljoren / sufficientcontext
  Official page for ICLR 2025 paper "Sufficient Context: A New Lens on Retrieval Augmented Generation Systems"
  ☆53Updated 3 months ago
• SakanaAI / treequest
  A Tree Search Library with Flexible API for LLM Inference-Time Scaling
  ☆488Updated this week
• allenai / asta-paper-finder
  frozen-in-time version of our Paper Finder agent for reproducing evaluation results
  ☆200Updated 2 months ago