Alternatives and similar repositories for lmeval

Users that are interested in lmeval are comparing it to the libraries listed below

• weaviate / gorilla
  Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.
  ☆132Updated last month
• SalesforceAIResearch / SFR-RAG
  ☆75Updated 4 months ago
• LLMSELECTOR / LLMSELECTOR
  ☆68Updated 3 months ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆164Updated 8 months ago
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆243Updated 3 months ago
• agent-husky / Husky-v1
  Code for Husky, an open-source language agent that solves complex, multi-step reasoning tasks. Husky v1 addresses numerical, tabular and …
  ☆345Updated 11 months ago
• jlscheerer / xtr-warp
  XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.
  ☆131Updated last month
• aymeric-roucher / GAIA
  Beating the GAIA benchmark with Transformers Agents. 🚀
  ☆121Updated 3 months ago
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆53Updated 6 months ago
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆200Updated this week
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆87Updated last month
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆105Updated last month
• apple / ml-superposition-prompting
  ☆143Updated 10 months ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆207Updated 10 months ago
• menloresearch / ReZero
  ☆145Updated last month
• rungalileo / agent-leaderboard
  Ranking LLMs on agentic tasks
  ☆138Updated this week
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆93Updated 3 months ago
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆60Updated last week
• phunterlau / paper_without_code
  LLM reads a paper and produce a working prototype
  ☆57Updated last month
• cognitivecomputations / spectrum
  ☆121Updated 2 months ago
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆318Updated last week
• PrimeIntellect-ai / genesys
  ☆128Updated 2 months ago
• ArturTanona / grpo_unsloth_docker
  ☆57Updated 3 months ago
• MinorJerry / OpenWebVoyager
  ☆77Updated 7 months ago
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆214Updated this week
• microsoft / lost_in_conversation
  Code that accompanies the public release of the paper Lost in Conversation (https://arxiv.org/abs/2505.06120)
  ☆125Updated 3 weeks ago
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆221Updated 7 months ago
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆137Updated 10 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆116Updated this week
• dottxt-ai / prompts
  A prompting library
  ☆165Updated 8 months ago