Alternatives and similar repositories for lmeval

Users that are interested in lmeval are comparing it to the libraries listed below

• anyscale / llm-router
  Tutorial for building LLM router
  ☆224Updated last year
• rungalileo / agent-leaderboard
  Ranking LLMs on agentic tasks
  ☆180Updated last week
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆250Updated 6 months ago
• huggingface / gpt-oss-recipes
  Collection of scripts and notebooks for OpenAI's latest GPT OSS models
  ☆398Updated last week
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆223Updated this week
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆195Updated 11 months ago
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆387Updated this week
• willkurt / token-explorer
  A simple tool that let's you explore different possible paths that an LLM might sample.
  ☆184Updated 3 months ago
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆111Updated 4 months ago
• jina-ai / correlations
  Simple UI for debugging correlations of text embeddings
  ☆289Updated 2 months ago
• weaviate / gorilla
  Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.
  ☆133Updated 2 months ago
• aymeric-roucher / GAIA
  Beating the GAIA benchmark with Transformers Agents. 🚀
  ☆132Updated 6 months ago
• jlscheerer / xtr-warp
  XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.
  ☆154Updated 3 months ago
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆104Updated 5 months ago
• SalesforceAIResearch / SFR-RAG
  ☆77Updated 7 months ago
• LLMSELECTOR / LLMSELECTOR
  ☆74Updated 6 months ago
• menloresearch / ReZero
  ☆155Updated 4 months ago
• illuin-tech / vidore-benchmark
  Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.
  ☆232Updated 3 weeks ago
• QuixiAI / spectrum
  ☆134Updated this week
• togethercomputer / open_deep_research
  Together Open Deep Research
  ☆334Updated 4 months ago
• apple / ml-superposition-prompting
  ☆145Updated last year
• BhabhaAI / dataformer
  Solving data for LLMs - Create quality synthetic datasets!
  ☆151Updated 7 months ago
• agent-husky / Husky-v1
  Code for Husky, an open-source language agent that solves complex, multi-step reasoning tasks. Husky v1 addresses numerical, tabular and …
  ☆345Updated last year
• AnswerDotAI / fastdata
  ☆155Updated 8 months ago
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆101Updated 4 months ago
• diffbot / diffbot-llm-inference
  DIffbot LLM Inference Server
  ☆184Updated this week
• DeepSoftwareAnalytics / Awesome-Agent4SE
  ☆97Updated 11 months ago
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆276Updated last year
• microsoft / debug-gym
  A Text-Based Environment for Interactive Debugging
  ☆256Updated this week
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆88Updated this week