Alternatives and similar repositories for lmeval

Users that are interested in lmeval are comparing it to the libraries listed below

• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆246Updated 4 months ago
• rungalileo / agent-leaderboard
  Ranking LLMs on agentic tasks
  ☆147Updated 2 weeks ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆216Updated 11 months ago
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆359Updated this week
• jlscheerer / xtr-warp
  XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.
  ☆137Updated 2 months ago
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆211Updated this week
• weaviate / gorilla
  Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.
  ☆132Updated last month
• jina-ai / correlations
  Simple UI for debugging correlations of text embeddings
  ☆287Updated last month
• aymeric-roucher / GAIA
  Beating the GAIA benchmark with Transformers Agents. 🚀
  ☆128Updated 4 months ago
• SalesforceAIResearch / SFR-RAG
  ☆76Updated 6 months ago
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆108Updated 3 months ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆176Updated 9 months ago
• BhabhaAI / dataformer
  Solving data for LLMs - Create quality synthetic datasets!
  ☆150Updated 5 months ago
• apple / ml-superposition-prompting
  ☆144Updated 11 months ago
• diffbot / diffbot-llm-inference
  DIffbot LLM Inference Server
  ☆179Updated 4 months ago
• microsoft / lost_in_conversation
  Code that accompanies the public release of the paper Lost in Conversation (https://arxiv.org/abs/2505.06120)
  ☆141Updated 3 weeks ago
• topoteretes / awesome-ai-memory
  A list of AI memory projects
  ☆168Updated 6 months ago
• ibm-granite / granite-3.0-language-models
  ☆259Updated 3 weeks ago
• VectorInstitute / fed-rag
  A framework for fine-tuning retrieval-augmented generation (RAG) systems.
  ☆121Updated last week
• argilla-io / synthetic-data-generator
  Build datasets using natural language
  ☆500Updated 2 months ago
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆276Updated last year
• stephenleo / llm-structured-output-benchmarks
  Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…
  ☆173Updated 9 months ago
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆53Updated 7 months ago
• LLMSELECTOR / LLMSELECTOR
  ☆71Updated 4 months ago
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆94Updated 2 months ago
• togethercomputer / open_deep_research
  Together Open Deep Research
  ☆320Updated 3 months ago
• menloresearch / ReZero
  ☆156Updated 2 months ago
• agent-husky / Husky-v1
  Code for Husky, an open-source language agent that solves complex, multi-step reasoning tasks. Husky v1 addresses numerical, tabular and …
  ☆345Updated last year
• phunterlau / paper_without_code
  LLM reads a paper and produce a working prototype
  ☆58Updated 3 months ago
• codelion / adaptive-classifier
  A flexible, adaptive classification system for dynamic text classification
  ☆336Updated 3 weeks ago