google / lmevalLinks
☆232Updated 3 months ago
Alternatives and similar repositories for lmeval
Users that are interested in lmeval are comparing it to the libraries listed below
Sorting:
- Benchmark and optimize LLM inference across frameworks with ease☆124Updated last month
- Simple UI for debugging correlations of text embeddings☆296Updated 4 months ago
- A Lightweight Library for AI Observability☆251Updated 8 months ago
- Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.☆136Updated 2 months ago
- Ranking LLMs on agentic tasks☆194Updated last month
- Tutorial for building LLM router☆231Updated last year
- Collection of scripts and notebooks for OpenAI's latest GPT OSS models☆463Updated 2 months ago
- Super basic implementation (gist-like) of RLMs with REPL environments.☆204Updated last week
- Routing on Random Forest (RoRF)☆214Updated last year
- ☆79Updated 3 weeks ago
- A simple tool that let's you explore different possible paths that an LLM might sample.☆190Updated 5 months ago
- Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research☆254Updated this week
- 🤗 Benchmark Large Language Models Reliably On Your Data☆406Updated 3 weeks ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆110Updated 6 months ago
- Code to accompany the Universal Deep Research paper (https://arxiv.org/abs/2509.00244)☆446Updated 2 months ago
- XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.☆167Updated 5 months ago
- An Automatic Prompt Optimization Framework for Large Language Models☆130Updated 2 months ago
- ☆158Updated 6 months ago
- Solving data for LLMs - Create quality synthetic datasets!☆151Updated 9 months ago
- Beating the GAIA benchmark with Transformers Agents. 🚀☆138Updated 8 months ago
- Training setup for Langchain's Open Deep Research☆66Updated last month
- Code that accompanies the public release of the paper Lost in Conversation (https://arxiv.org/abs/2505.06120)☆175Updated 4 months ago
- ☆146Updated last year
- frozen-in-time version of our Paper Finder agent for reproducing evaluation results☆190Updated 2 months ago
- Train your own SOTA deductive reasoning model☆108Updated 7 months ago
- ☆84Updated 11 months ago
- ☆79Updated 9 months ago
- Simple examples using Argilla tools to build AI☆56Updated 11 months ago
- Banishing LLM Hallucinations Requires Rethinking Generalization☆275Updated last year
- Complex Function Calling Benchmark.☆139Updated 9 months ago