bentoml / llm-optimizerLinks
Benchmark and optimize LLM inference across frameworks with ease
☆151Updated 3 months ago
Alternatives and similar repositories for llm-optimizer
Users that are interested in llm-optimizer are comparing it to the libraries listed below
Sorting:
- Codebase for FinePDFs☆156Updated last month
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆115Updated 8 months ago
- ☆235Updated last month
- A framework for fine-tuning retrieval-augmented generation (RAG) systems.☆137Updated last week
- Developer Asset Hub for NVIDIA Nemotron — A one-stop resource for training recipes, usage cookbooks, and full end-to-end reference exampl…☆246Updated this week
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆128Updated 10 months ago
- This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang/tree/main/docs.☆95Updated last week
- Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation☆108Updated last year
- Simple UI for debugging correlations of text embeddings☆306Updated 7 months ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆246Updated last week
- ☆79Updated 2 months ago
- A multi-agent LLM system for detecting and resolving cognitive dissonance.☆270Updated 2 months ago
- The code repository of the paper: Competition and Attraction Improve Model Fusion☆169Updated 4 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆78Updated last year
- ☆68Updated 7 months ago
- ☆107Updated last month
- Self-host LLMs with vLLM and BentoML☆162Updated last month
- Super basic implementation (gist-like) of RLMs with REPL environments.☆290Updated 2 months ago
- frozen-in-time version of our Paper Finder agent for reproducing evaluation results☆214Updated 4 months ago
- Simple examples using Argilla tools to build AI☆57Updated last year
- Source code for the collaborative reasoner research project at Meta FAIR.☆111Updated 8 months ago
- Code to accompany the Universal Deep Research paper (https://arxiv.org/abs/2509.00244)☆451Updated 4 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆34Updated 8 months ago
- ☆126Updated 3 months ago
- AI Agent that researches the lives of historical figures and extracts events into structured JSON timelines using LangGraph multi-agent o…☆218Updated 2 months ago
- A Lightweight Library for AI Observability☆252Updated 10 months ago
- DSPydantic: Auto-Optimize Your Pydantic Models with DSPy☆225Updated 2 weeks ago
- syftr is an agent optimizer that helps you find the best agentic workflows for your budget.☆323Updated 2 months ago
- ☆159Updated 2 months ago
- ☆159Updated 8 months ago