bentoml / llm-optimizerLinks
Benchmark and optimize LLM inference across frameworks with ease
☆155Updated 4 months ago
Alternatives and similar repositories for llm-optimizer
Users that are interested in llm-optimizer are comparing it to the libraries listed below
Sorting:
- ☆236Updated last month
- Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation☆108Updated last year
- A Text-Based Environment for Interactive Debugging☆289Updated this week
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆256Updated last week
- ☆80Updated 3 months ago
- Codebase for FinePDFs☆161Updated last week
- ☆124Updated 3 months ago
- A framework for fine-tuning retrieval-augmented generation (RAG) systems.☆138Updated last week
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆81Updated last year
- A multi-agent LLM system for detecting and resolving cognitive dissonance.☆271Updated 3 months ago
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆132Updated 11 months ago
- XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.☆178Updated 8 months ago
- ☆68Updated 7 months ago
- Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.☆141Updated 4 months ago
- RapidFire AI: Rapid AI Customization from RAG to Fine-Tuning☆133Updated this week
- DSPydantic: Auto-Optimize Your Pydantic Models with DSPy☆238Updated last month
- ☆107Updated 2 months ago
- ScalarLM - a unified training and inference stack☆95Updated 2 months ago
- Code to accompany the Universal Deep Research paper (https://arxiv.org/abs/2509.00244)☆458Updated 4 months ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆114Updated 9 months ago
- Building blocks for agents in C++☆131Updated last week
- A Lightweight Library for AI Observability☆253Updated 10 months ago
- Simple examples using Argilla tools to build AI☆57Updated last year
- Self-host LLMs with vLLM and BentoML☆163Updated this week
- This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang☆97Updated this week
- The code repository of the paper: Competition and Attraction Improve Model Fusion☆169Updated 4 months ago
- Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research☆277Updated this week
- syftr is an agent optimizer that helps you find the best agentic workflows for your budget.☆326Updated 2 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆34Updated 8 months ago
- Routing on Random Forest (RoRF)☆238Updated last year