bentoml / llm-optimizerLinks
Benchmark and optimize LLM inference across frameworks with ease
☆41Updated this week
Alternatives and similar repositories for llm-optimizer
Users that are interested in llm-optimizer are comparing it to the libraries listed below
Sorting:
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆115Updated 7 months ago
- A framework for fine-tuning retrieval-augmented generation (RAG) systems.☆129Updated this week
- A multi-agent LLM system for detecting and resolving cognitive dissonance.☆251Updated 3 weeks ago
- syftr is an agent optimizer that helps you find the best agentic workflows for your budget.☆306Updated 2 weeks ago
- Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation☆105Updated 9 months ago
- ☆142Updated last month
- Synthetic Data Engine 💎☆64Updated this week
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆111Updated 5 months ago
- ☆36Updated 7 months ago
- Code to accompany the Universal Deep Research paper (https://arxiv.org/abs/2509.00244)☆370Updated 3 weeks ago
- Sculpt: Structuring unstructured data with LLMs☆35Updated 2 months ago
- Pivotal Token Search☆124Updated 2 months ago
- ☆231Updated 2 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆33Updated 4 months ago
- ☆296Updated last month
- ☆104Updated 3 months ago
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆85Updated last week
- ☆133Updated 2 months ago
- Routing on Random Forest (RoRF)☆203Updated 11 months ago
- An Automatic Prompt Optimization Framework for Large Language Models☆117Updated last month
- Train an adapter for any embedding model in under a minute☆126Updated 5 months ago
- ☆157Updated 3 weeks ago
- Train transformer language models with reinforcement learning.☆19Updated 6 months ago
- ☆68Updated 3 months ago
- VeritasGraph: Enterprise-Grade Graph RAG for Secure, On-Premise AI with Verifiable Attribution☆143Updated this week
- ☆102Updated 3 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆78Updated 10 months ago
- An AI agent library using Python as the common language to define executable actions and tool interfaces.☆84Updated last month
- A prompting library☆177Updated 2 months ago
- The code repository of the paper: Competition and Attraction Improve Model Fusion☆150Updated 3 weeks ago