bentoml / llm-optimizerLinks
Benchmark and optimize LLM inference across frameworks with ease
☆113Updated 3 weeks ago
Alternatives and similar repositories for llm-optimizer
Users that are interested in llm-optimizer are comparing it to the libraries listed below
Sorting:
- ☆232Updated 3 months ago
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆117Updated 7 months ago
- An Automatic Prompt Optimization Framework for Large Language Models☆122Updated 2 months ago
- A framework for fine-tuning retrieval-augmented generation (RAG) systems.☆130Updated this week
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆96Updated this week
- frozen-in-time version of our Paper Finder agent for reproducing evaluation results☆187Updated last month
- Source code for the collaborative reasoner research project at Meta FAIR.☆102Updated 5 months ago
- A multi-agent LLM system for detecting and resolving cognitive dissonance.☆267Updated last month
- Simple UI for debugging correlations of text embeddings☆292Updated 4 months ago
- GPTQ and efficient search for GGUF☆50Updated 3 weeks ago
- Code to accompany the Universal Deep Research paper (https://arxiv.org/abs/2509.00244)☆441Updated last month
- syftr is an agent optimizer that helps you find the best agentic workflows for your budget.☆310Updated 3 weeks ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆111Updated 6 months ago
- ☆68Updated 4 months ago
- ☆104Updated 3 months ago
- The code repository of the paper: Competition and Attraction Improve Model Fusion☆159Updated last month
- Routing on Random Forest (RoRF)☆212Updated last year
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆78Updated 11 months ago
- Pivotal Token Search☆126Updated 2 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆33Updated 5 months ago
- Simple examples using Argilla tools to build AI☆56Updated 10 months ago
- XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.☆166Updated 5 months ago
- Train your own SOTA deductive reasoning model☆107Updated 7 months ago
- SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?☆181Updated this week
- Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles☆56Updated 5 months ago
- Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation☆105Updated 9 months ago
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆87Updated 3 weeks ago
- ☆36Updated 8 months ago
- Verifiers for LLM Reinforcement Learning☆75Updated 3 weeks ago
- Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖☆75Updated 10 months ago