bentoml / llm-optimizerLinks
Benchmark and optimize LLM inference across frameworks with ease
☆131Updated 2 months ago
Alternatives and similar repositories for llm-optimizer
Users that are interested in llm-optimizer are comparing it to the libraries listed below
Sorting:
- ☆234Updated 4 months ago
- Super basic implementation (gist-like) of RLMs with REPL environments.☆248Updated last month
- Simple UI for debugging correlations of text embeddings☆299Updated 5 months ago
- A Lightweight Library for AI Observability☆251Updated 8 months ago
- A multi-agent LLM system for detecting and resolving cognitive dissonance.☆268Updated last month
- Code to accompany the Universal Deep Research paper (https://arxiv.org/abs/2509.00244)☆449Updated 2 months ago
- A framework for fine-tuning retrieval-augmented generation (RAG) systems.☆135Updated this week
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆111Updated 7 months ago
- Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation☆105Updated 11 months ago
- An Automatic Prompt Optimization Framework for Large Language Models☆137Updated 3 months ago
- ScalarLM - a unified training and inference stack☆93Updated this week
- Routing on Random Forest (RoRF)☆220Updated last year
- The code repository of the paper: Competition and Attraction Improve Model Fusion☆165Updated 2 months ago
- syftr is an agent optimizer that helps you find the best agentic workflows for your budget.☆320Updated 3 weeks ago
- ☆107Updated 2 weeks ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆78Updated last year
- frozen-in-time version of our Paper Finder agent for reproducing evaluation results☆205Updated 2 months ago
- Source code for the collaborative reasoner research project at Meta FAIR.☆105Updated 7 months ago
- Train your own SOTA deductive reasoning model☆107Updated 8 months ago
- Simple & Scalable Pretraining for Neural Architecture Research☆299Updated 2 weeks ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆100Updated last week
- A Text-Based Environment for Interactive Debugging☆276Updated last week
- Luth is a state-of-the-art series of fine-tuned LLMs for French☆39Updated last month
- craft post-training data recipes☆60Updated this week
- Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.☆138Updated 2 months ago
- ☆211Updated this week
- Inference, Fine Tuning and many more recipes with Gemma family of models☆275Updated 4 months ago
- XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.☆169Updated 6 months ago
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆125Updated 9 months ago
- Efficient non-uniform quantization with GPTQ for GGUF☆53Updated 2 months ago