Alternatives and similar repositories for llm-optimizer

Users that are interested in llm-optimizer are comparing it to the libraries listed below

• google / lmeval
  ☆234Updated last week
• langfuse / oss-llmops-stack
  Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…
  ☆127Updated 9 months ago
• tensorwavecloud / ScalarLM
  ScalarLM - a unified training and inference stack
  ☆94Updated 3 weeks ago
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆225Updated last week
• VectorInstitute / fed-rag
  A framework for fine-tuning retrieval-augmented generation (RAG) systems.
  ☆137Updated this week
• datarobot / syftr
  syftr is an agent optimizer that helps you find the best agentic workflows for your budget.
  ☆322Updated last month
• NVlabs / UniversalDeepResearch
  Code to accompany the Universal Deep Research paper (https://arxiv.org/abs/2509.00244)
  ☆450Updated 3 months ago
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆252Updated 9 months ago
• SakanaAI / natural_niches
  The code repository of the paper: Competition and Attraction Improve Model Fusion
  ☆167Updated 3 months ago
• kolenaIO / autoarena
  Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation
  ☆108Updated 11 months ago
• microsoft / debug-gym
  A Text-Based Environment for Interactive Debugging
  ☆282Updated last week
• evalops / cognitive-dissonance-dspy
  A multi-agent LLM system for detecting and resolving cognitive dissonance.
  ☆269Updated last month
• alexzhang13 / rlm
  Super basic implementation (gist-like) of RLMs with REPL environments.
  ☆278Updated last month
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆161Updated 2 weeks ago
• codelion / pts
  Pivotal Token Search
  ☆132Updated this week
• jina-ai / correlations
  Simple UI for debugging correlations of text embeddings
  ☆302Updated 6 months ago
• SalesforceAIResearch / promptomatix
  An Automatic Prompt Optimization Framework for Large Language Models
  ☆141Updated 4 months ago
• NVIDIA-NeMo / DataDesigner
  A general library for generating high-quality synthetic data from scratch or based on your own seed data.
  ☆403Updated this week
• huggingface / huggingface-gemma-recipes
  Inference, Fine Tuning and many more recipes with Gemma family of models
  ☆275Updated 4 months ago
• LLMSELECTOR / LLMSELECTOR
  ☆79Updated 2 months ago
• weaviate / gorilla
  Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.
  ☆138Updated 3 months ago
• scaleapi / SWE-bench_Pro-os
  SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
  ☆223Updated 2 weeks ago
• allenai / asta-paper-finder
  frozen-in-time version of our Paper Finder agent for reproducing evaluation results
  ☆206Updated 3 months ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆226Updated last year
• facebookresearch / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆34Updated 7 months ago
• davidberenstein1957 / dspydantic
  DSPydantic: Auto-Optimize Your Pydantic Models with DSPy
  ☆67Updated this week
• ibm-granite / granite-4.0-language-models
  ☆144Updated last week
• QuixiAI / dolphin-logger
  ☆107Updated last month
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆115Updated 8 months ago
• jlscheerer / xtr-warp
  XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.
  ☆173Updated 7 months ago