codelion / optillmLinks
Optimizing inference proxy for LLMs
☆2,550Updated this week
Alternatives and similar repositories for optillm
Users that are interested in optillm are comparing it to the libraries listed below
Sorting:
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆4,034Updated 10 months ago
- Synthetic data curation for post-training and structured data extraction☆1,404Updated this week
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,757Updated last week
- Agentless🐱: an agentless approach to automatically solve software development problems☆1,725Updated 5 months ago
- ☆898Updated 9 months ago
- High-performance retrieval engine for unstructured data☆1,408Updated last week
- [ICLR 2025] Automated Design of Agentic Systems☆1,342Updated 4 months ago
- This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?☆1,137Updated 2 weeks ago
- Autonomously train research-agent LLMs on custom data using reinforcement learning and self-verification.☆632Updated 2 months ago
- Recipes to scale inference-time compute of open models☆1,095Updated 3 weeks ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,449Updated 3 weeks ago
- A system for agentic LLM-powered data processing and ETL☆2,223Updated this week
- Verifiers for LLM Reinforcement Learning☆1,290Updated last week
- An Open Large Reasoning Model for Real-World Solutions☆1,497Updated 3 weeks ago
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆3,024Updated last month
- Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app☆1,815Updated last week
- A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data☆1,429Updated last month
- ☆1,025Updated 6 months ago
- AIDE: AI-Driven Exploration in the Space of Code. State of the Art machine Learning engineering agents that automates AI R&D.☆925Updated 2 months ago
- Search-R1: An Efficient, Scalable RL Training Framework for Reasoning & Search Engine Calling interleaved LLM based on veRL☆2,612Updated 2 weeks ago
- Harness LLMs with Multi-Agent Programming☆3,402Updated this week
- Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali☆2,252Updated 2 weeks ago
- Deploy your agentic worfklows to production☆2,026Updated this week
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,629Updated this week
- Big & Small LLMs working together☆972Updated this week
- TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients.☆2,654Updated 2 months ago
- Fast State-of-the-Art Static Embeddings☆1,732Updated 2 weeks ago
- A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!☆1,100Updated 4 months ago
- Code and Data for Tau-Bench☆595Updated 4 months ago
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,496Updated last month