codelion / optillmLinks
Optimizing inference proxy for LLMs
☆2,605Updated this week
Alternatives and similar repositories for optillm
Users that are interested in optillm are comparing it to the libraries listed below
Sorting:
- Synthetic data curation for post-training and structured data extraction☆1,434Updated this week
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,796Updated last week
- This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?☆1,172Updated last week
- ☆908Updated 9 months ago
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆4,083Updated 11 months ago
- [ICLR 2025] Automated Design of Agentic Systems☆1,358Updated 5 months ago
- Agentless🐱: an agentless approach to automatically solve software development problems☆1,781Updated 6 months ago
- Autonomously train research-agent LLMs on custom data using reinforcement learning and self-verification.☆640Updated 3 months ago
- Agent Reinforcement Trainer for training multi-turn agents using GRPO☆832Updated this week
- Verifiers for LLM Reinforcement Learning☆1,495Updated this week
- Create Custom LLMs☆1,676Updated last week
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,492Updated last month
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆3,263Updated last month
- TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients.☆2,719Updated this week
- ☆1,025Updated 6 months ago
- Harness LLMs with Multi-Agent Programming☆3,462Updated this week
- High-performance retrieval engine for unstructured data☆1,439Updated 3 weeks ago
- OO for LLMs☆806Updated 2 weeks ago
- Empowering RAG with a memory-based data interface for all-purpose applications!☆1,847Updated 2 months ago
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,560Updated last month
- [NeurIPS'24] HippoRAG is a novel RAG framework inspired by human long-term memory that enables LLMs to continuously integrate knowledge a…☆2,538Updated 2 weeks ago
- A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data☆1,441Updated last month
- AIDE: AI-Driven Exploration in the Space of Code. The machine Learning engineering agent that automates AI R&D.☆949Updated this week
- Recipes to scale inference-time compute of open models☆1,101Updated last month
- An Open Large Reasoning Model for Real-World Solutions☆1,504Updated last month
- System 2 Reasoning Link Collection☆841Updated 3 months ago
- Big & Small LLMs working together☆1,058Updated this week
- Enforce the output format (JSON Schema, Regex etc) of a language model☆1,833Updated 4 months ago
- A system for agentic LLM-powered data processing and ETL☆2,340Updated this week
- Software to implement GoT with a weviate vectorized database☆671Updated 3 months ago