codelion / optillmLinks
Optimizing inference proxy for LLMs
☆2,929Updated 3 weeks ago
Alternatives and similar repositories for optillm
Users that are interested in optillm are comparing it to the libraries listed below
Sorting:
- Synthetic data curation for post-training and structured data extraction☆1,511Updated 2 months ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,899Updated this week
- ☆1,086Updated last year
- Create Custom LLMs☆1,743Updated last week
- This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?☆1,311Updated 2 months ago
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆4,293Updated last year
- [ICLR 2025] Automated Design of Agentic Systems☆1,428Updated 8 months ago
- Autonomously train research-agent LLMs on custom data using reinforcement learning and self-verification.☆666Updated 6 months ago
- Harness LLMs with Multi-Agent Programming☆3,711Updated 3 weeks ago
- Agentless🐱: an agentless approach to automatically solve software development problems☆1,917Updated 9 months ago
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆3,434Updated 4 months ago
- Big & Small LLMs working together☆1,170Updated this week
- An Open Large Reasoning Model for Real-World Solutions☆1,522Updated 4 months ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,543Updated 4 months ago
- High-performance retrieval engine for unstructured data☆1,502Updated 2 months ago
- Recipes to scale inference-time compute of open models☆1,109Updated 4 months ago
- ☆1,034Updated 9 months ago
- TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients. Published in Nature.☆2,960Updated 2 months ago
- Fast State-of-the-Art Static Embeddings☆1,846Updated 3 weeks ago
- A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!☆1,151Updated 8 months ago
- Software to implement GoT with a weviate vectorized database☆675Updated 6 months ago
- AIDE: AI-Driven Exploration in the Space of Code. The machine Learning engineering agent that automates AI R&D.☆1,040Updated last week
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,973Updated this week
- DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤☆1,062Updated 8 months ago
- Empowering RAG with a memory-based data interface for all-purpose applications!☆2,116Updated 3 weeks ago
- Environments for LLM Reinforcement Learning☆3,222Updated this week
- Large-scale LLM inference engine☆1,560Updated this week
- Deploy your agentic worfklows to production☆2,055Updated last month
- A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data☆1,502Updated 4 months ago
- Chat language model that can use tools and interpret the results☆1,584Updated 2 weeks ago