codelion / optillm
Optimizing inference proxy for LLMs
☆2,040Updated this week
Alternatives and similar repositories for optillm:
Users that are interested in optillm are comparing it to the libraries listed below
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,448Updated this week
- Agentless🐱: an agentless approach to automatically solve software development problems☆1,455Updated last month
- [ICLR 2025] Automated Design of Agentic Systems☆1,188Updated 3 weeks ago
- Convert Compute And Books Into Instruct-Tuning Datasets! Makes: QA, RP, Classifiers.☆1,314Updated this week
- ☆806Updated 5 months ago
- ☆1,006Updated 2 months ago
- Recipes to scale inference-time compute of open models☆1,002Updated last month
- TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients.☆2,085Updated 3 weeks ago
- Enforce the output format (JSON Schema, Regex etc) of a language model☆1,704Updated this week
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,295Updated last week
- Deploy your agentic worfklows to production☆1,964Updated this week
- This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?☆927Updated 3 weeks ago
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆3,635Updated 6 months ago
- A library for advanced large language model reasoning☆1,946Updated this week
- System 2 Reasoning Link Collection☆794Updated 2 weeks ago
- Synthetic Data curation for post-training and structured data extraction☆816Updated this week
- Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…☆1,019Updated last month
- Everything about the SmolLM2 and SmolVLM family of models☆1,888Updated 2 weeks ago
- Use late-interaction multi-modal models such as ColPali in just a few lines of code.☆732Updated 3 weeks ago
- A reading list on LLM based Synthetic Data Generation 🔥☆1,141Updated 3 months ago
- ☆1,326Updated 3 months ago
- [ICML 2024] Official repository for "Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models"☆730Updated 6 months ago
- ☆438Updated 4 months ago
- Chat language model that can use tools and interpret the results☆1,518Updated this week
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,266Updated last week
- Harness LLMs with Multi-Agent Programming☆3,066Updated this week
- [NeurIPS'24] HippoRAG is a novel RAG framework inspired by human long-term memory that enables LLMs to continuously integrate knowledge a…☆1,593Updated last month
- An Open Large Reasoning Model for Real-World Solutions☆1,444Updated 2 months ago
- AllenAI's post-training codebase☆2,657Updated this week