codelion / optillm
Optimizing inference proxy for LLMs
☆1,926Updated this week
Alternatives and similar repositories for optillm:
Users that are interested in optillm are comparing it to the libraries listed below
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆3,442Updated 5 months ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆1,879Updated this week
- Automated Design of Agentic Systems☆1,135Updated last week
- Empowering RAG with a memory-based data interface for all-purpose applications!☆1,502Updated last month
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,238Updated last month
- Agentless🐱: an agentless approach to automatically solve software development problems☆1,281Updated 3 weeks ago
- ☆996Updated last month
- TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients.☆1,992Updated last month
- Deploy your agentic worfklows to production☆1,915Updated this week
- 🦛 CHONK your texts with Chonkie ✨ - The no-nonsense RAG chunking library☆2,249Updated this week
- The Open Source Memory Layer For Autonomous Agents☆1,955Updated 2 months ago
- Convert Compute And Books Into Instruct-Tuning Datasets! Makes: QA, RP, Classifiers.☆1,147Updated last month
- Streamlines and simplifies prompt design for both developers and non-technical users with a low code approach.☆1,006Updated last month
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,172Updated 4 months ago
- RAG that intelligently adapts to your use case, data, and queries☆2,747Updated this week
- The code used to train and run inference with the ColPali architecture.☆1,386Updated this week
- Recipes to scale inference-time compute of open models☆932Updated this week
- ☆774Updated 4 months ago
- Harness LLMs with Multi-Agent Programming☆2,917Updated this week
- open-source framework for creating and managing simulations populated with AI-powered agents. It provides an intuitive platform for desig…☆837Updated last week
- Implementing the 4 agentic patterns from scratch☆973Updated 2 months ago
- Everything about the SmolLM & SmolLM2 family of models☆1,554Updated last week
- A reading list on LLM based Synthetic Data Generation 🔥☆969Updated 2 months ago
- An Open Large Reasoning Model for Real-World Solutions☆1,378Updated last month
- Use late-interaction multi-modal models such as ColPali in just a few lines of code.☆693Updated 2 months ago
- Task-based Agentic Framework using StrictJSON as the core☆442Updated last week
- This repository provides an advanced Retrieval-Augmented Generation (RAG) solution for complex question answering. It uses sophisticated …☆951Updated last week
- This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?☆841Updated last month
- A library for prompt engineering and optimization (SAMMO = Structure-aware Multi-Objective Metaprompt Optimization)☆625Updated 3 weeks ago
- ☆812Updated last week