codelion / optillm
Optimizing inference proxy for LLMs
☆1,563Updated this week
Related projects ⓘ
Alternatives and complementary repositories for optillm
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆1,634Updated this week
- Implementing the 4 agentic patterns from scratch☆751Updated 3 weeks ago
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!☆3,256Updated 3 months ago
- ☆718Updated 2 months ago
- Automated Design of Agentic Systems☆1,038Updated this week
- ☆935Updated 2 weeks ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,095Updated last week
- Convert Compute And Books Into Instruct-Tuning Datasets! Makes: QA, RP, Classifiers.☆1,033Updated last week
- The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework Join our Community: https://discord.com/servers/agora-999382051…☆1,772Updated this week
- The Open Source Memory Layer For Autonomous Agents☆1,483Updated 3 weeks ago
- This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?☆723Updated 3 weeks ago
- The code used to train and run inference with the ColPali architecture.☆1,132Updated this week
- A reading list on LLM based Synthetic Data Generation 🔥☆791Updated 2 weeks ago
- An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.☆498Updated 3 weeks ago
- Agentless🐱: an agentless approach to automatically solve software development problems☆723Updated last week
- Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app☆1,265Updated this week
- ☆407Updated last month
- A library for prompt engineering and optimization (SAMMO = Structure-aware Multi-Objective Metaprompt Optimization)☆592Updated this week
- Use late-interaction multi-modal models such as ColPali in just a few lines of code.☆617Updated last week
- Agent driven automation starting with the web. Discord: https://discord.gg/wgNfmFuqJF☆818Updated this week
- Streamlines and simplifies prompt design for both developers and non-technical users with a low code approach.☆913Updated 3 weeks ago
- System 2 Reasoning Link Collection☆693Updated 3 weeks ago
- Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…☆798Updated 2 weeks ago
- Building AI agents, atomically☆999Updated this week
- [NeurIPS'24] HippoRAG is a novel RAG framework inspired by human long-term memory that enables LLMs to continuously integrate knowledge a…☆1,378Updated 3 months ago
- High-performance retrieval engine for unstructured data☆982Updated last week
- TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients.☆1,824Updated 2 weeks ago
- A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data☆1,280Updated this week
- Task-based Agentic Framework using StrictJSON as the core☆436Updated last month
- ReFT: Representation Finetuning for Language Models☆1,159Updated 2 weeks ago