codelion / optillm
Optimizing inference proxy for LLMs
☆2,150Updated last week
Alternatives and similar repositories for optillm:
Users that are interested in optillm are comparing it to the libraries listed below
- Synthetic data curation for post-training and structured data extraction☆1,209Updated this week
- ☆849Updated 7 months ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,375Updated 2 weeks ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,620Updated last week
- This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?☆1,042Updated 2 months ago
- Agentless🐱: an agentless approach to automatically solve software development problems☆1,616Updated 3 months ago
- Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…☆1,130Updated 3 months ago
- TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients.☆2,422Updated last week
- Verifiers for LLM Reinforcement Learning☆790Updated last week
- [ICLR 2025] Automated Design of Agentic Systems☆1,250Updated 2 months ago
- Recipes to scale inference-time compute of open models☆1,051Updated last month
- Search-R1: An Efficient, Scalable RL Training Framework for Reasoning & Search Engine Calling interleaved LLM based on veRL☆1,847Updated this week
- ☆1,014Updated 3 months ago
- AIDE: AI-Driven Exploration in the Space of Code. State of the Art machine Learning engineering agents that automates AI R&D.☆842Updated 2 weeks ago
- A reading list on LLM based Synthetic Data Generation 🔥☆1,237Updated last month
- Autonomously train research-agent LLMs on custom data using reinforcement learning and self-verification.☆571Updated 3 weeks ago
- DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤☆1,004Updated 2 months ago
- A library for advanced large language model reasoning☆2,076Updated this week
- Big & Small LLMs working together☆686Updated this week
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆3,802Updated 8 months ago
- Convert Compute And Books Into Instruct-Tuning Datasets! Makes: QA, RP, Classifiers.☆1,409Updated 2 months ago
- Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy☆1,102Updated last week
- A comprehensive repository of reasoning tasks for LLMs (and beyond)☆428Updated 6 months ago
- Enforce the output format (JSON Schema, Regex etc) of a language model☆1,770Updated last month
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,400Updated this week
- High-performance retrieval engine for unstructured data☆1,316Updated this week
- Evaluate your LLM's response with Prometheus and GPT4 💯☆901Updated 3 weeks ago
- Official Repo for ICML 2024 paper "Executable Code Actions Elicit Better LLM Agents" by Xingyao Wang, Yangyi Chen, Lifan Yuan, Yizhe Zhan…☆1,058Updated 10 months ago
- Streamlines and simplifies prompt design for both developers and non-technical users with a low code approach.☆1,047Updated 3 weeks ago
- Use late-interaction multi-modal models such as ColPali in just a few lines of code.☆768Updated 2 months ago