algorithmicsuperintelligence / optillmLinks
Optimizing inference proxy for LLMs
☆3,266Updated 2 weeks ago
Alternatives and similar repositories for optillm
Users that are interested in optillm are comparing it to the libraries listed below
Sorting:
- Synthetic data curation for post-training and structured data extraction☆1,594Updated last week
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆3,039Updated 3 weeks ago
- Agentless🐱: an agentless approach to automatically solve software development problems☆1,997Updated last year
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆3,661Updated 7 months ago
- Create Custom LLMs☆1,797Updated 2 months ago
- This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?☆1,420Updated 2 months ago
- ☆1,173Updated 3 weeks ago
- Autonomously train research-agent LLMs on custom data using reinforcement learning and self-verification.☆679Updated 9 months ago
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆4,525Updated last year
- [ICLR 2025] Automated Design of Agentic Systems☆1,485Updated 11 months ago
- Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…☆2,029Updated last month
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,815Updated 7 months ago
- Fast State-of-the-Art Static Embeddings☆1,969Updated 2 weeks ago
- Harness LLMs with Multi-Agent Programming☆3,833Updated this week
- Tool for generating high quality Synthetic datasets☆1,455Updated 2 months ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,587Updated 3 weeks ago
- Large-scale LLM inference engine☆1,613Updated this week
- Big & Small LLMs working together☆1,241Updated this week
- Superfast AI decision making and intelligent processing of multi-modal data.☆3,161Updated last month
- A library for advanced large language model reasoning☆2,319Updated 7 months ago
- OO for LLMs☆886Updated 3 weeks ago
- TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients. Published in Nature.☆3,266Updated 5 months ago
- Sky-T1: Train your own O1 preview model within $450☆3,367Updated 6 months ago
- Recipes to scale inference-time compute of open models☆1,123Updated 7 months ago
- AllenAI's post-training codebase☆3,515Updated this week
- The Open Source Memory Layer For Autonomous Agents☆2,525Updated last year
- AIDE: AI-Driven Exploration in the Space of Code. The machine Learning engineering agent that automates AI R&D.☆1,108Updated 2 months ago
- Tools for merging pretrained large language models.☆6,673Updated last week
- A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!☆1,179Updated 11 months ago
- High-performance retrieval engine for unstructured data☆1,549Updated 2 months ago