algorithmicsuperintelligence / optillmLinks
Optimizing inference proxy for LLMs
☆3,232Updated 3 weeks ago
Alternatives and similar repositories for optillm
Users that are interested in optillm are comparing it to the libraries listed below
Sorting:
- Synthetic data curation for post-training and structured data extraction☆1,577Updated 4 months ago
- This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?☆1,398Updated last month
- Create Custom LLMs☆1,786Updated last month
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,971Updated last week
- ☆1,152Updated last year
- Big & Small LLMs working together☆1,230Updated this week
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆4,479Updated last year
- Autonomously train research-agent LLMs on custom data using reinforcement learning and self-verification.☆676Updated 9 months ago
- Agentless🐱: an agentless approach to automatically solve software development problems☆1,986Updated last year
- Our library for RL environments + evals☆3,655Updated this week
- [ICLR 2025] Automated Design of Agentic Systems☆1,475Updated 10 months ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,202Updated last week
- TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients. Published in Nature.☆3,164Updated 4 months ago
- Harness LLMs with Multi-Agent Programming☆3,807Updated 3 weeks ago
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆3,568Updated 7 months ago
- Large-scale LLM inference engine☆1,611Updated last month
- OctoTools: An agentic framework with extensible tools for complex reasoning☆1,403Updated 2 months ago
- Enforce the output format (JSON Schema, Regex etc) of a language model☆1,969Updated 3 months ago
- System 2 Reasoning Link Collection☆861Updated 9 months ago
- Recipes to scale inference-time compute of open models☆1,120Updated 7 months ago
- An implementation of iterative deep research using the OpenAI Agents SDK☆691Updated 6 months ago
- Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…☆2,007Updated 3 weeks ago
- A library for advanced large language model reasoning☆2,318Updated 6 months ago
- g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains☆4,219Updated 3 months ago
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,800Updated 7 months ago
- An AI memory layer with short- and long-term storage, semantic clustering, and optional memory decay for context-aware applications.☆674Updated 11 months ago
- ☆1,036Updated last year
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,584Updated this week
- WilmerAI is one of the oldest LLM semantic routers. It uses multi-layer prompt routing and complex workflows to allow you to not only cre…☆796Updated 2 weeks ago
- Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali☆2,582Updated this week