algorithmicsuperintelligence / optillmLinks
Optimizing inference proxy for LLMs
☆3,091Updated this week
Alternatives and similar repositories for optillm
Users that are interested in optillm are comparing it to the libraries listed below
Sorting:
- Synthetic data curation for post-training and structured data extraction☆1,541Updated 3 months ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,918Updated last week
- ☆1,116Updated last year
- Agentless🐱: an agentless approach to automatically solve software development problems☆1,951Updated 10 months ago
- Autonomously train research-agent LLMs on custom data using reinforcement learning and self-verification.☆668Updated 7 months ago
- This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?☆1,361Updated last month
- [ICLR 2025] Automated Design of Agentic Systems☆1,444Updated 9 months ago
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆4,393Updated last year
- TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients. Published in Nature.☆3,068Updated 3 months ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,565Updated 5 months ago
- Create Custom LLMs☆1,766Updated last month
- Recipes to scale inference-time compute of open models☆1,114Updated 5 months ago
- Environments for LLM Reinforcement Learning☆3,445Updated last week
- High-performance retrieval engine for unstructured data☆1,517Updated this week
- Harness LLMs with Multi-Agent Programming☆3,753Updated this week
- Enforce the output format (JSON Schema, Regex etc) of a language model☆1,946Updated 2 months ago
- A library for advanced large language model reasoning☆2,300Updated 5 months ago
- Empowering RAG with a memory-based data interface for all-purpose applications!☆2,159Updated 2 months ago
- An Open Large Reasoning Model for Real-World Solutions☆1,527Updated 5 months ago
- The Open Source Memory Layer For Autonomous Agents☆2,503Updated last year
- ☆1,035Updated 10 months ago
- Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…☆1,882Updated last month
- Big & Small LLMs working together☆1,187Updated last week
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,078Updated this week
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆3,528Updated 5 months ago
- System 2 Reasoning Link Collection☆855Updated 7 months ago
- Chat language model that can use tools and interpret the results☆1,587Updated last week
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,755Updated 5 months ago
- Entropy Based Sampling and Parallel CoT Decoding☆3,421Updated 11 months ago
- Fast State-of-the-Art Static Embeddings☆1,898Updated 3 weeks ago