algorithmicsuperintelligence / optillmLinks
Optimizing inference proxy for LLMs
☆3,299Updated this week
Alternatives and similar repositories for optillm
Users that are interested in optillm are comparing it to the libraries listed below
Sorting:
- Synthetic data curation for post-training and structured data extraction☆1,618Updated last week
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆3,074Updated last week
- ☆1,189Updated last month
- This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?☆1,434Updated 2 months ago
- Agentless🐱: an agentless approach to automatically solve software development problems☆2,007Updated last year
- Create Custom LLMs☆1,806Updated 2 months ago
- [ICLR 2025] Automated Design of Agentic Systems☆1,498Updated last year
- Autonomously train research-agent LLMs on custom data using reinforcement learning and self-verification.☆682Updated 10 months ago
- TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients. Published in Nature.☆3,331Updated 6 months ago
- Harness LLMs with Multi-Agent Programming☆3,863Updated this week
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆4,568Updated last year
- Large-scale LLM inference engine☆1,641Updated last week
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆3,684Updated 8 months ago
- Big & Small LLMs working together☆1,258Updated this week
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,592Updated last month
- A library for advanced large language model reasoning☆2,326Updated 7 months ago
- High-performance retrieval engine for unstructured data☆1,554Updated 2 months ago
- Everything about the SmolLM and SmolVLM family of models☆3,579Updated 2 weeks ago
- Recipes to scale inference-time compute of open models☆1,124Updated 8 months ago
- Chat language model that can use tools and interpret the results☆1,590Updated last month
- A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!☆1,185Updated last year
- OctoTools: An agentic framework with extensible tools for complex reasoning☆1,409Updated 3 months ago
- A reading list on LLM based Synthetic Data Generation 🔥☆1,512Updated 7 months ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,279Updated last week
- An Open Large Reasoning Model for Real-World Solutions☆1,533Updated 8 months ago
- ☆1,033Updated last year
- System 2 Reasoning Link Collection☆869Updated 10 months ago
- DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤☆1,088Updated last year
- The code used to train and run inference with the ColVision models, e.g. ColPali, ColQwen2, and ColSmol.☆2,476Updated 3 weeks ago
- Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…☆2,044Updated last month