algorithmicsuperintelligence / optillmLinks
Optimizing inference proxy for LLMs
☆3,317Updated last week
Alternatives and similar repositories for optillm
Users that are interested in optillm are comparing it to the libraries listed below
Sorting:
- Synthetic data curation for post-training and structured data extraction☆1,618Updated 2 weeks ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆3,074Updated last week
- Agentless🐱: an agentless approach to automatically solve software development problems☆2,007Updated last year
- ☆1,193Updated last month
- This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?☆1,434Updated 2 months ago
- Autonomously train research-agent LLMs on custom data using reinforcement learning and self-verification.☆682Updated 10 months ago
- [ICLR 2025] Automated Design of Agentic Systems☆1,506Updated last year
- Enforce the output format (JSON Schema, Regex etc) of a language model☆1,986Updated 5 months ago
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆4,568Updated last year
- Create Custom LLMs☆1,806Updated 2 months ago
- Chat language model that can use tools and interpret the results☆1,590Updated 2 months ago
- TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients. Published in Nature.☆3,341Updated 6 months ago
- An Open Large Reasoning Model for Real-World Solutions☆1,533Updated 8 months ago
- Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…☆2,050Updated 2 months ago
- Harness LLMs with Multi-Agent Programming☆3,874Updated this week
- ☆1,033Updated last year
- Empowering RAG with a memory-based data interface for all-purpose applications!☆2,203Updated 4 months ago
- AdalFlow: The library to build & auto-optimize LLM applications.☆4,005Updated last week
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆3,705Updated 8 months ago
- Large-scale LLM inference engine☆1,641Updated 2 weeks ago
- Big & Small LLMs working together☆1,258Updated this week
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,291Updated 2 weeks ago
- A library for advanced large language model reasoning☆2,328Updated 7 months ago
- Entropy Based Sampling and Parallel CoT Decoding☆3,436Updated last year
- Recipes to scale inference-time compute of open models☆1,124Updated 8 months ago
- Large Concept Models: Language modeling in a sentence representation space☆2,332Updated last year
- OO for LLMs☆892Updated this week
- AIDE: AI-Driven Exploration in the Space of Code. The machine Learning engineering agent that automates AI R&D.☆1,127Updated 3 months ago
- DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤☆1,091Updated last year
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,592Updated last month