codelion / optillmLinks
Optimizing inference proxy for LLMs
☆3,018Updated last week
Alternatives and similar repositories for optillm
Users that are interested in optillm are comparing it to the libraries listed below
Sorting:
- Synthetic data curation for post-training and structured data extraction☆1,535Updated 2 months ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,903Updated this week
- ☆1,097Updated last year
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆4,347Updated last year
- This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?☆1,327Updated 2 weeks ago
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆3,518Updated 5 months ago
- Autonomously train research-agent LLMs on custom data using reinforcement learning and self-verification.☆667Updated 7 months ago
- Enforce the output format (JSON Schema, Regex etc) of a language model☆1,943Updated last month
- Create Custom LLMs☆1,754Updated last month
- TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients. Published in Nature.☆3,012Updated 2 months ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,560Updated 4 months ago
- Agentless🐱: an agentless approach to automatically solve software development problems☆1,937Updated 10 months ago
- Tool for generating high quality Synthetic datasets☆1,306Updated 3 weeks ago
- [ICLR 2025] Automated Design of Agentic Systems☆1,435Updated 8 months ago
- Recipes to scale inference-time compute of open models☆1,111Updated 5 months ago
- Big & Small LLMs working together☆1,184Updated this week
- Chat language model that can use tools and interpret the results☆1,585Updated last month
- High-performance retrieval engine for unstructured data☆1,507Updated 2 months ago
- Large-scale LLM inference engine☆1,567Updated last week
- DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤☆1,069Updated 8 months ago
- WilmerAI is one of the oldest LLM semantic routers. It uses multi-layer prompt routing and complex workflows to allow you to not only cre…☆781Updated last week
- Software to implement GoT with a weviate vectorized database☆677Updated 6 months ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,021Updated this week
- Harness LLMs with Multi-Agent Programming☆3,725Updated last week
- ☆1,035Updated 10 months ago
- Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…☆1,673Updated 2 weeks ago
- Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali☆2,513Updated 2 weeks ago
- AIDE: AI-Driven Exploration in the Space of Code. The machine Learning engineering agent that automates AI R&D.☆1,048Updated last month
- Fast State-of-the-Art Static Embeddings☆1,863Updated last week
- OO for LLMs☆862Updated last week