codelion / optillmLinks
Optimizing inference proxy for LLMs
☆2,836Updated this week
Alternatives and similar repositories for optillm
Users that are interested in optillm are comparing it to the libraries listed below
Sorting:
- Synthetic data curation for post-training and structured data extraction☆1,495Updated last month
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,867Updated last week
- ☆1,071Updated 11 months ago
- This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?☆1,283Updated last month
- Create Custom LLMs☆1,730Updated 3 weeks ago
- TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients. Published in Nature.☆2,902Updated last month
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆3,405Updated 3 months ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,528Updated 3 months ago
- Autonomously train research-agent LLMs on custom data using reinforcement learning and self-verification.☆661Updated 5 months ago
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆4,255Updated last year
- [ICLR 2025] Automated Design of Agentic Systems☆1,412Updated 7 months ago
- Agentless🐱: an agentless approach to automatically solve software development problems☆1,895Updated 8 months ago
- Enforce the output format (JSON Schema, Regex etc) of a language model☆1,905Updated 2 weeks ago
- Large-scale LLM inference engine☆1,543Updated this week
- Verifiers for LLM Reinforcement Learning☆2,981Updated this week
- Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali☆2,415Updated this week
- Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…☆1,564Updated 8 months ago
- Big & Small LLMs working together☆1,142Updated this week
- Recipes to scale inference-time compute of open models☆1,111Updated 3 months ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,866Updated this week
- Deploy your agentic worfklows to production☆2,052Updated last week
- Entropy Based Sampling and Parallel CoT Decoding☆3,419Updated 9 months ago
- ☆1,034Updated 8 months ago
- A library for advanced large language model reasoning☆2,267Updated 3 months ago
- High-performance retrieval engine for unstructured data☆1,491Updated last month
- A reading list on LLM based Synthetic Data Generation 🔥☆1,398Updated 3 months ago
- Fast State-of-the-Art Static Embeddings☆1,833Updated this week
- Empowering RAG with a memory-based data interface for all-purpose applications!☆1,900Updated 4 months ago
- Harness LLMs with Multi-Agent Programming☆3,680Updated this week
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,658Updated 3 months ago