codelion / optillmLinks
Optimizing inference proxy for LLMs
☆2,766Updated this week
Alternatives and similar repositories for optillm
Users that are interested in optillm are comparing it to the libraries listed below
Sorting:
- Synthetic data curation for post-training and structured data extraction☆1,477Updated 3 weeks ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,849Updated last week
- This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?☆1,247Updated last month
- ☆1,052Updated 11 months ago
- Verifiers for LLM Reinforcement Learning☆1,760Updated this week
- Autonomously train research-agent LLMs on custom data using reinforcement learning and self-verification.☆655Updated 5 months ago
- Create Custom LLMs☆1,707Updated last month
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆4,221Updated last year
- Agentless🐱: an agentless approach to automatically solve software development problems☆1,868Updated 7 months ago
- Large-scale LLM inference engine☆1,524Updated this week
- Enforce the output format (JSON Schema, Regex etc) of a language model☆1,875Updated last week
- Recipes to scale inference-time compute of open models☆1,112Updated 3 months ago
- TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients.☆2,843Updated 3 weeks ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,517Updated 2 months ago
- ☆1,030Updated 8 months ago
- Harness LLMs with Multi-Agent Programming☆3,616Updated this week
- g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains☆4,224Updated 6 months ago
- System 2 Reasoning Link Collection☆851Updated 5 months ago
- Big & Small LLMs working together☆1,123Updated this week
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,820Updated last week
- An AI memory layer with short- and long-term storage, semantic clustering, and optional memory decay for context-aware applications.☆656Updated 7 months ago
- A reading list on LLM based Synthetic Data Generation 🔥☆1,386Updated 2 months ago
- A library for advanced large language model reasoning☆2,209Updated 2 months ago
- Empowering RAG with a memory-based data interface for all-purpose applications!☆1,886Updated 3 months ago
- Tool for generating high quality Synthetic datasets☆1,130Updated 2 weeks ago
- OO for LLMs☆843Updated 2 weeks ago
- Fast State-of-the-Art Static Embeddings☆1,801Updated this week
- A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!☆1,135Updated 6 months ago
- [ICLR 2025] Automated Design of Agentic Systems☆1,401Updated 6 months ago
- An Open Large Reasoning Model for Real-World Solutions☆1,516Updated 2 months ago