Optimizing inference proxy for LLMs
☆4,345Nov 16, 2026Updated this week
Alternatives and similar repositories for optillm
Users that are interested in optillm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Open-source implementation of AlphaEvolve☆7,828Updated this week
- DSPy: The framework for programming—not prompting—language models☆39,155Updated this week
- Structured Outputs☆16,016Sep 21, 2026Updated last month
- Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails…☆7,118Oct 24, 2026Updated 3 weeks ago
- 💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows☆13,671Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Entropy Based Sampling and Parallel CoT Decoding☆3,434Nov 13, 2024Updated 2 years ago
- Go ahead and axolotl questions☆12,738Updated this week
- Tools for merging pretrained large language models.☆7,483Oct 31, 2026Updated 2 weeks ago
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.☆79,829Updated this week
- Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement…☆10,866Updated this week
- Platform for stateful agents: AI with advanced memory that can learn and self-improve over time.☆25,503Oct 18, 2026Updated last month
- Pivotal Token Search☆168Nov 7, 2026Updated last week
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆3,831May 28, 2026Updated 5 months ago
- Create Custom LLMs☆1,876Jun 27, 2026Updated 4 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The self-managing agent platform☆43,245Updated this week
- The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails…☆63,547Updated this week
- structured outputs for llms☆14,127Updated this week
- aider is AI pair programming in your terminal☆50,199May 22, 2026Updated 5 months ago
- LMCache: Supercharge Your LLM with the Fastest KV Cache Layer☆12,399Updated this week
- The LLM Evaluation Framework☆19,577Updated this week
- SGLang is a high-performance serving framework for large language models and multimodal models.☆38,882Updated this week
- Build Real-Time Knowledge Graphs for AI Agents☆32,962Updated this week
- A fast inference library for running LLMs locally on modern consumer-class GPUs☆4,653Mar 4, 2026Updated 8 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Large-scale LLM inference engine☆1,910Updated this week
- A guidance language for controlling large language models.☆21,827May 21, 2026Updated 5 months ago
- Harness LLMs with Multi-Agent Programming☆4,153Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆97,265Updated this week
- g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains☆4,158Dec 30, 2025Updated 10 months ago
- SoTA production-ready AI retrieval system. Agentic Retrieval-Augmented Generation (RAG) with a RESTful API.☆8,103Nov 7, 2025Updated last year
- ☆1,031Dec 17, 2024Updated last year
- Democratizing Reinforcement Learning for LLMs☆5,927Oct 16, 2026Updated last month
- 🙌 OpenHands: AI-Driven Development☆93,911Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆13,757Nov 10, 2026Updated last week
- Stop configuring your AI stack. Start using it. One command brings a complete pre-wired LLM stack with hundreds of services to explore.☆3,278Nov 11, 2026Updated last week
- 🤗 smolagents: a barebones library for agents that think in code.☆30,459Updated this week
- The Memory Layer for AI Agents - Drop-in memory infrastructure for AI agents and apps. Context that persists. Built for production.☆69,280Updated this week
- ☆965Jan 23, 2025Updated last year
- A system for agentic LLM-powered data processing and ETL☆4,266Updated this week
- Fast, flexible LLM inference☆7,851Updated this week
Are these results useful?