Deprecated inference engine
☆1,200Sep 6, 2025Updated 5 months ago
Alternatives and similar repositories for openrouter-runner
Users that are interested in openrouter-runner are comparing it to the libraries listed below
Sorting:
- Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing a…☆37,083Updated this week
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆4,644Aug 10, 2024Updated last year
- LlamaIndex is the leading document agent and OCR platform☆47,210Updated this week
- Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app☆2,220Updated this week
- 🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓☆5,156Feb 25, 2026Updated last week
- A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.☆10,748Feb 23, 2026Updated last week
- DSPy: The framework for programming—not prompting—language models☆32,519Updated this week
- Letta is the platform for building stateful agents: AI with advanced memory that can learn and self-improve over time.☆21,340Feb 24, 2026Updated last week
- Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, 20+ clouds, o…☆9,516Updated this week
- 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Open…☆22,415Updated this week
- Open-source search and retrieval database for AI applications.☆26,418Updated this week
- Superagent protects your AI applications against prompt injections, data leaks, and harmful outputs. Embed safety directly into your app …☆6,422Feb 3, 2026Updated last month
- Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek, Qwen, Llama, Gemma, TTS 2x faster with 70% less VRAM.☆53,029Updated this week
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆44,662Updated this week
- Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and a…☆24,370Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆71,883Updated this week
- A programming framework for agentic AI☆54,956Jan 22, 2026Updated last month
- Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with struc…☆15,690Updated this week
- Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your p…☆58,536Updated this week
- structured outputs for llms☆12,468Feb 25, 2026Updated last week
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆12,734Feb 9, 2026Updated 3 weeks ago
- ⏩ Source-controlled AI checks, enforceable in CI. Powered by the open-source Continue CLI☆31,532Updated this week
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.☆21,026Mar 11, 2025Updated 11 months ago
- Universal memory layer for AI Agents☆48,604Updated this week
- Enhanced ChatGPT Clone: Features Agents, MCP, DeepSeek, Anthropic, AWS, OpenAI, Responses API, Azure, Groq, o1, GPT-5, Mistral, OpenRoute…☆34,214Updated this week
- Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including C…☆5,333Oct 30, 2025Updated 4 months ago
- Go ahead and axolotl questions☆11,335Updated this week
- Build AI Agents, Visually☆49,461Updated this week
- Local AI API Platform☆2,759Jul 4, 2025Updated 8 months ago
- Open-source, secure environment with real-world tools for enterprise-grade agents.☆11,096Updated this week
- Build, run, manage agentic software at scale.☆38,276Updated this week
- 🐫 CAMEL: The first and the best multi-agent framework. Finding the Scaling Law of Agents. https://www.camel-ai.org☆16,172Updated this week
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆13,206Updated this week
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆12,140Feb 23, 2026Updated last week
- Structured Outputs☆13,488Updated this week
- 🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading☆9,971Sep 7, 2024Updated last year
- aider is AI pair programming in your terminal☆41,062Feb 25, 2026Updated last week
- Perplexica is an AI-powered answering engine.☆30,120Feb 13, 2026Updated 2 weeks ago
- Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cl…☆29,247Updated this week