Deprecated inference engine
☆1,214Sep 6, 2025Updated 6 months ago
Alternatives and similar repositories for openrouter-runner
Users that are interested in openrouter-runner are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing a…☆39,597Updated this week
- LlamaIndex is the leading document agent and OCR platform☆47,753Mar 17, 2026Updated last week
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆4,698Aug 10, 2024Updated last year
- Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app☆2,250Updated this week
- 🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓☆5,270Mar 15, 2026Updated last week
- A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.☆10,981Mar 14, 2026Updated last week
- Superagent protects your AI applications against prompt injections, data leaks, and harmful outputs. Embed safety directly into your app …☆6,484Mar 11, 2026Updated last week
- Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ cl…☆9,664Updated this week
- DSPy: The framework for programming—not prompting—language models☆33,038Updated this week
- Letta is the platform for building stateful agents: AI with advanced memory that can learn and self-improve over time.☆21,680Mar 16, 2026Updated last week
- 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Open…☆23,441Updated this week
- Data infrastructure for AI☆26,774Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆74,135Updated this week
- A programming framework for agentic AI☆55,908Updated this week
- Unsloth Studio is a web UI for training and running open models like Qwen, DeepSeek, gpt-oss and Gemma locally.☆57,673Updated this week
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆46,408Mar 17, 2026Updated last week
- Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your p…☆59,216Updated this week
- Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and a…☆24,585Updated this week
- Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with struc…☆15,834Updated this week
- Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including C…☆5,395Updated this week
- structured outputs for llms☆12,589Updated this week
- ⏩ Source-controlled AI checks, enforceable in CI. Powered by the open-source Continue CLI☆31,921Mar 18, 2026Updated last week
- Universal memory layer for AI Agents☆50,867Updated this week
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆12,174Mar 16, 2026Updated last week
- Build AI Agents, Visually☆50,960Updated this week
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.☆21,189Mar 11, 2025Updated last year
- Enhanced ChatGPT Clone: Features Agents, MCP, DeepSeek, Anthropic, AWS, OpenAI, Responses API, Azure, Groq, o1, GPT-5, Mistral, OpenRoute…☆34,800Updated this week
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆12,774Mar 11, 2026Updated 2 weeks ago
- Local AI API Platform☆2,762Jul 4, 2025Updated 8 months ago
- Build, run, manage agentic software at scale.☆38,835Updated this week
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆13,256Updated this week
- 🐫 CAMEL: The first and the best multi-agent framework. Finding the Scaling Law of Agents. https://www.camel-ai.org☆16,479Updated this week
- Go ahead and axolotl questions☆11,460Mar 17, 2026Updated last week
- Structured Outputs☆13,588Updated this week
- Open-source, secure environment with real-world tools for enterprise-grade agents.☆11,388Updated this week
- aider is AI pair programming in your terminal☆42,197Mar 17, 2026Updated last week
- An autonomous agent that conducts deep research on any data using any LLM providers☆25,875Mar 14, 2026Updated last week
- Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cl…☆29,790Updated this week
- Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali☆2,724Feb 5, 2026Updated last month