Deprecated inference engine
☆1,253Sep 6, 2025Updated 10 months ago
Alternatives and similar repositories for openrouter-runner
Users that are interested in openrouter-runner are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails…☆54,122Updated this week
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆5,220Aug 10, 2024Updated last year
- LlamaIndex is the leading document agent and OCR platform☆50,962Updated this week
- 🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓☆5,971Jul 5, 2026Updated 2 weeks ago
- Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app☆2,361Updated this week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.☆12,482May 25, 2026Updated last month
- Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ cl…☆10,319Updated this week
- Platform for stateful agents: AI with advanced memory that can learn and self-improve over time.☆23,880Jul 3, 2026Updated 2 weeks ago
- Superagent protects your AI applications against prompt injections, data leaks, and harmful outputs. Embed safety directly into your app …☆6,677Apr 11, 2026Updated 3 months ago
- DSPy: The framework for programming—not prompting—language models☆36,252Updated this week
- Search infrastructure for AI☆28,837Updated this week
- A programming framework for agentic AI☆59,846Apr 15, 2026Updated 3 months ago
- Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and a…☆25,955Updated this week
- Autonomous coding agent as an SDK, IDE extension, or CLI assistant.☆64,846Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with struc…☆16,623Updated this week
- open-source coding agent☆34,986Updated this week
- Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including C…☆5,716Jun 25, 2026Updated 3 weeks ago
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆12,396Jul 13, 2026Updated last week
- Unsloth is a local UI for training and running Gemma 4, Qwen3.6, DeepSeek, Kimi, GLM and other models.☆68,541Updated this week
- structured outputs for llms☆13,579Jul 13, 2026Updated last week
- Build AI Agents, Visually☆54,740Updated this week
- Local AI API Platform☆2,755Jul 4, 2025Updated last year
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.☆21,848Apr 15, 2026Updated 3 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Enhanced ChatGPT Clone: Features Agents, MCP, Skills, DeepSeek, Anthropic, AWS, OpenAI, Responses API, Azure, Groq, o1, GPT-5, Mistral, O…☆41,003Updated this week
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆12,953Apr 13, 2026Updated 3 months ago
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆55,844Updated this week
- Build, run, and manage agent platforms.☆41,310Updated this week
- Universal memory layer for AI Agents☆61,308Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆86,727Updated this week
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆13,491Updated this week
- 🐫 CAMEL: The first and the best multi-agent framework. Finding the Scaling Law of Agents. https://www.camel-ai.org☆17,447Updated this week
- A sample pattern for running CI tests on Modal☆19Apr 12, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Go ahead and axolotl questions☆12,219Updated this week
- An autonomous agent that conducts deep research on any data using any LLM providers☆28,484Updated this week
- aider is AI pair programming in your terminal☆47,541May 22, 2026Updated last month
- Structured Outputs☆14,573Updated this week
- 🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenT…☆31,497Updated this week
- Open-source, secure environment with real-world tools for enterprise-grade agents.☆13,052Updated this week
- Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali☆2,889Mar 24, 2026Updated 3 months ago