Portkey-AI / gatewayLinks
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
☆8,992Updated this week
Alternatives and similar repositories for gateway
Users that are interested in gateway are comparing it to the libraries listed below
Sorting:
- RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry☆4,155Updated 5 months ago
- Letta (formerly MemGPT) is the stateful agents framework with memory, reasoning, and context management.☆17,422Updated this week
- Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…☆25,705Updated this week
- 🥷 Run AI-agents with an API☆6,039Updated 2 weeks ago
- The open-source visual AI programming environment and TypeScript library☆4,035Updated this week
- Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.☆13,205Updated this week
- 🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓☆4,180Updated this week
- Build a Perplexity-Inspired Answer Engine Using Next.js, Groq, Llama-3, Langchain, OpenAI, Upstash, Brave & Serper☆4,899Updated 3 weeks ago
- Zep | Examples, Integrations, & More☆3,421Updated this week
- Enhanced ChatGPT Clone: Features Agents, DeepSeek, Anthropic, AWS, OpenAI, Responses API, Azure, Groq, o1, GPT-4o, Mistral, OpenRouter, V…☆28,340Updated this week
- 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Open…☆13,958Updated this week
- The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.☆2,966Updated this week
- ☆6,669Updated last month
- Full-stack framework for building Multi-Agent Systems with memory, knowledge and reasoning.☆30,517Updated this week
- Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/☆8,977Updated 2 months ago
- An AI-powered search engine with a generative UI☆7,788Updated last month
- The production toolkit for LLMs. Observability, prompt management and evaluations.☆1,371Updated this week
- Large Action Model framework to develop AI Web Agents☆6,091Updated 6 months ago
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…☆5,285Updated 4 months ago
- Automate browser-based workflows with LLMs and Computer Vision☆13,850Updated this week
- SoTA production-ready AI retrieval system. Agentic Retrieval-Augmented Generation (RAG) with a RESTful API.☆7,093Updated 3 weeks ago
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆4,115Updated 11 months ago
- Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.☆3,068Updated this week
- 🔥 Open Source Browser API for AI Agents & Apps. Steel Browser is a batteries-included browser instance that lets you automate the web wi…☆4,843Updated 2 weeks ago
- Retrieval Augmented Generation (RAG) chatbot powered by Weaviate☆7,214Updated last week
- Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Ge…☆7,641Updated this week
- Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including C…☆4,668Updated last week
- ☆5,137Updated 3 months ago
- Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.☆10,608Updated this week
- The easiest way to use Agentic RAG in any enterprise☆4,286Updated 6 months ago