Portkey-AI / gatewayLinks
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
☆10,254Updated this week
Alternatives and similar repositories for gateway
Users that are interested in gateway are comparing it to the libraries listed below
Sorting:
- RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry☆4,314Updated last month
- Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing a…☆33,588Updated last week
- 🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓☆4,922Updated last week
- Retrieval Augmented Generation (RAG) chatbot powered by Weaviate☆7,510Updated 6 months ago
- Test your prompts, agents, and RAGs. AI Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude,…☆9,826Updated this week
- The open-source visual AI programming environment and TypeScript library☆4,431Updated 3 months ago
- AI suite powered by state-of-the-art models and providing advanced AI/AGI functions. Includes AI personas, AGI functions, world-class Bea…☆6,812Updated this week
- Superagent protects your AI applications against prompt injections, data leaks, and harmful outputs. Embed safety directly into your app …☆6,357Updated last week
- The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.☆3,720Updated this week
- 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Open…☆20,373Updated last week
- Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/☆9,657Updated 8 months ago
- Build Conversational AI in minutes ⚡️☆11,364Updated this week
- Enhanced ChatGPT Clone: Features Agents, MCP, DeepSeek, Anthropic, AWS, OpenAI, Responses API, Azure, Groq, o1, GPT-5, Mistral, OpenRoute…☆32,994Updated this week
- Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.☆3,153Updated last week
- GenAI Agent Framework, the Pydantic way☆14,232Updated last week
- 🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboratio…☆3,177Updated 6 months ago
- Zep | Examples, Integrations, & More☆3,960Updated last week
- The first "code-first" agent framework for seamlessly planning and executing data analytics tasks.☆6,091Updated last week
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…☆5,755Updated 2 months ago
- Letta is the platform for building stateful agents: open AI with advanced memory that can learn and self-improve over time.☆20,619Updated this week
- SoTA production-ready AI retrieval system. Agentic Retrieval-Augmented Generation (RAG) with a RESTful API.☆7,567Updated 2 months ago
- structured outputs for llms☆12,148Updated this week
- Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean…☆13,588Updated last week
- An AI-powered search engine with a generative UI☆8,491Updated last month
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆4,525Updated last year
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆12,034Updated 3 weeks ago
- The universal tool suite for vector database management. Manage Pinecone, Chroma, Qdrant, Weaviate and more vector databases with ease.☆2,137Updated 9 months ago
- The open source codebase powering HuggingChat☆10,420Updated last week
- Universal memory layer for AI Agents☆45,538Updated this week
- All things prompt engineering☆5,720Updated last year