Portkey-AI / gateway
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
☆7,609Updated this week
Alternatives and similar repositories for gateway:
Users that are interested in gateway are comparing it to the libraries listed below
- Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…☆20,671Updated this week
- RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry☆3,999Updated last month
- Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI☆21,269Updated this week
- Build Conversational AI in minutes ⚡️☆9,225Updated this week
- Retrieval Augmented Generation (RAG) chatbot powered by Weaviate☆7,016Updated 3 weeks ago
- 🥷 Run AI-agents with an API☆5,736Updated 2 weeks ago
- Build a Perplexity-Inspired Answer Engine Using Next.js, Groq, Llama-3, Langchain, OpenAI, Upstash, Brave & Serper☆4,880Updated 6 months ago
- An AI-powered search engine with a generative UI☆7,301Updated this week
- Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks☆6,470Updated this week
- 🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓☆3,589Updated this week
- Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/☆8,548Updated this week
- 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Open…☆10,340Updated this week
- structured outputs for llms☆10,095Updated this week
- the AI-native open-source embedding database☆19,226Updated this week
- Letta (formerly MemGPT) is the stateful agents framework with memory, reasoning, and context management.☆15,854Updated this week
- Drag & drop UI to build your customized LLM flow☆37,088Updated this week
- A programming framework for agentic AI 🤖 PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/aut…☆43,139Updated this week
- LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a ch…☆5,899Updated 7 months ago
- 🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using RAG 🔄.☆14,802Updated this week
- Build resilient language agents as graphs.☆11,387Updated this week
- Open source codebase powering the HuggingChat app☆8,543Updated this week
- Enhanced ChatGPT Clone: Features Agents, DeepSeek, Anthropic, AWS, OpenAI, Assistants API, Azure, Groq, o1, GPT-4o, Mistral, OpenRouter, …☆24,279Updated this week
- A code-first agent framework for seamlessly planning and executing data analytics tasks.☆5,646Updated last week
- SoTA production-ready AI retrieval system. Agentic Retrieval-Augmented Generation (RAG) with a RESTful API.☆6,326Updated this week
- The easiest way to use Agentic RAG in any enterprise☆4,189Updated 2 months ago
- 🔍 AI search engine - self-host with local or cloud LLMs☆3,264Updated 6 months ago
- The Memory layer for AI Agents☆27,435Updated this week
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆11,129Updated this week
- Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.☆10,861Updated last week
- Build Reasoning Agents with memory, knowledge, tools and native multi-modal support.☆24,496Updated this week