Portkey-AI / gateway
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
☆7,310Updated this week
Alternatives and similar repositories for gateway:
Users that are interested in gateway are comparing it to the libraries listed below
- Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…☆18,941Updated this week
- An AI-powered search engine with a generative UI☆7,158Updated this week
- RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry☆3,906Updated 3 weeks ago
- Build a Perplexity-Inspired Answer Engine Using Next.js, Groq, Llama-3, Langchain, OpenAI, Upstash, Brave & Serper☆4,869Updated 5 months ago
- Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/☆8,260Updated this week
- Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Ge…☆5,832Updated this week
- Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.☆10,513Updated this week
- Retrieval Augmented Generation (RAG) chatbot powered by Weaviate☆6,937Updated 2 weeks ago
- The easiest way to use Agentic RAG in any enterprise☆4,142Updated last month
- 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Open…☆9,390Updated this week
- 🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)☆6,187Updated 2 months ago
- Build Conversational AI in minutes ⚡️☆8,883Updated this week
- Large Action Model framework to develop AI Web Agents☆5,946Updated last month
- 🥷 Run AI-agents with an API☆5,670Updated 4 months ago
- 🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓☆3,413Updated this week
- The most advanced AI retrieval system. Agentic Retrieval-Augmented Generation (RAG) with a RESTful API.☆5,507Updated this week
- All things prompt engineering☆5,569Updated 9 months ago
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…☆4,939Updated last week
- Build Multimodal AI Agents with memory, knowledge and tools. Simple, fast and model-agnostic.☆20,842Updated this week
- Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks☆6,380Updated 4 months ago
- A list of AI autonomous agents☆15,996Updated 2 weeks ago
- Build resilient language agents as graphs.☆10,285Updated this week
- 😎 Awesome list of tools and projects with the awesome LangChain framework☆8,103Updated last week
- Private & local AI personal knowledge management app for high entropy people.☆7,736Updated 2 weeks ago
- Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI☆20,631Updated this week
- LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a ch…☆5,869Updated 6 months ago
- Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.☆12,424Updated this week
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆10,964Updated this week
- ☆6,598Updated 3 weeks ago
- Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.☆10,090Updated last week