MagicAPI / ai-gateway
Built for demanding AI workflows, this gateway offers low-latency, provider-agnostic access, ensuring your AI applications run smoothly and quickly.
☆30Updated 3 weeks ago
Alternatives and similar repositories for ai-gateway:
Users that are interested in ai-gateway are comparing it to the libraries listed below
- Enables cloud-based AI services to access local Stdio based MCP servers☆20Updated this week
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆66Updated 3 weeks ago
- Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…☆36Updated 4 months ago
- Light WebUI for lm.rs☆22Updated 2 months ago
- AI Assistant☆16Updated 3 weeks ago
- Rust implementation of Surya☆55Updated last week
- iauto is a low-code engine for building and deploying AI agents☆81Updated last month
- Multi-modal modular data ingestion and retrieval☆60Updated this week
- A discovery and compression tool for your Python codebase. Creates a knowledge graph for a LLM context window, efficiently outlining your…☆68Updated last month
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆58Updated 5 months ago
- UI for Ollama☆14Updated 3 months ago
- An open source, Gradio-based chatbot app that combines the best of retrieval augmented generation and prompt engineering into an intellig…☆46Updated 5 months ago
- a lightweight, open-source blueprint for building powerful and scalable LLM chat applications☆30Updated 7 months ago
- Local LLM inference & management server with built-in OpenAI API☆31Updated 8 months ago
- Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.☆55Updated last year
- ☆26Updated 2 months ago
- ✨ AI interface for tinkerers (Ollama, Haystack RAG, Python)☆57Updated this week
- RetroChat is a powerful command-line interface for interacting with various AI language models. It provides a seamless experience for eng…☆69Updated 3 weeks ago
- ☆152Updated 2 months ago
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆113Updated 7 months ago
- Augment AI agents with long-term memory through knowledge graph 🧠☆49Updated 2 months ago
- A Model Context Protocol server for searching and analyzing arXiv papers☆43Updated this week
- This project is a reverse-engineered version of Figma's tone changer. It uses Groq's Llama-3-8b for high-speed inference and to adjust th…☆87Updated 5 months ago
- MCP implementation that enables communication between MCP servers and OpenAI-compatible LLMs☆134Updated last month
- Multi-language code navigation API in a container☆53Updated this week
- The fastest CLI tool for prompting LLMs. Including support for prompting several LLMs at once!☆66Updated this week
- Tools for LLM agents.☆57Updated 2 weeks ago
- George is an API leveraging AI to make it easy to control a computer with natural language.☆39Updated last week
- 🤖 Headless IDE for AI agents☆148Updated last month
- One Line To Build Zero-Data Classifiers in Minutes☆33Updated 3 months ago