bricks-cloud / BricksLLM
🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.
☆871Updated this week
Related projects: ⓘ
- Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.☆821Updated 8 months ago
- A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for vario…☆920Updated this week
- The production toolkit for LLMs. Observability, prompt management and evaluations.☆1,020Updated this week
- Agents Capable of Self-Editing Their Prompts / Python Code☆732Updated 6 months ago
- The Open Source Memory Layer For Autonomous Agents☆1,390Updated last week
- This repo provides the server side code for llmsherpa API to connect. It includes parsers for various file formats.☆1,031Updated 3 weeks ago
- Easy token price estimates for 400+ LLMs. TokenOps.☆1,403Updated last week
- Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of Postgres with bindings for Python…☆1,233Updated last week
- High-performance retrieval engine for unstructured data☆778Updated this week
- Vision utilities for web interaction agents 👀☆1,373Updated this week
- Zep: Long-Term Memory for AI Assistants.☆2,363Updated last week
- LLMFlows - Simple, Explicit and Transparent LLM Apps☆659Updated 5 months ago
- A series of top performing Text to SQL LLMs☆857Updated 7 months ago
- Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app☆1,097Updated this week
- Laminar - Open-source DataDog + PostHog for AI agents / RAG apps. Fast, reliable and insightful. Written in Rust 🦀. YC S24.☆734Updated last week
- 🧊 Open source LLM-Observability Platform for Developers. One-line integration for monitoring, metrics, evals, agent tracing, prompt mana…☆1,703Updated this week
- Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastr…☆1,123Updated this week
- Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, ev…☆425Updated this week
- OpenLIT: Complete Observability and Evals for the Entire GenAI Stack, from LLMs to GPUs. Improve your LLM apps from playground to product…☆720Updated this week
- TypeScript AI agent platform with Autonomous agents, Software developer agents, AI code review agents and more☆777Updated this week
- Open-source observability for your LLM application, based on OpenTelemetry☆1,836Updated this week
- Stateful load balancer custom-tailored for llama.cpp☆518Updated this week
- Build and query dynamic, temporally-aware Knowledge Graphs☆572Updated this week
- Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errors☆628Updated 9 months ago
- A RAG LLM co-pilot for browsing the web, powered by local LLMs☆1,360Updated this week
- The universal tool suite for vector database management. Manage Pinecone, Chroma, Qdrant, Weaviate and more vector databases with ease.☆1,296Updated last month
- A realtime and indexing and structured extraction engine for Unstructured Data to build Generative AI Applications☆837Updated this week
- AutoChain: Build lightweight, extensible, and testable LLM Agents☆1,778Updated 3 months ago
- Multi-node production AI stack. Run the best of open source AI easily on your own servers. Create your own AI by fine-tuning open source …☆319Updated this week
- Experts.js is the easiest way to create and deploy OpenAI's Assistants and link them together as Tools to create advanced Multi AI Agent …☆971Updated last week