bricks-cloud / BricksLLM
🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.
☆922Updated this week
Related projects ⓘ
Alternatives and complementary repositories for BricksLLM
- Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.☆839Updated 10 months ago
- The production toolkit for LLMs. Observability, prompt management and evaluations.☆1,087Updated this week
- Zep | The Memory Foundation For Your AI Stack☆2,717Updated last month
- Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app☆1,272Updated this week
- The universal tool suite for vector database management. Manage Pinecone, Chroma, Qdrant, Weaviate and more vector databases with ease.☆1,465Updated last month
- 🧊 Open source LLM-Observability Platform for Developers. One-line integration for monitoring, metrics, evals, agent tracing, prompt mana…☆1,965Updated this week
- The Open Source Memory Layer For Autonomous Agents☆1,489Updated last month
- Tech Stack for Building, Evaluating, and Deploying your LLM Application☆329Updated last week
- Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of Postgres with bindings for Python…☆1,283Updated 2 months ago
- Experts.js is the easiest way to create and deploy OpenAI's Assistants and link them together as Tools to create advanced Multi AI Agent …☆999Updated 2 months ago
- TypeScript AI agent platform with Autonomous agents, Software developer agents, AI code review agents and more☆837Updated this week
- Reliable LLM Memory for AI Applications and AI Agents☆926Updated this week
- Vision utilities for web interaction agents 👀☆1,453Updated this week
- Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastr…☆1,284Updated this week
- pingcap/autoflow is a Graph RAG based and conversational knowledge base tool built with TiDB Serverless Vector Storage. Demo: https://tid…☆973Updated this week
- Agents Capable of Self-Editing Their Prompts / Python Code☆744Updated 8 months ago
- Stateful load balancer custom-tailored for llama.cpp 🏓🦙☆568Updated this week
- Easy token price estimates for 400+ LLMs. TokenOps.☆1,468Updated this week
- Multi-node production GenAI stack. Run the best of open source AI easily on your own servers. Easily add knowledge from documents and scr…☆350Updated this week
- Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Manageme…☆869Updated this week
- LLMFlows - Simple, Explicit and Transparent LLM Apps☆668Updated 7 months ago
- Data-Driven Evaluation for LLM-Powered Applications☆449Updated 2 months ago
- No-code multi-agent framework to build LLM Agents, workflows and applications with your data☆1,616Updated last week
- Text analytics for LLM apps. Cluster messages to detect use cases, outliers, power users. Detect intents and run evals with LLM (OpenAI, …☆378Updated this week
- AutoChain: Build lightweight, extensible, and testable LLM Agents☆1,792Updated 6 months ago
- A RAG LLM co-pilot for browsing the web, powered by local LLMs☆1,412Updated this week
- 🦛 CHONK your texts with Chonkie ✨ - The no-nonsense RAG chunking library☆1,477Updated this week
- This repo provides the server side code for llmsherpa API to connect. It includes parsers for various file formats.☆1,102Updated last month
- Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models (Dall-E, SDXL), Speed Up Responses, and Ensure Non-Stop Reliabi…☆428Updated 7 months ago
- Agent accuracy measurements for LLMs☆203Updated 5 months ago