bricks-cloud / BricksLLM
🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.
☆972Updated 3 weeks ago
Alternatives and similar repositories for BricksLLM:
Users that are interested in BricksLLM are comparing it to the libraries listed below
- Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.☆849Updated last year
- No-code multi-agent framework to build LLM Agents, workflows and applications with your data☆1,750Updated last month
- Zep | The Memory Foundation For Your AI Stack☆2,923Updated 2 months ago
- A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for vario…☆990Updated 3 months ago
- The production toolkit for LLMs. Observability, prompt management and evaluations.☆1,146Updated this week
- Agents Capable of Self-Editing Their Prompts / Python Code☆753Updated 10 months ago
- A RAG LLM co-pilot for browsing the web, powered by local LLMs☆1,460Updated this week
- LLMFlows - Simple, Explicit and Transparent LLM Apps☆679Updated this week
- Easy token price estimates for 400+ LLMs. TokenOps.☆1,538Updated 2 weeks ago
- Text analytics for LLM apps. Cluster messages to detect use cases, outliers, power users. Detect intents and run evals with LLM (OpenAI, …☆400Updated 3 weeks ago
- AutoChain: Build lightweight, extensible, and testable LLM Agents☆1,825Updated 8 months ago
- A lightweight task engine for building stateful AI agents that prioritizes simplicity and flexibility.☆878Updated 3 weeks ago
- A realtime serving engine for Data-Intensive Generative AI Applications☆956Updated this week
- Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of Postgres with bindings for Python…☆1,315Updated 4 months ago
- Build, Improve Performance, and Productionize your LLM Application with an Integrated Framework☆337Updated 2 months ago
- The Open Source Memory Layer For Autonomous Agents☆1,971Updated 3 months ago
- Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errors☆638Updated last year
- Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app☆1,428Updated this week
- 🧬 Helix is a private GenAI stack for building AI applications with declarative pipelines, knowledge (RAG), API bindings, and first-class…☆388Updated this week
- Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastr…☆1,473Updated this week
- Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Manageme…☆1,153Updated this week
- The universal tool suite for vector database management. Manage Pinecone, Chroma, Qdrant, Weaviate and more vector databases with ease.☆1,588Updated 4 months ago
- Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.☆2,152Updated this week
- Experts.js is the easiest way to create and deploy OpenAI's Assistants and link them together as Tools to create advanced Multi AI Agent …☆1,022Updated 4 months ago
- Prompt engineering for developers☆675Updated 11 months ago
- pingcap/autoflow is a Graph RAG based and conversational knowledge base tool built with TiDB Serverless Vector Storage. Demo: https://tid…☆2,229Updated this week
- The simplest way to build AI workloads on Postgres☆755Updated this week
- Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry☆287Updated this week
- Stateful load balancer custom-tailored for llama.cpp 🏓🦙☆676Updated last week
- Complex LLM Workflows from Simple JSON.☆290Updated last year