bricks-cloud / BricksLLM
🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.
☆1,031Updated 3 months ago
Alternatives and similar repositories for BricksLLM:
Users that are interested in BricksLLM are comparing it to the libraries listed below
- Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.☆854Updated last year
- Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errors☆651Updated last year
- Zep | The Memory Foundation For Your AI Stack☆3,249Updated 3 weeks ago
- A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for vario…☆1,015Updated 2 months ago
- The production toolkit for LLMs. Observability, prompt management and evaluations.☆1,293Updated this week
- 🧬 Helix is a private GenAI stack for building AI applications with declarative pipelines, knowledge (RAG), API bindings, and first-class…☆490Updated this week
- This repo provides the server side code for llmsherpa API to connect. It includes parsers for various file formats.☆1,225Updated 3 weeks ago
- Agents Capable of Self-Editing Their Prompts / Python Code☆763Updated last year
- Data-Driven Evaluation for LLM-Powered Applications☆489Updated 3 months ago
- Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models (Dall-E, SDXL), Speed Up Responses, and Ensure Non-Stop Reliabi…☆444Updated last year
- Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app☆1,682Updated last week
- Turn expensive prompts into cheap fine-tuned models☆2,579Updated 11 months ago
- Agent accuracy measurements for LLMs☆205Updated 10 months ago
- Text analytics for LLM apps. Cluster messages to detect use cases, outliers, power users. Detect intents and run evals with LLM (OpenAI, …☆432Updated last month
- Vision utilities for web interaction agents 👀☆1,654Updated 5 months ago
- The simplest way to build AI workloads on Postgres☆774Updated this week
- Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of Postgres with bindings for Python…☆1,357Updated 2 months ago
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…☆2,839Updated 8 months ago
- AutoChain: Build lightweight, extensible, and testable LLM Agents☆1,852Updated 11 months ago
- Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastr…☆1,584Updated last week
- ☆496Updated 8 months ago
- Experts.js is the easiest way to create and deploy OpenAI's Assistants and link them together as Tools to create advanced Multi AI Agent …☆1,045Updated 7 months ago
- Build, Improve Performance, and Productionize your LLM Application with an Integrated Framework☆339Updated 5 months ago
- Stateful load balancer custom-tailored for llama.cpp 🏓🦙☆744Updated this week
- AgentSearch is a framework for powering search agents and enabling customizable local search.☆483Updated last year
- A RAG LLM co-pilot for browsing the web, powered by local LLMs☆1,506Updated 3 months ago
- LLMFlows - Simple, Explicit and Transparent LLM Apps☆692Updated 2 months ago
- Build robust LLM applications with true composability 🔗☆418Updated last year
- A single API for product integrations☆606Updated last year
- 🧠 Motorhead is a memory and information retrieval server for LLMs.☆875Updated 2 weeks ago