robbyt / llm_proxyLinks
AI aware proxy
☆19Updated last year
Alternatives and similar repositories for llm_proxy
Users that are interested in llm_proxy are comparing it to the libraries listed below
Sorting:
- Knowledge for GPTScript☆29Updated last year
- Building self-refined guardrails via DSPy☆13Updated last year
- Quickly and securely turn any Linux box into a build and deployment assistant☆24Updated last year
- Open Weight, tool-calling LLMs☆155Updated last year
- Security and compliance proxy for LLM APIs☆50Updated 2 years ago
- ☆12Updated last year
- A high performance batching router optimises max throughput for text inference workload☆16Updated 2 years ago
- Open Source LLM proxy that transparently captures and logs all interactions with LLM API☆62Updated 6 months ago
- QLLM: A powerful CLI for seamless interaction with multiple Large Language Models. Simplify AI workflows, streamline development, and unl…☆34Updated 9 months ago
- The home of official Obot tools☆32Updated 2 weeks ago
- Build reliable, secure, and production-ready AI apps easily.☆97Updated last month
- Structured outputs from DSPy and Jinja2☆26Updated 6 months ago
- Finetune LLMs on K8s by using Runbooks☆170Updated last year
- A plan engine for dynamic planning and reliable execution of AI agent workflows.☆239Updated 7 months ago
- Agentkube - Run Kubernetes Like Never Before☆24Updated last month
- ☆18Updated 2 years ago
- High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included☆149Updated this week
- ☆24Updated last year
- The version 0.2 is a prompt based agent workflow that integrates with other Lyzr agents☆32Updated last year
- ☆172Updated last year
- Pebblo enables developers to safely load data and promote their Gen AI app to deployment☆149Updated 6 months ago
- Litmus is a comprehensive LLM testing and evaluation tool designed for GenAI Application Development. It provides a robust platform with …☆41Updated 5 months ago
- Augment Swarm with durable execution to help you build reliable and scalable multi-agent systems.☆115Updated last year
- 📡 Deploy AI models and apps to Kubernetes without developing a hernia☆33Updated last year
- 😎 Awesome list of resources about using and building AI software development systems☆115Updated last year
- A toy AI agent that can write programs, powered by Dagger☆37Updated 9 months ago
- Python module for running GPTScript☆14Updated 3 weeks ago
- Run AI generated code in isolated sandboxes☆135Updated 11 months ago
- An example application built with LangChain CLI and LangServe☆79Updated 2 years ago
- Tutorial for building LLM router☆241Updated last year