robbyt / llm_proxy
AI aware proxy
☆18Updated 2 months ago
Related projects ⓘ
Alternatives and complementary repositories for llm_proxy
- Knowledge for GPTScript☆29Updated 3 weeks ago
- 📡 Deploy AI models and apps to Kubernetes without developing a hernia☆31Updated 5 months ago
- Open Source LLM proxy that transparently captures and logs all interactions with LLM API☆48Updated this week
- Run Structured LLM Inference with Easy Parallelism☆15Updated this week
- Vector Embedding Server in under 100 lines of code☆22Updated 8 months ago
- docker-as-code compiler☆11Updated last month
- GO GO PARSE YOUR CODE GO GO☆11Updated 3 weeks ago
- Quickly and securely turn any Linux box into a build and deployment assistant☆25Updated last month
- AI Chatbot that helps you learn how to use Dagger☆29Updated last year
- Autospec is an open-source AI agent that takes a web app URL and autonomously QAs it, and saves its passing specs as E2E test code☆47Updated 2 weeks ago
- Rust crates for XetHub☆34Updated last month
- Neutrino Notebooks lets you compile Jupyter Notebooks into easily-deployable FastAPI apps☆25Updated last year
- Supervised fine-tuning of Google's open-source Gemma-2B model to optimize writing Python code☆22Updated 8 months ago
- Document parser for RAG☆16Updated last week
- ☆17Updated last week
- Gateway and load balancer to your LLM inference endpoints☆19Updated 2 weeks ago
- A high performance batching router optimises max throughput for text inference workload☆16Updated last year
- k8sAI is a RAG-enabled GPT for working with k8s☆46Updated 6 months ago
- Geniusrise: Framework for building geniuses☆60Updated 5 months ago
- Dynamically create Pydantic models from JSON schemas☆18Updated last month
- QLLM: A powerful CLI for seamless interaction with multiple Large Language Models. Simplify AI workflows, streamline development, and unl…☆24Updated last week
- Ready to go EKS setup☆9Updated 2 months ago
- iauto is a low-code engine for building and deploying AI agents☆81Updated 4 months ago
- Guards and protection agnostic to your model or provider☆35Updated last month
- Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…☆36Updated 2 months ago
- Work with web-enabled agents quickly — whether running a quick task or bootstrapping a full-stack product.☆90Updated 3 weeks ago
- ☆93Updated last month
- LLM code editor for backend services☆11Updated last month
- Agents and RAG workflows with little to no code☆18Updated 5 months ago
- Repository for go shared libraries (for now).☆10Updated last week