katanemo / arch
Arch is an intelligent prompt gateway. Engineered with (fast) LLMs for the secure handling, robust observability, and seamless integration of prompts with your APIs - outside business logic. Built by the core contributors of Envoy proxy, on Envoy.
☆678Updated this week
Related projects ⓘ
Alternatives and complementary repositories for arch
- ➖ Stripped down, stable version of firecrawl optimized for self-hosting and ease of contribution. Billing logic and AI features are compl…☆217Updated last week
- 🦛 CHONK your texts with Chonkie ✨ - The no-nonsense RAG chunking library☆1,415Updated this week
- Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of Postgres with bindings for Python…☆1,272Updated 2 months ago
- The fastest way to build robust AI agents☆434Updated this week
- ☆379Updated 3 months ago
- A realtime serving engine for Data-Intensive Generative AI Applications☆914Updated this week
- Laminar - open-source all-in-one platform for engineering AI products. Crate data flywheel for you AI app. Traces, Evals, Datasets, Label…☆1,135Updated this week
- A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data☆1,280Updated this week
- TensorZero creates a feedback loop for optimizing LLM applications — turning production data into smarter, faster, and cheaper models.☆611Updated this week
- Easy token price estimates for 400+ LLMs. TokenOps.☆1,467Updated this week
- Tech Stack for Building, Evaluating, and Deploying your LLM Application☆328Updated this week
- openperplex is an opensource AI search engine☆755Updated 3 months ago
- TypeScript AI agent platform with Autonomous agents, Software developer agents, AI code review agents and more☆830Updated this week
- Automate code reviews, patching and documentation with self-hosted LLM workflows.☆1,112Updated this week
- LLM Analytics☆615Updated last month
- An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.☆498Updated 3 weeks ago
- Building AI agents, atomically☆999Updated this week
- Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app☆1,265Updated this week
- Replace OpenAI with Llama.cpp Automagically.☆289Updated 5 months ago
- Local voice chatbot for engaging conversations, powered by Ollama, Hugging Face Transformers, and Coqui TTS Toolkit☆718Updated 3 months ago
- Structured information extraction from documents☆282Updated last month
- Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Manageme…☆862Updated this week
- Chat with any codebase in under two minutes | Fully local or via third-party APIs☆1,053Updated last week
- Stateful load balancer custom-tailored for llama.cpp☆563Updated this week
- GenAI powered OpenSource IDE for API first workflows☆247Updated 3 months ago
- ☆251Updated 3 months ago
- The open-source AI-native IDE☆563Updated this week
- Automatically reformat any JSON into any schema with AI☆301Updated last month
- Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastr…☆1,268Updated this week
- Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, ev…☆583Updated this week