katanemo / arch
Arch is an intelligent prompt gateway. Engineered with (fast) LLMs for the secure handling, robust observability, and seamless integration of prompts with APIs - all outside business logic. Built by the core contributors of Envoy proxy, on Envoy.
☆553Updated this week
Related projects ⓘ
Alternatives and complementary repositories for arch
- Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of Postgres with bindings for Python…☆1,267Updated 2 months ago
- Laminar - open-source all-in-one platform for engineering AI products. Traces, Evals, Datasets, Labels. YC S24.☆972Updated this week
- TypeScript AI agent platform with Autonomous agents, Software developer agents, AI code review agents and more☆823Updated this week
- Stateful load balancer custom-tailored for llama.cpp☆557Updated last week
- Build, evaluate, deploy, manage, and iterate on your LLM development with a single framework☆312Updated this week
- Easy token price estimates for 400+ LLMs. TokenOps.☆1,457Updated this week
- An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.☆489Updated 2 weeks ago
- A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data☆1,255Updated last week
- Automatically reformat any JSON into any schema with AI☆297Updated last month
- LLM Analytics☆613Updated 3 weeks ago
- Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.☆834Updated 9 months ago
- ☆376Updated 2 months ago
- Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app☆1,253Updated last week
- DOM to Semantic-Markdown for use with LLMs☆667Updated last month
- Build and query dynamic, temporally-aware Knowledge Graphs☆1,360Updated this week
- Replace OpenAI with Llama.cpp Automagically.☆287Updated 5 months ago
- openperplex is an opensource AI search engine☆742Updated 3 months ago
- Algolia alternative for technical docs☆446Updated this week
- GenAI powered OpenSource IDE for API first workflows☆241Updated 3 months ago
- A realtime serving engine for Data-Intensive Generative AI Applications☆910Updated this week
- Implementing the 4 agentic patterns from scratch☆728Updated 2 weeks ago
- Experts.js is the easiest way to create and deploy OpenAI's Assistants and link them together as Tools to create advanced Multi AI Agent …☆995Updated 2 months ago
- A community-driven collection of RAG (Retrieval-Augmented Generation) frameworks, projects, and resources. Contribute and explore the evo…☆224Updated last week
- 🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.☆268Updated 3 weeks ago
- Agent accuracy measurements for LLMs☆203Updated 4 months ago
- Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastr…☆1,250Updated this week
- 🦛 CHONK your texts with Chonkie ✨ - The no-nonsense RAG chunking library☆789Updated this week
- Text analytics for LLM apps. Cluster messages to detect use cases, outliers, power users. Detect intents and run evals with LLM (OpenAI, …☆373Updated this week
- BAML is a language that helps you get structured data from LLMs, with the best DX possible. Works with all languages. Check out the promp…☆1,311Updated this week
- The Open Source Memory Layer For Autonomous Agents☆1,470Updated 3 weeks ago