vcache-project / vCacheLinks
Reliable and Efficient Semantic Prompt Caching with vCache
☆47Updated last month
Alternatives and similar repositories for vCache
Users that are interested in vCache are comparing it to the libraries listed below
Sorting:
- The profiler that gives a unified view of your entire stack - from PyTorch down to GPU☆94Updated 2 months ago
- MCP-enabled AI conversation engine with MCTS analysis, FastAPI backend, and async operations for building advanced LLM applications☆45Updated 3 months ago
- Agent Markdown Language☆77Updated last week
- EFFICIENT AND OPTIMIZED TOKENIZER ENGINE FOR LLM INFERENCE SERVING☆465Updated last month
- Workflow Defined Engine☆24Updated this week
- Production-ready FastAPI authentication API template with Supabase integration. Features email/password auth, Google OAuth (PKCE), JWT va…☆91Updated 5 months ago
- SCOPE ICLR 2025☆21Updated last month
- AgentTrace is a lightweight observability library to trace and evaluate agentic systems.☆35Updated 7 months ago
- The minimal, ad-hoc way of plug and play NebulaGraph with pip install, even inside Colab Notebook!☆19Updated last year
- ☆19Updated last year
- ASTChunk is a Python toolkit for code chunking using Abstract Syntax Trees (ASTs), designed to create structurally sound and meaningful c…☆93Updated 4 months ago
- Enable tool-use ability for any LLM model (DeepSeek V3/R1, etc.)☆57Updated 5 months ago
- Website with current metrics on the fastest AI models.☆42Updated 11 months ago
- Official Magic UI MCP server.☆152Updated 5 months ago
- Timbal is an open-source python framework for building reliable AI applications, battle-tested in production with simple, transparent arc…☆21Updated this week
- GraphBit is the world’s first enterprise-grade Agentic AI framework, built on a Rust core with a Python wrapper for unmatched speed, secu…☆418Updated last week
- Turn PostgreSQL into your search engine in a Pythonic way.☆51Updated 2 months ago
- Agentic AI System for Company Data Enrichment☆91Updated last month
- Yet another coding assistant powered by LLM.☆16Updated last year
- OpenDAL fsspec integration☆30Updated 5 months ago
- A command-line tool that uses AI to rename and organize video files.☆18Updated this week
- [⛔️ DEPRECATED] Friendli: the fastest serving engine for generative AI☆49Updated 4 months ago
- Rogue your vibe hero like rogue like.☆29Updated this week
- This is an open-source version of the representation engineering framework for stopping harmful outputs or hallucinations on the level of…☆325Updated this week
- Rust implementation of Surya☆62Updated 8 months ago
- Agentic AI for writing code☆226Updated this week
- The state-of-the-art open Next Edit model, built by Continue☆40Updated 2 months ago
- (WIP) Open Knowledge Layer(OpenKL): The Advance Knowledge and Memory for Personal Agents.☆64Updated last month
- Hand-crafted Swift SDK for the OpenAI Responses API.☆21Updated last month
- Workflow orchestrator written in rust☆46Updated 10 months ago