trymirai / uzuLinks
A high-performance inference engine for AI models
β1,363Updated last week
Alternatives and similar repositories for uzu
Users that are interested in uzu are comparing it to the libraries listed below
Sorting:
- Open-source LLM load balancer and serving platform for self-hosting LLMs at scale ππ¦β1,360Updated 3 weeks ago
- Minimal LLM inference in Rustβ1,020Updated last year
- High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and inβ¦β1,208Updated this week
- High-Performance Implementation of OpenAI's TikToken.β460Updated 4 months ago
- Artificial Neural Engine Machine Learning Libraryβ1,235Updated 2 months ago
- Diagram as Code Tool Written in Rust with Draggable Editingβ1,903Updated this week
- Onit MacOS clientβ1,008Updated 2 months ago
- An transformer based LLM. Written completely in Rustβ2,950Updated last month
- A robust message queue system for Rust applications, designed as a Rust alternative to Celery.β582Updated 4 months ago
- HelixDB is an open-source graph-vector database built from scratch in Rust.β3,074Updated this week
- Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit β¦β360Updated 5 months ago
- Modern, fast, document parser written in π¦β524Updated last month
- Your filesystem as a vector databaseβ488Updated 6 months ago
- Local first semantic and hybrid BM25 grep / search tool for use by AI and humans!β951Updated last week
- A powerful document AI question-answering tool that connects to your local Ollama models. Create, manage, and interact with RAG systems fβ¦β1,082Updated 3 months ago
- SeekStorm - sub-millisecond full-text search library & multi-tenancy server in Rustβ1,765Updated this week
- Fast, streaming indexing, query, and agentic LLM applications in Rustβ602Updated last week
- Demo project showing a single Rust codebase running on CPU and directly on GPUsβ460Updated 3 months ago
- Rust based package manager for macOSβ1,860Updated 2 months ago
- A fast, minimalist directory tree viewer, written in Rust.β1,366Updated 2 months ago
- self-hosted plaform for secure execution of untrusted user or AI-generated codeβ4,003Updated last week
- Communicate with an LLM provider using a single interfaceβ1,315Updated this week
- A human-friendly alternative to netstat for socket and port monitoring on Linux and macOS.β2,489Updated last week
- π¦οΈ A fast, secure MCP server that extends its capabilities through WebAssembly plugins.β820Updated this week
- Fully open-source command-line AI assistant inspired by OpenAI Codex, supporting local language models.β646Updated 4 months ago
- A Positively Charged JavaScript Runtimeβ325Updated 3 weeks ago
- Ultra-lightweight AI Agentβ416Updated 2 months ago
- Git Based Memory Storage for Conversational AI Agentβ679Updated 2 months ago
- Rust framework for LLM orchestrationβ203Updated last year
- HTTP(s) request filter for processesβ792Updated this week