trymirai / uzuLinks
A high-performance inference engine for AI models
β1,420Updated this week
Alternatives and similar repositories for uzu
Users that are interested in uzu are comparing it to the libraries listed below
Sorting:
- Minimal LLM inference in Rustβ1,029Updated last year
- Open-source LLM load balancer and serving platform for self-hosting LLMs at scale ππ¦ Alternative to projects like llm-d, Docker Model Rβ¦β1,447Updated this week
- High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and inβ¦β1,248Updated this week
- Artificial Neural Engine Machine Learning Libraryβ1,314Updated this week
- A robust message queue system for Rust applications, designed as a Rust alternative to Celery.β599Updated 2 weeks ago
- High-Performance Implementation of OpenAI's TikToken.β467Updated 7 months ago
- Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit β¦β363Updated 8 months ago
- Fast, streaming indexing, query, and agentic LLM applications in Rustβ656Updated this week
- Local first semantic and hybrid BM25 grep / search tool for use by AI and humans!β1,397Updated 2 weeks ago
- Your filesystem as a vector databaseβ502Updated 9 months ago
- MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. Iβ¦β661Updated last month
- SeekStorm - sub-millisecond full-text search library & multi-tenancy server in Rustβ1,830Updated this week
- A powerful document AI question-answering tool that connects to your local Ollama models. Create, manage, and interact with RAG systems fβ¦β1,093Updated 6 months ago
- Unofficial Rust bindings to Apple's mlx frameworkβ247Updated last week
- A security-focused library OS supporting kernel- and user-mode executionβ715Updated this week
- Communicate with an LLM provider using a single interfaceβ1,661Updated this week
- Diagram as Code Tool Written in Rust with Draggable Editingβ2,188Updated last week
- Demo project showing a single Rust codebase running on CPU and directly on GPUsβ475Updated 6 months ago
- π¦ Distributed log streaming engine built from first principlesβ1,843Updated 2 weeks ago
- π¦οΈ A fast, secure MCP server that extends its capabilities through WebAssembly plugins.β851Updated last week
- HelixDB is an open-source graph-vector database built from scratch in Rust.β3,758Updated this week
- HTTP(s) request filter for processesβ898Updated last week
- A Positively Charged JavaScript Runtimeβ334Updated last month
- Rust based package manager for macOSβ1,847Updated 5 months ago
- Git Based Memory Storage for Conversational AI Agentβ774Updated 2 weeks ago
- Onit MacOS clientβ1,024Updated 5 months ago
- An open-source framework for verifiably private AI inferenceβ910Updated last month
- Embeddable library or single binary for indexing and searching 1B vectorsβ366Updated last month
- An transformer based LLM. Written completely in Rustβ3,047Updated 4 months ago
- A cosy home for your LLMs.β901Updated last week