trymirai / uzuLinks
A high-performance inference engine for AI models
☆1,404Updated this week
Alternatives and similar repositories for uzu
Users that are interested in uzu are comparing it to the libraries listed below
Sorting:
- Minimal LLM inference in Rust☆1,026Updated last year
- Open-source LLM load balancer and serving platform for self-hosting LLMs at scale 🏓🦙☆1,414Updated last week
- High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and in…☆1,244Updated this week
- High-Performance Implementation of OpenAI's TikToken.☆467Updated 6 months ago
- Artificial Neural Engine Machine Learning Library☆1,295Updated 2 weeks ago
- Your filesystem as a vector database☆499Updated 8 months ago
- Modern, fast, document parser written in 🦀☆536Updated 3 months ago
- Diagram as Code Tool Written in Rust with Draggable Editing☆2,156Updated this week
- A robust message queue system for Rust applications, designed as a Rust alternative to Celery.☆593Updated last week
- Rust based package manager for macOS☆1,850Updated 4 months ago
- A powerful document AI question-answering tool that connects to your local Ollama models. Create, manage, and interact with RAG systems f…☆1,090Updated 5 months ago
- Local first semantic and hybrid BM25 grep / search tool for use by AI and humans!☆1,244Updated last month
- Fast, streaming indexing, query, and agentic LLM applications in Rust☆638Updated last week
- Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit …☆362Updated 7 months ago
- 🦭 Distributed log streaming engine built from first principles☆1,787Updated last month
- A fast, minimalist directory tree viewer, written in Rust.☆1,394Updated 4 months ago
- Fully open-source command-line AI assistant inspired by OpenAI Codex, supporting local language models.☆665Updated 6 months ago
- 📦️ A fast, secure MCP server that extends its capabilities through WebAssembly plugins.☆834Updated this week
- SeekStorm - sub-millisecond full-text search library & multi-tenancy server in Rust☆1,804Updated this week
- An transformer based LLM. Written completely in Rust☆3,030Updated 3 months ago
- Onit MacOS client☆1,020Updated 4 months ago
- Demo project showing a single Rust codebase running on CPU and directly on GPUs☆469Updated 5 months ago
- A human-friendly alternative to netstat for socket and port monitoring on Linux and macOS.☆2,539Updated this week
- A fast, lightweight text editor for Markdown, JSON, YAML, and TOML files. Built with Rust and egui for a native, responsive experience.☆500Updated this week
- HelixDB is an open-source graph-vector database built from scratch in Rust.☆3,663Updated this week
- MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. I…☆634Updated 3 weeks ago
- A fast Rust based tool to serialize text-based files in a repository or directory for LLM consumption☆2,393Updated last week
- An open-source framework for verifiably private AI inference☆903Updated last week
- kulfi: Open Source, General Purpose, Sovereign, Decentralized, Peer to Peer Internet. https://malai.sh: Command Line Toolkit for fastn-ne…☆535Updated 3 months ago
- Run any ML model from any programming language.☆425Updated 2 years ago