trymirai / uzuLinks
A high-performance inference engine for AI models
β1,419Updated this week
Alternatives and similar repositories for uzu
Users that are interested in uzu are comparing it to the libraries listed below
Sorting:
- Open-source LLM load balancer and serving platform for self-hosting LLMs at scale ππ¦β1,430Updated 2 weeks ago
- High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and inβ¦β1,245Updated this week
- Minimal LLM inference in Rustβ1,028Updated last year
- Diagram as Code Tool Written in Rust with Draggable Editingβ2,176Updated 2 weeks ago
- Local first semantic and hybrid BM25 grep / search tool for use by AI and humans!β1,371Updated last week
- Your filesystem as a vector databaseβ502Updated 9 months ago
- Artificial Neural Engine Machine Learning Libraryβ1,305Updated this week
- Rust based package manager for macOSβ1,848Updated 5 months ago
- A robust message queue system for Rust applications, designed as a Rust alternative to Celery.β598Updated last week
- π¦ Distributed log streaming engine built from first principlesβ1,836Updated last week
- Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit β¦β363Updated 8 months ago
- High-Performance Implementation of OpenAI's TikToken.β467Updated 7 months ago
- A powerful document AI question-answering tool that connects to your local Ollama models. Create, manage, and interact with RAG systems fβ¦β1,092Updated 5 months ago
- Fast, streaming indexing, query, and agentic LLM applications in Rustβ653Updated last week
- A fast, lightweight text editor for Markdown, JSON, YAML, and TOML files. Built with Rust and egui for a native, responsive experience.β956Updated this week
- SeekStorm - sub-millisecond full-text search library & multi-tenancy server in Rustβ1,823Updated this week
- A fast, minimalist directory tree viewer, written in Rust.β1,400Updated 4 months ago
- Onit MacOS clientβ1,018Updated 5 months ago
- An transformer based LLM. Written completely in Rustβ3,043Updated 3 months ago
- An open-source framework for verifiably private AI inferenceβ910Updated 3 weeks ago
- Fully open-source command-line AI assistant inspired by OpenAI Codex, supporting local language models.β665Updated 6 months ago
- Unofficial Rust bindings to Apple's mlx frameworkβ247Updated this week
- Demo project showing a single Rust codebase running on CPU and directly on GPUsβ473Updated 5 months ago
- Modern, fast, document parser written in π¦β549Updated 3 months ago
- Zero-copy PDF text extraction library written in Zig. High-performance, memory-mapped parsing with SIMD acceleration.β840Updated last month
- HelixDB is an open-source graph-vector database built from scratch in Rust.β3,723Updated this week
- Beautiful, open source, WebGPU-based charting libraryβ2,356Updated last week
- HTTP(s) request filter for processesβ855Updated this week
- kulfi: Open Source, General Purpose, Sovereign, Decentralized, Peer to Peer Internet. https://malai.sh: Command Line Toolkit for fastn-neβ¦β538Updated 2 weeks ago
- A human-friendly alternative to netstat for socket and port monitoring on Linux and macOS.β2,549Updated last week