trymirai / uzuLinks
A high-performance inference engine for AI models
β1,343Updated this week
Alternatives and similar repositories for uzu
Users that are interested in uzu are comparing it to the libraries listed below
Sorting:
- Open-source LLM load balancer and serving platform for self-hosting LLMs at scale ππ¦β1,337Updated last week
- Minimal LLM inference in Rustβ1,013Updated 11 months ago
- High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and inβ¦β1,191Updated this week
- High-Performance Implementation of OpenAI's TikToken.β458Updated 3 months ago
- Artificial Neural Engine Machine Learning Libraryβ1,211Updated last month
- A powerful document AI question-answering tool that connects to your local Ollama models. Create, manage, and interact with RAG systems fβ¦β1,079Updated 2 months ago
- Your filesystem as a vector databaseβ482Updated 5 months ago
- Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit β¦β360Updated 5 months ago
- HelixDB is an open-source graph-vector database built from scratch in Rust.β2,856Updated this week
- Demo project showing a single Rust codebase running on CPU and directly on GPUsβ447Updated 2 months ago
- Onit MacOS clientβ1,007Updated 2 months ago
- Rust based package manager for macOSβ1,865Updated last month
- A fast, minimalist directory tree viewer, written in Rust.β1,353Updated last month
- Fast, streaming indexing, query, and agentic LLM applications in Rustβ591Updated this week
- Fully open-source command-line AI assistant inspired by OpenAI Codex, supporting local language models.β634Updated 3 months ago
- Communicate with an LLM provider using a single interfaceβ1,008Updated this week
- Local first semantic and hybrid BM25 grep / search tool for use by AI and humans!β898Updated this week
- SeekStorm - sub-millisecond full-text search library & multi-tenancy server in Rustβ1,746Updated last week
- Microsandbox β Self-Hosted Plaform for Secure Execution of Untrusted User or AI-Generated Codeβ3,881Updated 2 months ago
- Modern, fast, document parser written in π¦β521Updated last week
- A robust message queue system for Rust applications, designed as a Rust alternative to Celery.β577Updated 3 months ago
- git-like rag pipelineβ246Updated last week
- High-performance MLX-based LLM inference engine for macOS with native Swift implementationβ416Updated 3 weeks ago
- π¦οΈ A fast, secure MCP server that extends its capabilities through WebAssembly plugins.β811Updated this week
- MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. Iβ¦β583Updated last week
- Unofficial Rust bindings to Apple's mlx frameworkβ202Updated 2 weeks ago
- A human-friendly alternative to netstat for socket and port monitoring on Linux and macOS.β2,459Updated last week
- A Positively Charged JavaScript Runtimeβ322Updated last week
- VS Code extension for LLM-assisted code/text completionβ1,001Updated last week
- kulfi: Open Source, General Purpose, Sovereign, Decentralized, Peer to Peer Internet. https://malai.sh: Command Line Toolkit for fastn-neβ¦β507Updated last month