trymirai / uzuLinks
A high-performance inference engine for AI models
☆583Updated this week
Alternatives and similar repositories for uzu
Users that are interested in uzu are comparing it to the libraries listed below
Sorting:
- Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit …☆356Updated last month
- High-Performance Implementation of OpenAI's TikToken.☆432Updated 2 weeks ago
- Rust framework for LLM orchestration☆204Updated 11 months ago
- Minimal LLM inference in Rust☆1,003Updated 8 months ago
- Run any ML model from any programming language.☆422Updated last year
- Stateful load balancer custom-tailored for llama.cpp 🏓🦙☆792Updated this week
- Your personal plug and play memory layer for LLMs☆417Updated last week
- Official Rust Implementation of Model2Vec☆122Updated 2 weeks ago
- Browser-LLM Auto-Scaling Technology☆531Updated this week
- Artificial Neural Engine Machine Learning Library☆1,095Updated last week
- A robust message queue system for Rust applications, designed as a Rust alternative to Celery.☆403Updated last week
- A flexible authorization library that combines role-based (RBAC), attribute-based (ABAC), and relationship-based (ReBAC) access control p…☆307Updated last month
- A Rust crate for containing memory leaks and fragmentation☆240Updated 2 months ago
- Local coding agent with neat UI☆214Updated 2 months ago
- ☆196Updated 2 months ago
- A faster FaaS platform with full wasi-http compliance☆224Updated 3 weeks ago
- Browsers-as-a-service for automations and web agents☆376Updated last week
- Faster builds, zero effort.☆192Updated this week
- High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and in…☆1,107Updated this week
- Deterministic workflow engine☆279Updated this week
- Securely run AI-generated code in stateful sandboxes that run forever.☆208Updated 3 months ago
- Embedded storage built for multiplexing. Smart machines don't need to read JSON, they only need protocol buffers. The world's first MODMS…☆294Updated this week
- HNSW implementation in Rust. Reference: https://arxiv.org/ftp/arxiv/papers/1603/1603.09320.pdf☆232Updated 8 months ago
- 📦️ A fast, secure MCP server that extends its capabilities through WebAssembly plugins.☆722Updated this week
- Unofficial Rust bindings to Apple's mlx framework☆166Updated last week
- High-performance key-value store for ML inference. 100x faster than Redis.☆221Updated last year
- ☆163Updated last year
- Self-contained distributed software platform for building stateful, massively real-time streaming applications in Rust.☆345Updated 3 weeks ago
- ☆640Updated this week
- Transform JSON objects using vector embeddings☆422Updated last year