Compressed KV cache as cross-backend wire format for Metal + CUDA split inference over Thunderbolt 5
☆16Apr 14, 2026Updated 3 months ago
Alternatives and similar repositories for turboquant-tinygrad-bridge
Users that are interested in turboquant-tinygrad-bridge are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆24Mar 26, 2026Updated 4 months ago
- Run a 35B MoE model at 10+ tok/s on a $600 Mac mini. Pure C/Metal inference engine streaming experts from SSD on Apple Silicon☆19Apr 20, 2026Updated 3 months ago
- Chatons is a desktop AI workspace for coding and project workflows: it lets you chat with multiple AI providers, pick scoped or full mod…☆18May 27, 2026Updated 2 months ago
- LLM inference in C/C++☆35Apr 12, 2026Updated 3 months ago
- ☆10Jun 16, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Fork of turbo quant tom-tom and TurboQuant KV cache from domwox☆30Jul 7, 2026Updated last month
- ☆13Feb 8, 2023Updated 3 years ago
- A NERDTree-style sidebar for managing Claude Code sessions in tmux☆15Feb 26, 2026Updated 5 months ago
- Curated AMD GPU compatibility index and CLI for AI workloads☆31May 23, 2026Updated 2 months ago
- Install the ComfyUI Cloud MCP server for Claude, Cursor, and other AI agents☆18Jun 22, 2026Updated last month
- Publicly available code for Net Protocol☆15Jul 23, 2026Updated 2 weeks ago
- ☆12Jul 9, 2020Updated 6 years ago
- Pairwise theory based test cases generator☆13Jun 7, 2021Updated 5 years ago
- ANE (Apple Neural Engine) CostModel profiler for CoreML models☆36Apr 9, 2026Updated 4 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- AI skills for Claude Code. Product marketing, strategy & GTM frameworks by a product leader and full-stack builder in the age of AI.☆20Feb 7, 2026Updated 6 months ago
- AI-based research for supplementation protocols