cactus-compute / cactusLinks
Kernels & AI inference engine for mobile devices.
☆4,131Updated this week
Alternatives and similar repositories for cactus
Users that are interested in cactus are comparing it to the libraries listed below
Sorting:
- ☆759Updated this week
- Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https…☆2,042Updated this week
- Communicate with an LLM provider using a single interface☆1,594Updated this week
- Kyutai's Speech-To-Text and Text-To-Speech models based on the Delayed Streams Modeling framework.☆2,793Updated 2 months ago
- A high-performance inference engine for AI models☆1,418Updated this week
- ☆2,265Updated last month
- An app that brings language models directly to your phone.☆5,531Updated this week
- VS Code extension for LLM-assisted code/text completion☆1,135Updated last week
- State-of-the-art TTS model under 25MB 😻☆9,468Updated 5 months ago
- WebAssembly binding for llama.cpp - Enabling on-browser LLM inference☆981Updated last month
- Big & Small LLMs working together☆1,249Updated this week
- opensource self-hosted sandboxes for ai agents☆4,479Updated 2 weeks ago
- On-device AI across mobile, embedded and edge for PyTorch☆4,172Updated this week
- HelixDB is an open-source graph-vector database built from scratch in Rust.☆3,701Updated this week
- AI agents can now use real Android and iOS apps, just like a human.☆2,114Updated this week
- MentraOS is the leading smart glasses platform + SDK. Stream your view, transcribe audio, talk to AI and capture photos hands-free on com…☆1,653Updated this week
- On-device TTS model by Neuphonic☆4,679Updated last week
- Have a natural, spoken conversation with AI!☆3,475Updated 6 months ago
- Minimal CLI coding agent by Mistral☆2,778Updated last week
- A TTS that fits in your CPU (and pocket)☆2,075Updated this week
- Omnara (YC S25) - Talk to Your AI Agents from Anywhere!☆2,591Updated last week
- ✨ Build a machine learning model from a prompt☆2,302Updated 5 months ago
- The most accurate document search and store for building AI apps☆3,456Updated this week
- Make text LLMs listen and speak☆1,133Updated this week
- Open-source LLM load balancer and serving platform for self-hosting LLMs at scale 🏓🦙☆1,425Updated last week
- Renderer for the harmony response format to be used with gpt-oss☆4,146Updated last month
- An MCP server that autonomously evaluates web applications.☆1,235Updated last week
- Fully open-source command-line AI assistant inspired by OpenAI Codex, supporting local language models.☆665Updated 6 months ago
- Lightning-Fast, On-Device, Multilingual TTS — running natively via ONNX.☆2,407Updated last week
- Omnilingual ASR Open-Source Multilingual SpeechRecognition for 1600+ Languages☆2,611Updated 3 weeks ago