cactus-compute / cactusLinks
Kernels & AI inference engine for mobile devices.
☆4,238Updated this week
Alternatives and similar repositories for cactus
Users that are interested in cactus are comparing it to the libraries listed below
Sorting:
- ☆797Updated this week
- Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https…☆2,113Updated this week
- Communicate with an LLM provider using a single interface☆1,661Updated this week
- LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via e…☆1,444Updated this week
- Big & Small LLMs working together☆1,261Updated this week
- A high-performance inference engine for AI models☆1,420Updated this week
- Renderer for the harmony response format to be used with gpt-oss☆4,171Updated last month
- Lightning-Fast, On-Device, Multilingual TTS — running natively via ONNX.☆2,588Updated 2 weeks ago
- ☆2,271Updated 2 months ago
- On-device TTS model by Neuphonic☆4,768Updated last week
- WebAssembly binding for llama.cpp - Enabling on-browser LLM inference☆993Updated last month
- Make text LLMs listen and speak☆1,170Updated 2 weeks ago
- ✨ Build a machine learning model from a prompt☆2,512Updated this week
- Kyutai's Speech-To-Text and Text-To-Speech models based on the Delayed Streams Modeling framework.☆2,832Updated 2 weeks ago
- MentraOS is the leading smart glasses platform + SDK. Stream your view, transcribe audio, talk to AI and capture photos hands-free on com…☆1,774Updated this week
- Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.☆2,339Updated 6 months ago
- Omnilingual ASR Open-Source Multilingual SpeechRecognition for 1600+ Languages☆2,632Updated last month
- State-of-the-art TTS model under 25MB 😻☆9,590Updated last week
- Running any GGUF SLMs/LLMs locally, on-device in Android☆666Updated last month
- Omnara (YC S25) - Talk to Your AI Agents from Anywhere!☆2,605Updated 3 weeks ago
- MobileLLM Optimizing Sub-billion Parameter Language Models for On-Device Use Cases. In ICML 2024.☆1,406Updated 9 months ago
- Render any git repo into a single static HTML page for humans or LLMs☆2,016Updated 5 months ago
- A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.☆15,102Updated this week
- The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU cluste…☆4,779Updated this week
- Have a natural, spoken conversation with AI!☆3,506Updated 7 months ago
- Background coding agent and real-time web interface☆1,431Updated 2 months ago
- Qwen3-omni is a natively end-to-end, omni-modal LLM developed by the Qwen team at Alibaba Cloud, capable of understanding text, audio, im…☆3,399Updated last month
- On-device AI across mobile, embedded and edge for PyTorch☆4,226Updated this week
- A TTS that fits in your CPU (and pocket)☆2,995Updated last week
- MiniMax-M1, the world's first open-weight, large-scale hybrid-attention reasoning model.☆3,075Updated 7 months ago