cactus-compute / cactusLinks
Kernels & AI inference engine for mobile devices.
☆3,998Updated this week
Alternatives and similar repositories for cactus
Users that are interested in cactus are comparing it to the libraries listed below
Sorting:
- ☆659Updated last week
- State-of-the-art TTS model under 25MB 😻☆9,422Updated 4 months ago
- Have a natural, spoken conversation with AI!☆3,448Updated 5 months ago
- An app that brings language models directly to your phone.☆5,371Updated this week
- This repository contains the official implementation of "FastVLM: Efficient Vision Encoding for Vision Language Models" - CVPR 2025☆7,110Updated 7 months ago
- On-device TTS model by Neuphonic☆4,313Updated last week
- A high-performance inference engine for AI models☆1,393Updated this week
- Communicate with an LLM provider using a single interface☆1,519Updated this week
- Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https…☆1,954Updated this week
- The most accurate document search and store for building AI apps☆3,432Updated this week
- ☆2,238Updated last month
- Run LLMs with MLX☆3,160Updated this week
- Omnara (YC S25) - Talk to Your AI Agents from Anywhere!☆2,568Updated this week
- A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speec…☆3,153Updated last week
- Local realtime voice AI☆2,411Updated last month
- I made my AI think harder by making it argue with itself repeatedly. It works stupidly well.☆2,316Updated 8 months ago
- Renderer for the harmony response format to be used with gpt-oss☆4,111Updated 2 weeks ago
- Lightning-Fast, On-Device TTS — running natively via ONNX.☆1,913Updated 2 weeks ago
- Kyutai's Speech-To-Text and Text-To-Speech models based on the Delayed Streams Modeling framework.☆2,686Updated last month
- Towards Human-Sounding Speech☆5,848Updated 3 weeks ago
- ✨ Build a machine learning model from a prompt☆2,287Updated 4 months ago
- Omnilingual ASR Open-Source Multilingual SpeechRecognition for 1600+ Languages☆2,537Updated 2 weeks ago
- Render any git repo into a single static HTML page for humans or LLMs☆1,982Updated 4 months ago
- Lightweight coding agent that runs in your terminal☆2,161Updated 8 months ago
- WebAssembly binding for llama.cpp - Enabling on-browser LLM inference☆965Updated 2 weeks ago
- Open Source Machine Learning Research Platform designed for frontier AI/ML workflows. Local, on-prem, or in the cloud. Open source.☆4,724Updated this week
- MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.☆1,976Updated this week
- 🦛 CHONK docs with Chonkie ✨ — The lightweight ingestion library for fast, efficient and robust RAG pipelines☆3,443Updated this week
- Make text LLMs listen and speak☆1,052Updated last week
- A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.☆14,695Updated 2 weeks ago