Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.
☆6,171Sep 26, 2026Updated last month
Alternatives and similar repositories for cactus
Users that are interested in cactus are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, ASR, structured extraction and embeddings on phones, wearables,…☆14,433Oct 19, 2026Updated 2 weeks ago
- A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.☆25,174Updated this week
- Open-source State-of-the-art TTS model which runs on a CPU 😻☆16,757Updated this week
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.☆78,910Updated this week
- Scale computer-use 2.0 with open-source drivers, cross-OS sandboxes, and benchmarks for training, evaluation, and data generation.☆31,483Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Very low latency speech to text, intent recognition, and text to speech, for building voice agents and interfaces☆11,366Oct 2, 2026Updated 3 weeks ago
- Sim is the collaborative workspace to build, deploy, and monitor AI agents and workflows. Used by 100,000+ builders.☆29,954Updated this week
- SoTA open-source TTS☆27,489Jul 21, 2026Updated 3 months ago
- an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM☆56,072Updated this week
- Official inference framework for 1-bit LLMs☆41,430Jul 27, 2026Updated 3 months ago
- A high-performance inference engine for AI models☆3,159Updated this week
- Run frontier AI locally.☆48,146Updated this week
- LLM inference in C/C++☆133,055Updated this week
- Distribute and run LLMs with a single file.☆26,539Oct 12, 2026Updated 3 weeks ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- On-device AI across mobile, embedded and edge for PyTorch☆5,146Updated this week
- Open Source framework for voice agents, multimodal apps, and realtime AI. Maintained by Daily and the community.☆16,974Updated this week
- The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.☆25,894Updated this week
- Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.☆45,217Updated this week
- Open source Granola AI Alternative☆9,732Updated this week
- TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.☆11,710Jun 11, 2026Updated 4 months ago
- Mastra is the modern TypeScript framework for AI-powered applications and agents.☆29,252Updated this week
- A TTS model capable of generating ultra-realistic dialogue in one pass.☆19,407Nov 19, 2025Updated 11 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆96,053Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- 🙌 OpenHands: AI-Driven Development☆92,418Updated this week
- 🌐 The open-source Agentic browser; alternative to ChatGPT Atlas, Perplexity Comet, Dia.☆14,209Updated this week
- Port of OpenAI's Whisper model in C/C++☆54,842Updated this week
- The Memory Layer for AI Agents - Drop-in memory infrastructure for AI agents and apps. Context that persists. Built for production.☆68,226Updated this week
- HelixDB is an OLTP graph database with native vector and full-text search built in Rust on Object Storage.☆6,263Updated this week
- Moshi is a speech-text foundation model and full-duplex spoken dialogue framework. It uses Mimi, a state-of-the-art streaming neural audi…☆11,357Sep 9, 2026Updated last month
- High-performance In-browser LLM Inference Engine☆19,343Updated this week
- The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails…☆62,486Updated this week
- AI coworker with memory and collaboration☆18,113Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆28,724Jun 2, 2026Updated 4 months ago
- The open-source managed agent platform. A self-hostable alternative to Claude Managed Agents and OpenAI's Agents API.☆3,339Updated this week
- Lightpanda: the headless browser designed for AI and automation☆40,112Updated this week
- LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via e…☆3,554Updated this week
- The self-driving agent platform☆43,003Updated this week
- LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge dev…☆6,797Updated this week
- A free, open source, and extensible speech-to-text application that works completely offline.☆36,539Updated this week