Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, ASR, structured extraction and embeddings on phones, wearables, smart homes, robots, cars and microcontrollers.
☆13,896Oct 11, 2026Updated this week
Alternatives and similar repositories for needle
Users that are interested in needle are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.☆6,119Sep 26, 2026Updated 2 weeks ago
- A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows☆2,255Sep 1, 2026Updated last month
- Fast and Accurate Code Search for Agents. Uses 99% fewer tokens than grep+read☆6,199Updated this week
- An embeddable, portable, branchable virtual machine to safely run Agents locally.☆6,711Updated this week
- State machine guardrails for AI agents☆505Sep 25, 2026Updated 2 weeks ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Open-source State-of-the-art TTS model which runs on a CPU 😻☆15,867Oct 6, 2026Updated last week
- Coding Agent singularly focused efficiency and context curation. Reduces API costs by 50-80% vs other agent AND improves the code quality…☆1,527Updated this week
- DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm☆23,819Updated this week
- Very low latency speech to text, intent recognition, and text to speech, for building voice agents and interfaces☆11,216Oct 2, 2026Updated last week
- Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦☆41,753Updated this week
- AI coworker with memory and collaboration☆18,011Updated this week
- Scale computer-use 2.0 with open-source drivers, cross-OS fleets, and benchmarks for training, evaluation, and data generation.☆29,632Updated this week
- 🌱 Private, quiet space for thinking. Simple app for .md files.☆4,158Sep 2, 2026Updated last month
- Shadow any website for offline viewing, with the JavaScript stripped out☆3,475Aug 10, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Lightning-Fast, On-Device, Multilingual TTS — running natively via ONNX.☆13,768Sep 9, 2026Updated last month
- AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI☆114,841Updated this week
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.☆77,936Updated this week
- A lightweight cli for running single-purpose AI agents. Define focused agents in TOML, trigger them from anywhere; pipes, git hooks, cron…☆897Oct 5, 2026Updated last week
- Bonsai Demo☆3,345Updated this week
- Ollama for classical ML models. AOT compiler that turns XGBoost, LightGBM, scikit-learn, CatBoost & ONNX models into native C99 inference…☆689Apr 16, 2026Updated 5 months ago
- A vector index built on TurboQuant, written in Rust with Python bindings☆17,377Updated this week
- TurboQuant WASM SIMD vector compression — 3 bits/dim with fast dot product. Requires relaxed SIMD (Chrome 114+, Firefox 128+, Safari 18+,…☆323Apr 19, 2026Updated 5 months ago
- Running a big model on a small laptop☆4,240Mar 19, 2026Updated 6 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- On-device, real-time multimodal AI with features similar to GPT-Live☆2,074Aug 3, 2026Updated 2 months ago
- an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM☆55,239Updated this week
- Fine-tune Gemma 4 and 3n with audio, images and text on Apple Silicon, using PyTorch and Metal Performance Shaders.☆1,516Oct 4, 2026Updated last week
- Get up and running with GLM-5.3-flash, DeepSeek, Gemma and other open source frontier models.☆1,564Updated this week
- Use Claude Code's autonomous agent loop with DeepSeek V4 Pro, OpenRouter, or any Anthropic-compatible backend. Same UX, 17x cheaper.☆2,265Jul 23, 2026Updated 2 months ago
- Lightweight coding agent written in Rust, optimized for memory footprint and performance☆1,707Updated this week
- Official inference framework for 1-bit LLMs☆41,101Jul 27, 2026Updated 2 months ago
- Lightpanda: the headless browser designed for AI and automation☆36,411Updated this week
- Open-Source Frontier Voice AI☆54,807Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A fast, helpful, and open-source document parser☆12,843Updated this week
- A lightweight text-to-speech model with zero-shot voice cloning☆973Sep 1, 2026Updated last month
- IP addresses break, dial keys instead. A library that adds QUIC + NAT Traversal to your apps.☆12,694Updated this week
- The only tool you need to know what is happening and how to fix it.☆1,605Updated this week
- Voxtral ASR & TTS running natively and in the browser. A Rust implementation of Mistral's Voxtral mini realtime ASR / TTS using the Burn …☆823Updated this week
- SQLite extension + bindings for Postgres NOTIFY/LISTEN semantics with durable queues, streams, pub/sub, and scheduler☆3,038Updated this week
- Distribute and run LLMs with a single file.☆26,230Updated this week