W8A8/W4A8 inference + optimized SDPA on Apple Silicon — unlocking unused INT8 TensorOps in M5 for 1.2–1.9× faster LLM prefill, plus FlashInfer-inspired GQA decode attention for up to 1.6× SDPA speedup, built as MLX custom primitives.
☆360Jun 5, 2026Updated 5 months ago
Alternatives and similar repositories for cider
Users that are interested in cider are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Mano-P: Open-source GUI-VLA agent for edge devices. #1 on OSWorld (specialized, 58.2%). Runs locally on Apple M4 Mac mini/MacBook — no da…☆2,848Jun 25, 2026Updated 4 months ago
- LLM-powered conversation summarisation service for OCTO — turns group chats and threads into structured briefs with key decisions, open q…☆34Updated this week
- Bridge Claude Code (Claude Agent SDK) to Octo IM — independent Node.js gateway☆31Oct 19, 2026Updated 3 weeks ago
- 🐙 Admin console for the OCTO platform — manage tenants, users, spaces, channels, and Lobster agents. Built with React, TypeScript, Vite …☆40Updated this week
- Lightweight task & matter service for the OCTO platform — REST API, timeline tracking, and LLM-powered extraction. Part of the OCTO open …☆31Jul 27, 2026Updated 3 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- The World's Most Comprehensive, Authoritative, and Structured Open Source Data Source Knowledge Base☆186Oct 3, 2026Updated last month
- Production-ready Kubernetes deployment manifests for the OCTO platform — Kustomize bases, environment overlays, and secret templates for …☆55Oct 27, 2026Updated 2 weeks ago
- Third-party adapters for OCTO — bridge AI agents, IM platforms, and external services into the OCTO workplace via OpenClaw channels and W…☆43Updated this week
- The Go foundation library for the OCTO platform — protocol types, crypto primitives, storage adapters, HTTP framework, event bus, and wor…☆28Updated this week
- Intelligent speech-to-text microservice for OCTO — multi-engine ASR (Gemini, GPT, Qwen) with context-aware correction, vocabulary managem…☆26Updated this week
- Web & desktop (Electron) client for the OCTO open workplace — one React + TypeScript codebase shipping browser and PC surfaces, with firs…☆1,220Updated this week
- Exact speculative decoding on Apple Silicon, powered by MLX.☆390Apr 20, 2026Updated 6 months ago
- ☆47Jun 13, 2026Updated 5 months ago
- Native Apple Silicon inference engine for many AI agents at once: C++/Metal, agent-contexts API, 8-bit paged KV, SSD tier (Qwen3.8)☆34Updated this week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- 极简 macOS 原生文本编辑器 · A tiny native plain-text editor for macOS☆27Updated this week
- 🐙 The Go backend powering OCTO — an open workplace built for humans × AI agents. REST & WebSocket APIs, Lobster (AI agent) orchestration…☆1,113Updated this week
- Apple Neural Engine on Linux: verified gemm/softmax/attention/transformer-block primitives, driven from Python on an M1 under Omarchy Mac☆20Updated this week
- Research MIL-to-HWX compiler for the M4 Apple Neural Engine☆19Sep 3, 2026Updated 2 months ago
- Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused o…☆4,140Updated this week
- Lossless DFlash speculative decoding for MLX on Apple Silicon☆793Aug 20, 2026Updated 2 months ago
- 让 AI Agent 操控你的 X/Twitter 账号 | Local API for OpenClaw to control X☆13Mar 13, 2026Updated 8 months ago
- ☆71Oct 3, 2026Updated last month
- The Open Assistant API is a ready-to-use, open-source, self-hosted agent/gpts orchestration creation framework, supporting customized ext…☆369Jun 24, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar☆23,600Updated this week
- ⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.☆6,013Updated this week
- Organization profile, community health files, and shared templates☆39Sep 16, 2026Updated last month
- MLX (Apple Silicon) port of MiniMax-H3 video+audio and Pruna's P-H3-Image. Use it in Phosphene, the free Mac app: phosphene.video☆29Updated this week
- 🔄 Upstream version aggregator for the OCTO platform — periodically scans GitHub Releases and npm registry, normalizes to version.json on…☆17Updated this week
- Octo official website — modern, internationalized redesign☆17Jun 27, 2026Updated 4 months ago
- Octo ecosystem unified authentication: contract, SDKs (Go first, TS/Python later)☆17Sep 24, 2026Updated last month
- 一个辅助 Vibe Coding 的 Skill 工具，通过生成结构化的版本需求文档，来指导 AI 进行 Coding ，提升 Coding 的准确性。☆11May 7, 2026Updated 6 months ago
- 一个可以生成万千美女的提示词生成器☆49Oct 14, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Software guides on my taste☆13Nov 3, 2026Updated last week
- Git-native AI coding engineering standard: shared specs, tasks, and project memory in your repo.☆19Jul 10, 2026Updated 4 months ago
- Chris Dixon 博客全文知识库（42万字）——喂给 AI 学习加密投资☆36Mar 26, 2026Updated 7 months ago
- The open-source managed agents platform. Turn coding agents into real teammates — assign tasks, track progress, compound skills.☆20Jul 9, 2026Updated 4 months ago
- OpenClaw / octo AgentSkills for Mininglamp tooling☆20Jun 29, 2026Updated 4 months ago
- More than just IM 不只是即时通讯(IM)☆21Updated this week
- Impulse by Velocity: run AI models on your own computer, on Windows and Linux. Load any GGUF model and chat with web search, files, chart…☆34Updated this week
Are these results useful?