Giant MoE models on a single consumer GPU by streaming experts from SSD. CUDA fork of antirez/ds4: runs GLM-5.2 (743B), Tencent Hy3 (295B), and DeepSeek 4 Flash, with io_uring expert streaming, LFU host cache, cross-layer expert prefetch, and the first MTP speculative decoding for GLM-5.2.
☆40Jul 12, 2026Updated 3 months ago
Alternatives and similar repositories for neutronstar
Users that are interested in neutronstar are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- SSD-streaming inference engine for giant MoE models (Rust + CUDA). GLM 5.2 743B at 2 tok/s and Hy3 295B at 7 tok/s on two consumer 16GB G…☆235Sep 1, 2026Updated 2 months ago
- cyberneurova-DeepSeek-V4-Flash-abliterated-aligned local inference engine with M5 Metal support☆38Oct 22, 2026Updated 2 weeks ago
- A feature rich and optimized online map for Simrail.☆15Updated this week
- DeepSeek-V4.1-Flash-1017 (552B MoE + 196B Engram) on 2x RTX 3090 + 128 GB RAM. Rust + CUDA, T16 quantization. 40+ tok/s measured with exp…☆95Updated this week
- ☆10May 15, 2026Updated 5 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Transforms raw text into interconnected knowledge graphs and autonomously generates insights through advanced pattern detection. It combi…☆11Jul 29, 2026Updated 3 months ago
- Run Hy3 on a 10GB-RAM consumer machine — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦☆71Aug 3, 2026Updated 3 months ago
- ☆28Updated this week
- Breakwater is a local on-call agent service. Its name comes from "breakwater": by leveraging large model capabilities and historical data…☆27Jul 5, 2026Updated 4 months ago
- ☆15Aug 2, 2026Updated 3 months ago
- Pandorabox infrastructure code☆34Updated this week
- Docker environment for Code Search on Fess.☆11Oct 29, 2026Updated last week
- A cross-platform printer AI MCP server that supports Windows, macOS, and Linux systems, providing printer management, status queries, and…☆14Mar 10, 2026Updated 7 months ago
- A Steampunk-themed strategy game where you have to manage a steam supply network on a distant planet.☆31Apr 23, 2026Updated 6 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Python 2D parametric DXF rendering CAD engine☆31Sep 4, 2024Updated 2 years ago
- Headless / multi-user serving-mode for the DGX Spark: free unified memory for vLLM by paring back the desktop. Companion to qwen3.5-122B-…☆21Jun 29, 2026Updated 4 months ago
- Benchmark your local LLMs with real evaluation suites. Not vibes - actual scores.☆38Updated this week
- A Model Context Protocol (MCP) server which allows MCP Clients (such as Claude) to connect to Twitch Chat.☆11Jan 20, 2025Updated last year
- March7thAssistantExtender(三月七助手拓展包)☆15Jun 24, 2025Updated last year
- 📧 MCP server for Gmail☆12Oct 25, 2026Updated 2 weeks ago
- ☆13Oct 28, 2025Updated last year
- Capminal Smart Contracts Repository☆97Oct 27, 2026Updated last week
- C++ library for SHA256 & SHA256-HMAC calculation.☆10Apr 24, 2020Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Agent Traffic Control☆28Updated this week
- Sleek desktop cockpit for the Oh My Pi (omp) coding-agent harness: live agent chat, dashboards, sessions, skills, MCP, agents, GitHub.☆14Aug 5, 2026Updated 3 months ago
- Bluetooth Low Energy (BLE) MCP server for Claude Code and other MCP-compatible agents.☆19Mar 30, 2026Updated 7 months ago
- Dev Ubuntu 20.04 Docker image, with Oh-My-Zsh/Pyenv/GNU&LLVM Build Tools, suitable as a temp sysroot☆13Aug 10, 2022Updated 4 years ago
- Incremental convex hull algorithm☆12Aug 7, 2021Updated 5 years ago
- 🧩 Plugins and extractors that ArchiveBox + abx-dl use: chrome, ytdlp, wget, singlefile, readability, forum-dl, gallery-dl, papers-dl, an…☆18Updated this week
- STAIR: fine-tune a model to find the right section of a document for a query☆17Sep 30, 2026Updated last month
- ☆18Jun 21, 2026Updated 4 months ago
- MCP Server for OpenCode CLI integration - Execute OpenCode commands, manage sessions, and discover models through the Model Context Proto…☆16Aug 13, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Run autonomous AI agents across machines using a distributed filesystem.☆17Apr 3, 2026Updated 7 months ago
- AI_Powered_Dev_Search_Engine☆12Mar 10, 2024Updated 2 years ago
- ☆14Apr 16, 2025Updated last year
- Protogen platform☆46Oct 23, 2026Updated 2 weeks ago
- ☆36Oct 31, 2026Updated last week
- ☆18Jun 17, 2025Updated last year
- MX Systolic Arrays on FPGAs☆14Oct 26, 2026Updated last week