Pipeline-parallel LLM inference across GPUs on separate machines.
☆469Oct 28, 2026Updated this week
Alternatives and similar repositories for shard
Users that are interested in shard are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Uncensored, private, decentralized AI inference on Solana.☆80Oct 23, 2026Updated last week
- htop for your local AI☆12Sep 30, 2026Updated last month
- CLI port of BenchLocal quality bench packs — runs LLM behavioral evals against any OpenAI-compatible endpoint. Companion to club-3090.☆20Oct 16, 2026Updated 2 weeks ago
- GLM-5.2 UD-Q2 decode speedup: CPU∥GPU MoE expert-split (harness, specs, de-risk)☆23Aug 9, 2026Updated 2 months ago
- Working recipe: MiniMax-M3 NVFP4 at tensor-parallel 3 across 3x DGX Spark (GB10/sm_121) with clean tool-calling. Includes the head-node O…☆16Jul 13, 2026Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- GLM-5.2-NVFP4-REAP-469B serving on SM120 (4× RTX PRO 6000 Blackwell) — one-command vLLM launch recipe, 250K context, DeepSeek Sparse Atte…☆155Jun 19, 2026Updated 4 months ago
- Full Transformer into a custom chip. microGPT in RTL, generating names on a Virtex-5 FPGA at ~56k tokens/second.☆655Jun 25, 2026Updated 4 months ago
- LLM speculative inference server for heterogeneous hardware & consumer GPUs☆2,967Updated this week
- LLM inference in C/C++☆56Aug 8, 2026Updated 2 months ago
- ☆17Aug 16, 2026Updated 2 months ago
- GLM-5.3-Flash (320B MoE) at TP4 across four DGX Sparks, same day as the model drop: 36 tok/s, 1.26M-token FP8 KV pool, 262K context, MTP …☆57Oct 10, 2026Updated 3 weeks ago
- The marketplace for verifiable AI outcomes: state a task, get a fixed price upfront, and Primitive Bench routes across tools to complete …☆122Sep 3, 2026Updated last month
- Bend's landing page☆18Sep 9, 2026Updated last month
- Distil SN97 — Competitive Model Distillation on Bittensor☆35May 20, 2026Updated 5 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Winner 🏆 (Agent-only) MLSys 2026 - FlashInfer AI Kernel Generation Contest for the DeepSeek Sparse Attention (DSA) track with an average…☆317Sep 12, 2026Updated last month
- Qwen3.6/3.8-27B on one RTX 5090: 576K pooled context across 12 sessions at FP8-level quality from 5.75 bpw. EXL3 trellis weights, 4-bit t…☆28Oct 23, 2026Updated last week
- Reason over explicit states, many branches at once: merge duplicates, cancel dead ends, advance together.☆181Oct 3, 2026Updated 3 weeks ago
- A vLLM patch + hand‑written SM120 SASS kernels: 2‑bit MoE experts + an FP4 "delta" cache that recovers precision — matching the official …☆561Updated this week
- simple activegraph coding agent demo☆13Jun 8, 2026Updated 4 months ago
- NVFP4 Gemma-4 26B-A4B MoE for DGX Spark — optimal recipe: DFlash n=10 (flex) on AEON vLLM Ultimate. 144 tok/s single / 1,724 peak (Coding…☆46Oct 6, 2026Updated 3 weeks ago
- An Enhanced TOP program to monitor your Nvidia DGX SPARK's Hardware☆12Jan 10, 2026Updated 9 months ago
- Open-source AI computer designs, from desktop workstations to 8-GPU servers.☆1,548Oct 6, 2026Updated 3 weeks ago
- Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, sglang, llama.cpp and other custom engines) and m…☆2,466Updated this week
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm☆24,172Updated this week
- ☆10Jun 20, 2026Updated 4 months ago
- Desktop provider switcher for Claude Code and Codex. Keep every endpoint, API key, and model in one place, switch the active provider in …☆17Updated this week
- Native DeepSeek V4.1 Flash inference across one RTX PRO 6000 and four DGX Spark expert workers☆38Sep 25, 2026Updated last month
- Autonomous self-improving 4x DGX Spark (GB10) MoA stack + LoRA loop (DSV4F router, Qwen3.6/Omni/TwoTower/Gemma). Hermes MoA routing, ~90%…☆24Aug 17, 2026Updated 2 months ago
- Control panel for VLLM, Sglang, llama.cpp, exllamav3☆1,836Updated this week
- Tile primitives for speedy kernels☆21Sep 13, 2026Updated last month
- PasteDB is a modern paste-sharing platform built for quickly sharing code, notes, text snippets, and images through simple links.☆20Updated this week
- A daily vulnerability briefing for AI-agent-managed machines — deterministic matching against OSV + CISA KEV; the LLM only explains. MIT☆17Oct 25, 2026Updated last week
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Code for the paper ReplaySSM: Cache SSM Inputs, Not State☆63Oct 13, 2026Updated 2 weeks ago
- ☆20Jun 1, 2026Updated 4 months ago
- A world beyond the story...☆33Jun 13, 2026Updated 4 months ago
- Self-hosted malware static triage platform powered by LLMs☆27Aug 19, 2026Updated 2 months ago
- Official Project Page for KL-Regularized Policy Optimization (KLPO) (https://arxiv.org/abs/2610.08963)☆190Oct 10, 2026Updated 3 weeks ago
- Statistically-Lossless Quantization of Large Language Models☆52Oct 8, 2026Updated 3 weeks ago
- AI Agents designed to help manage and update EventCatalog for users☆41Jul 7, 2026Updated 3 months ago