Truthful scheduler-step and streaming visualization for local LLM inference
☆35Sep 6, 2026Updated 2 months ago
Alternatives and similar repositories for ParallelHue
Users that are interested in ParallelHue are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆37Apr 26, 2026Updated 6 months ago
- NVFP4 KV cache for vLLM on SM120 (RTX PRO 6000) via FlashInfer FA2 explicit-SF-stride patch — ~1.5x fp8 pool at ~95-104% speed☆20Jun 5, 2026Updated 5 months ago
- A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative…☆11Oct 13, 2026Updated 3 weeks ago
- Validated GLM-5.3 Flash recipe for 2x NVIDIA RTX PRO 6000 Blackwell 96GB: 262K context, EXL3/TR3, adaptive MTP, tools, and vision.☆63Sep 20, 2026Updated last month
- Headless agent framework with Bash, Ripgrep, and MCP support - invocable via TypeScript SDK, Python SDK, and CLI☆12Oct 28, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- LLM serving engines that SkyDiscover builds on the fly for specific AI models and hardware: Qwen3.6-35B-A3B, Qwen3.8-Flash-Next and Flint…☆33Updated this week
- GLM 5.3 Flash for 2x RTX 6000, Full Mixed EXL3 Support, Code C1 >220tps☆22Oct 25, 2026Updated 2 weeks ago
- ☆21Oct 21, 2026Updated 2 weeks ago
- Managed deepagents☆25Updated this week
- static embedding models in golang☆21Oct 10, 2026Updated 3 weeks ago
- Metal Cuda Direct Memory Access☆208Nov 1, 2026Updated last week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆47Oct 27, 2026Updated last week
- Qwen 3.8 Flash NVFP4 with PLE NVFP4 quantized to run on a single DGX Spark☆15Aug 28, 2026Updated 2 months ago
- Qwen3.8-Flash-Next on one Intel Arc Pro B70 with experts on NVMe and 32 GB host RAM: SGLang + exl3xpu tier, staged NVMe prefill, SYCL spa…☆22Oct 8, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆183Updated this week
- Benchmark your local LLMs with real evaluation suites. Not vibes - actual scores.☆38Updated this week
- SEC MCP provides a streamlined interface to access SEC EDGAR data through the Model Context Protocol. It supports real-time data streamin…☆16Jul 7, 2025Updated last year
- A playbook framework for Claude Code and the sprint loop built on it — deterministic state machinery, model-driven steps, plain-markdown …☆15Oct 22, 2026Updated 2 weeks ago
- Model routing is a System 1 job: a 421M local decision engine (Laya) against a GPT-5 nano reasoning router. Same accuracy, 35x faster, fr …☆13Sep 20, 2026Updated last month
- An open source repository of the Solana Mobile documentation website☆11Feb 5, 2026Updated 9 months ago
- ☆30Jul 9, 2026Updated 4 months ago
- GLM-5.2 UD-Q2 decode speedup: CPU∥GPU MoE expert-split (harness, specs, de-risk)☆23Aug 9, 2026Updated 2 months ago
- Clean reproducible benchmark suite for the self-hosted cascade RC (ARC-AGI-2, HMMT-2026, HLE, MMMU-Pro, SWE-Bench Pro, Terminal-Bench 2.1…☆13Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- One sentence in, a researched 3D motion graphic out — a Claude Code skill that makes looping real-time HTML films (Three.js) and frame-ex…☆30Oct 2, 2026Updated last month
- ☆12Jul 31, 2026Updated 3 months ago
- Bonsai 2 27B: 262k context (trained max) on 12 GB, 54 to 97 tok/s decode, 2x prefill, q8_0 KV recipe, grammar tool calls 9/9. Same ternar…☆100Updated this week
- Set a specific expiration date (e.g. 2026-12-31) for a PMPro membership level or discount code. This expiration date will override any ex…☆11Sep 29, 2026Updated last month
- Enhancing Handwritten Quranic Arabic Recognition through Deep Learning☆21Jan 23, 2026Updated 9 months ago
- RTX 6000 Pro Wiki — Running Large LLMs (Qwen3.5-397B, Kimi-K2.5, GLM-5) on PCIe GPUs without NVLink☆18Updated this week
- Dockerized Screaming Frog SEO Spider☆14May 22, 2023Updated 3 years ago
- RL Gym for Security Agent Training☆12Jun 1, 2026Updated 5 months ago
- Terminal-based interface for AI assistants with isolated workspaces for development☆20Jun 29, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- `Paper repo for “Coherence-Guided Dead-Head Identification in Frozen Transformers,” including manuscript sources, figures, frozen result …☆52Apr 8, 2026Updated 7 months ago
- GLM-5.2-NVFP4-REAP-469B serving on SM120 (4× RTX PRO 6000 Blackwell) — one-command vLLM launch recipe, 250K context, DeepSeek Sparse Atte…☆155Jun 19, 2026Updated 4 months ago
- ☆13Updated this week
- High performance reverse proxy for logging LLM traces (OpenRouter/LiteLLM)☆21Sep 8, 2026Updated 2 months ago
- SnailHunter is a fully automated bug bounty hunting platform that combines traditional security tools with AI-powered analysis.☆17May 8, 2026Updated 6 months ago
- An open benchmark arena for coding agent harnesses, built for the Pi community☆12Oct 21, 2026Updated 2 weeks ago
- One serving daemon for local LLM inference — across runtimes and machines.☆22Updated this week