Tensor-parallel DeepSeek V4 Flash inference on dual AMD Strix Halo over OdinLink USB4/TB5 RDMA or Mellanox RoCE v2.
☆23Sep 20, 2026Updated last month
Alternatives and similar repositories for ds4-strix-halo-tp-odinlink
Users that are interested in ds4-strix-halo-tp-odinlink are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Docker Compose for llama.cpp GGUF servers on AMD Strix Halo: Qwen, Gemma, and Laguna packages (abliterated and quantized), stock Vulkan p…☆28Aug 17, 2026Updated 2 months ago
- Linux retro-themed h/w monitor w/real-time telemetry & historical data. LAN-only by design.☆14Jun 17, 2026Updated 4 months ago
- Qwen3.8-27B EXL3 + DFlash2 speculative decoding on an AMD RX 7900 XTX (exllamav3-rocm): recipe, patches, benchmarks☆22Nov 2, 2026Updated last week
- Performance-tuned llama.cpp for AMD Strix Halo (gfx1151): FA + MoE-prefill fixes with a bundled current Mesa driver. Vulkan and HIP; port…☆224Oct 25, 2026Updated 2 weeks ago
- GPU + XDNA2 NPU inference for AMD Strix Halo (gfx1151): Qwen3.6-35B-A3B, Qwen3.8-27B, Qwen3.8 Flash-Next, Flint and GLM-5.3 Flash (321B M…☆94Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Rust LLM inference engine tuned for AMD Strix Halo (gfx1151): a fork of Strata with ggml/llama.cpp-derived HIP kernels. Five models on on…☆39Updated this week
- A high-performance RCCL / NCCL (ROCm Communication Collectives Library) plugin for Thunderbolt 5 that enables GPU-to-GPU communication ac…☆78Nov 4, 2026Updated last week
- qwen3.8-flash-next on strix halo — 91g quant, 56 tok/s, 262k context, receipts included☆28Sep 24, 2026Updated last month
- Open-source deep-work orchestrator: a frontier planner proposes one small epoch at a time; local models grind; deterministic gates verify…☆41Jul 11, 2026Updated 4 months ago
- Portable vLLM builds with AMD ROCm acceleration for Lemonade☆81Sep 9, 2026Updated 2 months ago
- MCP server for creating UI flowcharts☆11Jan 5, 2025Updated last year
- Qubic Lite Reference Implementation (ql-node software)☆10Sep 22, 2018Updated 8 years ago
- Qwen 3.8 27B ROCmFP4 on AMD Strix Halo (Ryzen AI Max+ 395). Up to 36 tok/s via MTP Speculation, TurboQuant & Mesa RADV Wave64.☆268Sep 7, 2026Updated 2 months ago
- Rust-host continuation of DwarfStar for explicit, hardware-validated large-model inference on DGX-Spark.☆19Updated this week
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Python client for the dnsdist console☆13Aug 1, 2026Updated 3 months ago
- dyndns client daemon☆12Jan 23, 2024Updated 2 years ago
- ☆180Sep 2, 2026Updated 2 months ago
- ☆549Nov 2, 2026Updated last week
- ☆14Sep 23, 2016Updated 10 years ago
- ☆94Oct 23, 2026Updated 2 weeks ago
- Rulith Inference, formerly Strix Llama. Serving a 125B MoE model fast on one AMD Strix Halo machine, on Windows: a patched llama.cpp, a m…☆52Updated this week
- DeepSeek V4 Flash DSpark DGX Spark TP4 Ring 生产调优与算子工程归档 (LuZ0.4.5)☆17Sep 11, 2026Updated 2 months ago
- Auto install and set up Headroom for Hermes Agent. 70% token use reduction!☆13Jun 12, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Create dnsmasq DHCP & DNS configs using the Netbox API.☆14Jul 25, 2023Updated 3 years ago
- Open-source self-hosted home AI inference platform for AMD Strix Halo — multi-backend slots, OpenAI-compatible gateway, Vue 3 + FastAPI +…☆85Updated this week
- Kyojin: open-source engine that runs 100 GB-class open models (GLM-5.3, Qwen3.8, DeepSeek V4.1) on one desktop machine. AMD Strix Halo, N…☆235Updated this week
- An OpenSource Homebrew's Store☆12Oct 12, 2013Updated 13 years ago
- Home-enthusiast's guide to fine-tuning 27B+ LLMs on AMD Strix Halo (gfx1151, Ryzen AI MAX+ 395) — the patches and tuning to make Linux ma…☆32Jun 9, 2026Updated 5 months ago
- Dumps decrypted mach-o files from encrypted iPhone applications from memory to disk. This tool is necessary for security researchers to b…☆13Oct 29, 2014Updated 12 years ago
- Own your LLM's web search: a local search->fetch->rank pipeline that replaces hosted web-search tools. Measured: matches hosted accuracy …☆60Jul 23, 2026Updated 3 months ago
- ☆14Jul 15, 2016Updated 10 years ago
- Rust library to manipulate CUDA fatbinary format☆11Dec 9, 2025Updated 11 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- LLM inference in C/C++☆261Updated this week
- Self-hosted, browser-based AI dungeon RPG, fully local on an AMD Strix Halo APU: narrator + per-character agents on one local LLM (Gemma …☆29Jul 25, 2026Updated 3 months ago
- ☆95Updated this week
- netactuator is an active network management tool, for graphing individual host activities and make individual host behavior patterns.☆16Jul 17, 2011Updated 15 years ago
- Fast vLLM on AMD Strix Halo: one docker command for Qwen, Gemma, LFM and more, up to 31x faster prefill and ~2x decode vs stock vLLM at l…☆21Updated this week
- Automated Nested Lab Deployment on VMware Cloud SDDCs☆10Oct 26, 2020Updated 6 years ago
- Property Bindings for Objective-C☆19Jun 20, 2014Updated 12 years ago
Are these results useful?