A LD_PRELOAD library to share CUDA VRAM weights across multiple processes using IPC.
☆12Jun 30, 2026Updated 4 months ago
Alternatives and similar repositories for cuda-llm-weight-share
Users that are interested in cuda-llm-weight-share are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆16Jun 27, 2026Updated 4 months ago
- Archived fork of antirez/ds4 for GB10 DSpark — continues as Athena: github.com/xangel82/Athena-Engine☆28Oct 30, 2026Updated last week
- ☆18May 31, 2026Updated 5 months ago
- ☆23Aug 10, 2026Updated 2 months ago
- Web UI for sparkrun — launch and monitor inference workloads on NVIDIA DGX Spark☆29Jun 16, 2026Updated 4 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A self-hosted control plane for a DGX Spark GPU cluster: provision nodes over SSH or a join token, deploy and serve inference behind one …☆13Oct 23, 2026Updated 2 weeks ago
- Some benchmark results of small models and quants that fit on DGX Spark☆51Aug 23, 2026Updated 2 months ago
- A free, open source, mixed-signal circuit simulator that runs entirely in your browser. Rust engine compiled to WebAssembly, Svelte front…☆16Oct 1, 2026Updated last month
- Pinned one-DGX-Spark Docker recipe for DeepSeek V4 Flash with EXL3, SparkInfer, and 262K NVFP4 MLA KV cache☆32Sep 6, 2026Updated 2 months ago
- Monitoring mixin for Envoy and Envoy Gateway. A set of Grafana dashboards and Prometheus rules for Envoy and Envoy Gateway.☆14Apr 21, 2026Updated 6 months ago
- Docker compose configs for serving Qwen3.8-27B on a DGX Spark (GB10): vLLM+MTP current, SGLang+DSPARK + FP8 rollback stacks☆13Oct 27, 2026Updated last week
- My Repo for AI stuff☆12Updated this week
- Calculate clock-skew with a timestamp server to synchronize your web-apps!☆14Feb 26, 2016Updated 10 years ago
- Curated V100 SXM2 pin maps, two- and four-GPU NVLink connection plans, and connector-only KiCad resources toward an open-source carrier b…☆51Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Browser-based model and inference management for NVIDIA DGX Spark - inventory local and Hugging Face models, manage Ollama and LiteLLM, g…☆57Oct 18, 2026Updated 3 weeks ago
- MCP server that delegates Claude Code agent work to local models (llama.cpp / vLLM) on your own hardware☆19Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆16Jul 31, 2026Updated 3 months ago
- Qwen 3.8 Flash NVFP4 with PLE NVFP4 quantized to run on a single DGX Spark☆15Aug 28, 2026Updated 2 months ago
- Fork of llama.cpp Nvida Volta V100 (tensor parallelism 4 x v100 GPU)☆12Updated this week
- 1 spark glm 5.3 flash☆11Sep 7, 2026Updated 2 months ago
- A fork which adds a UI to the original deep-research tool☆11Feb 8, 2025Updated last year
- Local voice assistant using Gemma4☆19Jun 9, 2026Updated 4 months ago
- 4-5x faster Qwen3.5 on ASUS GX10 / DGX Spark — Hybrid INT4+FP8 + MTP via one shell script☆32Apr 16, 2026Updated 6 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Self-hosted Qwen3.8-27B (FP8) inference with vLLM, KServe and Envoy AI Gateway on RTX 6000 PRo or 2× RTX 4080 Super☆18Sep 2, 2026Updated 2 months ago
- An open source multi-function instrument for everyone☆21Oct 16, 2026Updated 3 weeks ago
- WebNN Developer Documentation☆16Oct 28, 2026Updated last week
- Open Source multiaxis CAM software☆12Jul 25, 2026Updated 3 months ago
- Operator-grade GPU monitor for NVIDIA GPUs with native GB10 / DGX Spark coherent UMA support — PSI pressure, clock detection, ConnectX-7 …☆36May 31, 2026Updated 5 months ago
- Apply Fast Fourier Transform on Images, and revert them with filter.图片的快速傅里叶变换以及滤镜☆16Sep 30, 2024Updated 2 years ago
- FlashQLA TileLang GDN kernels ported to NVIDIA Blackwell consumer (GB10 / DGX Spark)☆18Jun 5, 2026Updated 5 months ago
- ☆12Dec 30, 2025Updated 10 months ago
- recipe for running Qwen3.8-Flash-Next on a single DGX Spark (fork)☆50Oct 22, 2026Updated 2 weeks ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Save 50% off GenAI costs in two lines of code☆23Jun 15, 2026Updated 4 months ago
- GLM-5.3-Flash EXL3 2.05 on one DGX Spark — TP1 vLLM, DFlash2 K5, concurrency, 262K context, and published fidelity measurements☆57Sep 22, 2026Updated last month
- Bluetooth Low Energy framework for communicating with Combustion Inc. Predictive Thermometers.☆11Oct 30, 2026Updated last week
- Fast, capable GLM-5.3-Flash FP4-Local on two DGX Sparks: opinionated Atlas serving and reproducible inference research.☆72Updated this week
- ☆21Apr 7, 2026Updated 7 months ago
- Real-time hardware and LLM inference monitoring — GPU, CPU, memory, and vLLM metrics streamed to a dashboard.☆142Oct 17, 2026Updated 3 weeks ago
- Qwen3.8 27B for DGX Spark / RTX 6000 PRO☆100Aug 14, 2026Updated 2 months ago