vLLM fork with Marlin W4A8 SM121 patches + TMA module
☆15Mar 23, 2026Updated 7 months ago
Alternatives and similar repositories for vllm-marlin-sm12x
Users that are interested in vllm-marlin-sm12x are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A high-throughput and memory-efficient inference and serving engine for LLMs☆13Apr 14, 2026Updated 6 months ago
- FlashQLA TileLang GDN kernels ported to NVIDIA Blackwell consumer (GB10 / DGX Spark)☆18Jun 5, 2026Updated 4 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆16Jul 31, 2026Updated 3 months ago
- ☆21Apr 7, 2026Updated 6 months ago
- Optimized SGLang MoE kernel configs for NVIDIA DGX Spark (GB10) - GLM-4.7-FP8 and other MoE models☆13Feb 7, 2026Updated 8 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A dedicated effort to make an optimized, bleeding edge vLLM image using Docker to support DGX comprehensively☆128Feb 22, 2026Updated 8 months ago
- DGX Spark EC fan speed override / rollback tool☆22Aug 23, 2026Updated 2 months ago
- vLLM Model plugin for the encoder-decoder BART model☆13Oct 23, 2026Updated last week
- Linux hwmon driver for the NVIDIA DGX Spark (GB10 SoC) that exposes full system power telemetry via standard sensors / sysfs interfaces.☆38Mar 2, 2026Updated 8 months ago
- Cross-plataform tool that injects keys with the same hash code in order to test web applications against hash collision attacks.☆16Mar 3, 2013Updated 13 years ago
- Meltdown and spectre explained -- for normal people☆10Sep 12, 2018Updated 8 years ago
- Kubernetes synthetic testing and monitoring framework☆13Jul 21, 2026Updated 3 months ago
- NumPy and SciPy for Mojo and MAX on any Accelerator☆18Oct 22, 2026Updated last week
- ☆75Feb 27, 2026Updated 8 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- The code implementation of HyGRAG, accepted by WWW'26.☆17May 31, 2026Updated 5 months ago
- DGX Spark research and tests - containers, benchmarks, and investigation notes for running models on GB10 (SM 12.1)☆28Updated this week
- GLM-5.3-Flash NVFP4 (lab quant) on 2x DGX Spark — TP=2 over RoCE, one .env, compose head/worker, download/start/stop/status/tail-log☆11Sep 8, 2026Updated last month
- A Comprehensive Benchmark Framework for Retrieval-Augmented Generation (RAG) Routing and Query-Corpus Compatibility.☆14Feb 3, 2026Updated 8 months ago
- Experimental runtime reclamation of GB10 display-reserved memory into ordinary Linux RAM, with guarded driver, local signing, and reboot …☆12Oct 23, 2026Updated last week
- A userspace tunnel between two hosts mapping ports on client machine to addresses reachable from server machine.☆18Feb 25, 2022Updated 4 years ago
- sparkrun - launch, manage, and stop LLM inference workloads on NVIDIA DGX Spark systems. Live support: https://discord.com/invite/GH5kRg…☆554Updated this week
- Fast LLM swapping with sleep/wake support, compatible with vllm, llama.cpp, etc. llama-swap fork.☆57Apr 5, 2026Updated 6 months ago
- Agnost GitOps Helm charts☆13Dec 9, 2025Updated 10 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Android Hooking Framework☆15May 1, 2013Updated 13 years ago
- Security capability evaluation of locally served models. Method, corpus, and per-model results.☆18Oct 19, 2026Updated last week
- iOS app that syncs device's photos to an FTP NAS server☆10Nov 4, 2017Updated 8 years ago
- Distillation pipeline from pretrained Transformers to customized FLA models☆13Aug 4, 2025Updated last year
- Unlock tool for the NVIDIA CMP 170HX (GA100) mining card. Restores full A100 compute throughput by exploiting the Falcon BootROM .fwsigna…☆56Jul 30, 2026Updated 3 months ago
- With an ever-rising number of news articles and opinions, an investment startup aims to leverage artificial intelligence to address the c…☆11Dec 2, 2024Updated last year
- Production-ready, bleeding-edge, upstream-first vLLM Docker image for the NVIDIA DGX Spark (GB10 / sm_121a), verified against real models…☆59Updated this week
- Specification-driven multi-agent systems with OpenTelemetry observability, agent traces, benchmarking, MCP, and A2A.☆49Updated this week
- Open-source MCP server — progressive tool discovery, code execution, intelligent routing & token optimization across 50+ tools☆17Jun 25, 2026Updated 4 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- WIP☆10Apr 11, 2021Updated 5 years ago
- Docker configuration for running VLLM on dual DGX Sparks☆2,465Updated this week
- ☆21Aug 30, 2026Updated 2 months ago
- Doc Thinker: All-in-One RAG - document parsing, graph RAG, and evaluation☆33Oct 21, 2026Updated last week
- ☆25Oct 20, 2026Updated last week
- A parcel plugin for typed-css-modules - generate typescript declaration files for your css modules automatically☆15Sep 4, 2018Updated 8 years ago
- Sends ulogd / netfilter json to elasticsearch backend (logstash replacement for your firewall)☆10Mar 2, 2016Updated 10 years ago