This is a repository for documenting the setup and performance of MI100s in popular inference engines.
☆20Oct 8, 2026Updated last month
Alternatives and similar repositories for mi100-llm-testing
Users that are interested in mi100-llm-testing are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A fast Django .count() implementation for large tables☆13Aug 14, 2025Updated last year
- GLM-5.2 on 4x DGX Spark with adaptive MTP K2/K4/K5, FULL CUDA graphs, DCP2, 520K context, and a downloadable ARM64 runtime image.☆13Aug 8, 2026Updated 3 months ago
- A conta de Twitter @PROJdeLEI avisará, em tempo real, quando novos Projetos de Lei são criados por deputados ou senadores.☆11Jul 5, 2022Updated 4 years ago
- Monochromatic theme for iTerm2☆11Sep 25, 2023Updated 3 years ago
- MCP server for Vikunja task management☆17Oct 2, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- WMMA GEMM in ROCm for RDNA GPUs☆20Sep 1, 2026Updated 2 months ago
- Prebuilt ONNX Runtime 1.24.4 with CUDA EP for aarch64 Linux + NVIDIA Blackwell (sm_121)☆12Apr 10, 2026Updated 7 months ago
- Agnost GitOps Helm charts☆13Dec 9, 2025Updated 11 months ago
- DeepSeek V4.1 Flash on 4x DGX Spark: 438 tok/s at 16 users, ~80/138 single-user, 1M context. Fork of blaesus/dsgx10.☆28Updated this week
- Plugin em PHP para integração com o Novo Gateway de Pagamento☆15Aug 23, 2012Updated 14 years ago
- AI Assistant Plugin for Obsidian☆15Aug 27, 2024Updated 2 years ago
- Stop the maintenance☆11Feb 28, 2022Updated 4 years ago
- [ICML 2026] NanoQuant: Efficient Sub-1-Bit Quantization of Large Language Models☆28Jul 3, 2026Updated 4 months ago
- Distillation pipeline from pretrained Transformers to customized FLA models☆13Aug 4, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- GLM-5.3-Flash NVFP4 (lab quant) on 2x DGX Spark — TP=2 over RoCE, one .env, compose head/worker, download/start/stop/status/tail-log☆11Sep 8, 2026Updated 2 months ago
- Run frontier open-weight models privately on NVIDIA DGX Spark.☆15Oct 26, 2026Updated 2 weeks ago
- DGX Spark / GB10 vLLM Docker stack for large-model serving, presets, patches, and validation notes.☆12Jun 29, 2026Updated 4 months ago
- DeepSeek-V4-Flash-0731 tuned on 4x DGX Spark (GB10) at TP=4 — 123.13 tok/s decode. Every variable measured one at a time, with the values…☆13Aug 11, 2026Updated 3 months ago
- FlashAttention-style custom attention backend for vLLM on AMD MI50/MI60/Radeon VII (gfx906). Downstream fork of mixa3607/ML-gfx906 with r…☆19Apr 22, 2026Updated 6 months ago
- Linear-scaling compute & memory spline manifold for regression and interpolation☆20Oct 24, 2026Updated 2 weeks ago
- Tuning and qualification harness for the NVIDIA CMP 170HX (GA100). Measures, gates and recovers clock/voltage settings, and treats a comp…☆97Sep 28, 2026Updated last month
- Tries to UI development. Clone of https://www.perplexity.ai/☆11Sep 30, 2023Updated 3 years ago
- Scripts to setup a two-node llama.cpp cluster on NVIDIA DGX Spark (GB10) hardware.☆12May 10, 2026Updated 6 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆27Jul 13, 2026Updated 3 months ago
- ☆28Feb 16, 2026Updated 8 months ago
- INT8-native vLLM fork☆28Updated this week
- BertholomusAI recipe: DeepSeek-V4.1-Flash-1017 on 2x NVIDIA DGX Spark (GB10), our own TensorFold TP2 engine. Weights: bertholomus EXL3 2.…☆69Nov 4, 2026Updated last week
- ☆14Sep 4, 2024Updated 2 years ago
- ☆18Jan 3, 2026Updated 10 months ago
- Prepackaged medical pronunciation dictionary for voice AI TTS engines. 960+ drug names, clinical terms, anatomical terms, and medical acr…☆42Sep 23, 2026Updated last month
- Convert EML/.MAI to mbox. Forked from Broobles.☆22Oct 20, 2017Updated 9 years ago
- Hermes ↔ Grok Bot bridge: SSH relay and native API (:8642) methods☆28Sep 16, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- I thought it would be nice to get an email alert when a new job posting appears on a website, so I can use this to check for the newest j…☆17Nov 22, 2022Updated 3 years ago
- Create OS packages from Python projects using Docker containers☆22Feb 26, 2023Updated 3 years ago
- Unified KV-cache compression for LLM inference: 12 Python-native methods, guarded add-on composition and routing, analytical capacity sim…☆30Oct 10, 2026Updated last month
- This is a fork of SGLang for hip-attention integration. Please refer to hip-attention for detail.☆18Mar 31, 2026Updated 7 months ago
- Working recipe: MiniMax-M3 NVFP4 at tensor-parallel 3 across 3x DGX Spark (GB10/sm_121) with clean tool-calling. Includes the head-node O…☆16Jul 13, 2026Updated 3 months ago
- A pattern editor, in the "style" of a Tracker, for the Korg Electribe 2's (synth, sampler, hacktribe).☆31Apr 27, 2022Updated 4 years ago
- Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and in…☆18Nov 11, 2024Updated 2 years ago
Are these results useful?