Qwen3.8-27B INT8 + DFlash2 on a rented CMP 170HX — failure analysis (private GHCR image prevented benchmark)
☆17Aug 30, 2026Updated last month
Alternatives and similar repositories for Qwen3.8-27B-CMP-170HX
Users that are interested in Qwen3.8-27B-CMP-170HX are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Community-tested recipes, diagnostics, and benchmarks for CMP 170HX AI workloads☆88Updated this week
- NInfer SM80 port for NVIDIA CMP 170HX☆28Aug 22, 2026Updated 2 months ago
- Linux P2P unlock and performance fixes for NVIDIA CMP 170HX☆39Sep 22, 2026Updated last month
- DeepSeek-V4-Flash-0731 on 4x CMP 170HX (sm_80): 98 tok/s decode, ~5300 tok/s prefill. DSpark speculative decoding under pipeline parallel…☆118Aug 13, 2026Updated 2 months ago
- GLM-5.3-Flash on 4× NVIDIA CMP 170HX with vLLM: up to 482.6 tok/s single-user, up to 943.7 tok/s at 8 users, 262K context, TP4 or PP4, on…☆83Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The original as far as I could find.☆14Feb 10, 2025Updated last year
- A tool to unlobotomize your NVIDIA card!☆782Oct 8, 2026Updated 2 weeks ago
- glm-5.2 on too many 64 / 80 GB A100's☆22Sep 9, 2026Updated last month
- ☆33Jul 25, 2026Updated 2 months ago
- 将简单设定扩写成中国式宏大场景故事、连续分镜与成对图片视频提示词的 Codex Skill☆13Aug 18, 2026Updated 2 months ago
- Active4j-jsp是基于SpingBoot2.0轻量级的java快速开发框架。以Spring Framework为核心容器，Spring MVC为模型视图控制器，Mybatis Plus为数据访问层， Apache Shiro为权限授权层, Redis为分布式缓存，Q…☆15Feb 11, 2026Updated 8 months ago
- A high-performance reverse proxy that translates OpenAI image generation API calls into ComfyUI backend requests. This enables clients to…☆17Nov 20, 2025Updated 11 months ago
- Optimized NINFER runtime and reproducible Qwen3.8-27B true-128K inference for NVIDIA RTX 5080 16GB☆41Oct 14, 2026Updated last week
- Kotai is a fully local, zero-cost voice assistant that combines the power of Kyutai TTS/STT, LiveKit, and local LLMs to create natural co…☆10Jul 14, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆24Oct 13, 2026Updated last week
- One backbone, many specialists. CMF is a self-describing, memory-mappable single-file format and a dependency-free runtime for quantized …☆33Updated this week
- Generates synchronized, readable SRT subtitles from transcribed audio with WhisperX (faster-whisper-large-v3)☆16Jun 23, 2026Updated 3 months ago
- Bonsai-27B x NInfer local deployment project (RTX 5080, ternary quantization)☆49Oct 6, 2026Updated 2 weeks ago
- An optimized FastAPI server for OpenAI's Whisper whisper-large-v3-turbo model using MLX optimization☆14Jun 5, 2025Updated last year
- Updated voice agent with Nemotron 3.5 ASR☆19Jun 4, 2026Updated 4 months ago
- Basic EFI with Opencore for Intel Rocket Lake Processors (11th Gen)☆10Sep 27, 2026Updated 3 weeks ago
- a tiny little log formatter for pino.☆14May 21, 2023Updated 3 years ago
- Unlock tool for the NVIDIA CMP 170HX (GA100) mining card. Restores full A100 compute throughput by exploiting the Falcon BootROM .fwsigna…☆57Jul 30, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- An API client for Tuya☆14Oct 12, 2023Updated 3 years ago
- A simple, fast command-line tool for searching and comparing text documents.☆20Sep 6, 2024Updated 2 years ago
- A cmpunlocker fork with working p2p on SYS-4028GR-TRT2☆26Aug 8, 2026Updated 2 months ago
- ☆21Jan 31, 2025Updated last year
- OpenCore EFI for X79 Mainboard and CPU xeon E5 2650v2 RX470☆20Feb 1, 2021Updated 5 years ago
- Durable local inference for Oh My Pi: NInfer + Qwen3.8 27B on one RTX 3090/4090/5090, with restart-resumable OpenAI Responses state.☆45Updated this week
- The open-source management system built to stay alive, not rot after the audit. AI-first; documents in git, collaboration in PostgreSQL, …☆41Updated this week
- 解锁自有 NVIDIA CMP 170HX / 90HX 的算力限制。Linux x86-64，需要 root。☆57Aug 6, 2026Updated 2 months ago
- Tapo Smart Plug API Client in Go☆15Aug 1, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Give any local LLM a billion-token memory. Open-source, local-first context + memory engine for Ollama and AI agents — runs on your own m…☆47Updated this week
- create a ram disk with node.js☆13Jun 2, 2015Updated 11 years ago
- Realtime speech translation — a desktop simultaneous interpreter for Alibaba Cloud Qwen, OpenAI and Google Gemini☆71Updated this week
- ☆15Nov 12, 2021Updated 4 years ago
- Dogfooding vLLM backport for older GPUs.☆333Updated this week
- Single-request LLM serving recipes, patches, and benchmarks for modified RTX 2080 Ti 22GB / SM75 systems☆93Jun 10, 2026Updated 4 months ago
- Booking model context protocol server☆16Oct 27, 2025Updated 11 months ago