Qwen3.6/3.8-27B on one RTX 5090: 576K pooled context across 12 sessions at FP8-level quality from 5.75 bpw. EXL3 trellis weights, 4-bit trellis-coded KV, MTP spec-decode, paged batching, hand-written SM120 kernels, OpenAI API.
☆30Oct 23, 2026Updated 2 weeks ago
Alternatives and similar repositories for qwentin
Users that are interested in qwentin are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Open-source SM120 (Blackwell) SASS assembler — encode, schedule & assemble GPU machine code, including all tensor-core instructions.☆14Updated this week
- Source-available C++/CUDA inference engine for Qwen3.8-27B INT4 on 3x RTX 3090☆46Updated this week
- Reverse-engineered instruction set architecture database for NVIDIA SM120 (Blackwell) GPUs.☆29Updated this week
- High-speed, multi-threaded APT hunting tool designed for lateral movement detection and forensic artifact discovery in Windows environmen…☆15Feb 8, 2026Updated 9 months ago
- Swiss knife for JDWP exploitation☆17Apr 6, 2026Updated 7 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Self-hosted live telemetry, alerts and benchmarks for NVIDIA DGX Spark (GB10) clusters☆11Updated this week
- Row-wise block scaling for fp8 quantization matrix multiplication. Solution to GPU mode AMD challenge.☆19Feb 9, 2026Updated 9 months ago
- [ICLR 2025] Systematic Outliers in Large Language Models.☆11Feb 11, 2025Updated last year
- ☆11May 7, 2026Updated 6 months ago
- All-NVFP4 vLLM + DFlash2 K7 for Blackwell (SM120/SM121): NVFP4 target/draft/KV, 262K context, optional CPU vision sidecar.☆41Aug 28, 2026Updated 2 months ago
- ☆16Dec 9, 2023Updated 2 years ago
- One-menu RTX 5090 installer for the abliterated Qwen3.8-Flash-Next on fngine: pinned build with isolated CUDA, verified download, serving…☆14Oct 15, 2026Updated 3 weeks ago
- You only ReBoot once - A USB less ISO/IMG etc. bootloader based on ventoy☆17Updated this week
- Browser-native Hermes Agent sessions, tools, approvals, and subagent controls.☆13Sep 24, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆17Sep 25, 2026Updated last month
- Specialized fork for (relatively) fast single-GPU inference (in CUDA) using large MoE models that don't fit fully into VRAM☆17May 6, 2026Updated 6 months ago
- Frontier MoE models on RTX PRO 6000 / RTX 5090 (sm_120): DeepSeek-V4.1-Flash on 4x RTX PRO 6000, as a GPU+CPU hybrid on 4x RTX 5090, and …☆572Updated this week
- Unified Swift MLX inference stack for fast, local, multimodal AI on Apple Silicon.☆22Updated this week
- Production LLM inference on the Apple Neural Engine — a practitioner's guide, complete with converters, Swift runtimes, and validated mod…☆47Jun 7, 2026Updated 5 months ago
- A minimal external-display controller for Apple Vision Pro on custom firmware.☆21Oct 8, 2026Updated last month
- An OpenCode plugin that lets AI agents control Windows desktops directly using the \windows-mcp\ MCP server.☆18Jul 10, 2026Updated 4 months ago
- A terminal of blocks with a coding agent beside you, built on nanoui☆43Oct 25, 2026Updated 2 weeks ago
- ☆17Jun 18, 2026Updated 4 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆14Updated this week
- A tool for tweaking Apple TV apps☆11May 10, 2025Updated last year
- ☆16Aug 11, 2026Updated 3 months ago
- Switch 2 language experiment: all-in-one source, host-tested private draft☆30Updated this week
- 笔记整理 Skill：一个用于 Claude Code 的课程资料、PDF、PPT、题库整理成 Markdown/Obsidian 复习笔记的 Claude Skill。☆17Jun 30, 2026Updated 4 months ago
- Free and Open Source software download manager☆15Mar 30, 2023Updated 3 years ago
- ☆12Oct 25, 2026Updated 2 weeks ago
- PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation☆33Nov 16, 2024Updated last year
- My submission for the GPUMODE/AMD fp8 mm challenge☆29Jun 4, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆28Nov 3, 2026Updated last week
- Hermes Desktop for Windows☆11May 30, 2026Updated 5 months ago
- Use your iPhone as a USB camera for Mac video calls and OBS. Two free apps, no Wi-Fi or cloud. Open source.☆15Oct 25, 2026Updated 2 weeks ago
- The Blueprint design language. Formal spec, grammar, and authoring reference: Brilliant's lossless, versioned text representation of a de…☆19Sep 17, 2026Updated last month
- Fast TorToiSe inference (5x or your money back!)☆13Sep 4, 2023Updated 3 years ago
- The winning Assembly Summer 2015 4k intro by Prismbeings.☆23Jun 29, 2016Updated 10 years ago
- BUNNY RAMDISK BUILDER — A12/A13 SSH ramdisk builder for macOS (universal, native SwiftUI)☆16Aug 27, 2026Updated 2 months ago
Are these results useful?