Qwen3.8-27B on one RTX 4090: full native 262K context via E8 4-bit KV, up to 149 tok/s code decode with MTP3, sm_89-retuned attention prefill, vision, llama.cpp-compatible /metrics + /slots
☆15Sep 29, 2026Updated 3 weeks ago
Alternatives and similar repositories for ninfer-4090-48g
Users that are interested in ninfer-4090-48g are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Qwen3.8-27B on one RTX 4090: full native 262K context via E8 4-bit KV, up to 149 tok/s code decode with MTP3, sm_89-retuned attention pre…☆215Updated this week
- Quasar is an inference engine for Qwen3.6-27B-MTP / Qwen3.8-27B on consumer NVIDIA cards as well as Apple Silicon, in the spirit of antir…☆49Updated this week
- Hermes Android mobile client for self-hosted Hermes Gateway☆47Oct 9, 2026Updated 2 weeks ago
- 跟手搓PPT说拜拜☆18Aug 22, 2026Updated 2 months ago
- wrapper for Hunyuan-PromptEnhancer☆14Oct 10, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- SecureX is an Elixir Library To Handle User Roles and Permissions.☆10Jul 20, 2023Updated 3 years ago
- Windows GUI and CLI for upscaling video with NVIDIA RTX Video Super Resolution (no ComfyUI or PyTorch needed). Resumable segments for lon…☆26Oct 5, 2026Updated 2 weeks ago
- Easy quant comfyUI origin model to gguf , and esay use it, save more disk...☆23Aug 13, 2026Updated 2 months ago
- Standalone mixed-precision checkpoint quantizer for ComfyUI: per-layer W4A4 / W4A8 / INT8 / BF16 selection with hard quality and compress…☆19Aug 11, 2026Updated 2 months ago
- Load a single beam file, apps (a set of beams), or an erlang release (a set of apps) to a node.☆14Dec 19, 2020Updated 5 years ago
- Qwen and DeepSeek low-VRAM LoRA training with GGUF base model, compatible with Transformers and PEFT☆22Updated this week
- The mechanical CAD generation agent capable for recording and learning your own design skill and product features, it can grow like your …☆46Updated this week
- One line of NInfer for the Blackwell, Ada Lovelace, Ampere, Turing and Volta NVIDIA GPUs, consolidated from the forks that carry it: GGUF…☆153Updated this week
- Speed by Simplicity: A Single-Stream Architecture for Fast Audio-Video Generative Foundation Model☆28Apr 1, 2026Updated 6 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Utility scripts to quantize models in optimal ComfyUI formata.☆32Aug 21, 2026Updated 2 months ago
- An open JSON format and local toolchain for carrying an AI assisted project's working state between agents, tools and model providers.☆17Oct 16, 2026Updated last week
- One-stop on-device diffusion image-generation engine for iOS / macOS / visionOS. Embeds stable-diffusion.cpp + ggml-metal behind a tight …☆21Updated this week
- A ComfyUI custom node of MIDI-3D : Multi-Instance Diffusion for Single Image to 3D Scene Generation.☆16Nov 26, 2025Updated 10 months ago
- Xiaozhi-Chat. V1☆13Sep 12, 2025Updated last year
- Encrypted credential vault for DeepSeek Harness — AES-256-GCM + TOTP, model tools + Settings UI☆12Oct 16, 2026Updated last week
- SDNQ support for ComfyUI☆20Jan 6, 2026Updated 9 months ago
- Your Zero-Code AI File Expert☆16Feb 27, 2026Updated 7 months ago
- One Editor, Many Edits: A Unified Training-free Framework for Diverse Video Editing☆27Sep 9, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- MCP server for Software Defined Radio — control RTL-SDR & HackRF from Claude/LLM. ADS-B aircraft tracking, AIS ship tracking, POCSAG page…☆30Jul 21, 2026Updated 3 months ago
- ☆23Nov 4, 2025Updated 11 months ago
- Cross-platform desktop traffic light widget for monitoring AI coding assistants (Claude Code, Codex).☆42Jul 12, 2026Updated 3 months ago
- Run DeepSeek-V4.1-Flash / DeepSeek-V4-Flash and GLM-5.3-Flash on SM89 (Ada / RTX 4090) and SM120 (RTX PRO 6000) with vLLM☆196Updated this week
- ☆19May 25, 2024Updated 2 years ago
- DeepSeek Harness community plugin registry with evidence-based screening☆21Sep 11, 2026Updated last month
- Find the best AI models you can run☆38Updated this week
- A playground for experimenting with acoustic echo cancellation using a microphone, speaker, and ONNX.☆13Oct 22, 2024Updated 2 years ago
- Fast as Hamster | Stable Hamster | Stable Diffusion☆14Aug 26, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Aliyun OSS(阿里云对象存储) SDK for Elixir☆15Sep 7, 2026Updated last month
- 应用日志上报阿里云日志服务快速集成spring boot starter☆26Dec 16, 2023Updated 2 years ago
- A Windows share target for bringing WeChat chat archives to ChatGPT.☆43Sep 26, 2026Updated 3 weeks ago
- Unofficial ComfyUI implementation of UniWorld.☆22Jun 10, 2025Updated last year
- ☆29Sep 29, 2026Updated 3 weeks ago
- DEPRECATED. Install ComfyUI-UtilsCollection instead from https://github.com/silveroxides/ComfyUI-UtilsCollection☆21Jun 19, 2026Updated 4 months ago
- This repository is the official implementation of FLUX-CustomID. It is capable of generating images based on your face image at a level e…☆25Nov 13, 2024Updated last year