Qwen3.8-27B-GSQ3 on one RTX 4080: 100k context with rk4v4-e8, up to 2720 tok/s prefill and 262 tok/s generation
☆33Oct 9, 2026Updated last month
Alternatives and similar repositories for ninfer-4080
Users that are interested in ninfer-4080 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Qwen3.8-27B on a single RTX 4090 (sm_89): Cinference/NInfer port with MTP speculative decoding and K8V4 KV cache☆14Nov 1, 2026Updated last week
- Pre-driver FMLA32 Tensor Core unlocker and PTX benchmark console for GeForce RTX 40-series, RTX 30-series and RTX 20-series on Windows 10…☆23Updated this week
- One line of NInfer for the Blackwell, Ada Lovelace, Ampere, Turing and Volta NVIDIA GPUs, consolidated from the forks that carry it: GGUF…☆215Updated this week
- Thinking blocks that open during generation: a gate decides when to think, a tree of candidate thoughts is explored, and the best one sta…☆18Oct 11, 2026Updated last month
- Boring dark and light dashboard themes for Hermes Agent☆12May 14, 2026Updated 5 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A standalone, modular prompt generator for ComfyUI. Generate detailed, natural language prompts for characters and spaceships with extens…☆14Aug 3, 2026Updated 3 months ago
- Listens to Discord crypto pump-and-dump channels, buys the altcoin once announced and sells it immediately before the spike reaches its p…☆11May 10, 2025Updated last year
- Scripts to force Davinci Resolve to reload the latest version of media files☆14Jan 5, 2025Updated last year
- Hindsight Memory for Open WebUI☆21May 27, 2026Updated 5 months ago
- Esolang with real-world inspiration☆11Aug 18, 2020Updated 6 years ago
- Pump and dump trading bots for Binance and Kucoin☆15Nov 4, 2022Updated 4 years ago
- ☆17Dec 1, 2024Updated last year
- A PowerShell script to fully automate the setup of `llama.cpp` on Windows. It installs all prerequisites, including the correct CUDA Tool…☆25Oct 30, 2026Updated last week
- Normalized Attention Guidance for ComfyUI Krea2.☆31Aug 11, 2026Updated 3 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Code Execution MCP Server for Binary Ninja☆13Sep 22, 2026Updated last month
- Flash Attention v2 for Pascal (P100, GTX 1080) and Volta (V100) GPUs — bringing O(N) memory attention to hardware the official flash-attn…☆30Nov 3, 2026Updated last week
- Scripts to build openrisc toolchain and bootable filesystem☆12Sep 15, 2014Updated 12 years ago
- ☆11Aug 31, 2026Updated 2 months ago
- CamelForth in C for RP2040 Raspberry Pi Pico. A Forth by Dr Brad Rodriguez - ported to RP2040 by wa1tnr - Forth interpreter is on the RP2…☆12Oct 27, 2021Updated 5 years ago
- Local-first, LLM-guided, coverage-driven fuzzer for network protocols and binary formats. Single Rust binary. Zero signup.☆15Jul 14, 2026Updated 3 months ago
- A MOS SID 6581 / 8580 SID-file music audio visualizer for the browser.☆10May 7, 2023Updated 3 years ago
- Audio Reactive Music GLSL Shader render program.☆12Apr 24, 2026Updated 6 months ago
- A Frontend application in php for interacting with crypto bots and its own exchanges scrapper and incomes analitycs.☆32Jan 19, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A TPU you can watch run - real SystemVerilog systolic array, compiled to WASM, visualized live in your browser.☆18Updated this week
- Crypto Technical Analysis Telegram BOT , RSI , ROC , Volume, MFI, CCI, SMA10 , SMA20, SMA50, SMA100, P-SAR , MOM, BBands , MACD , Stoch ,…☆30Oct 12, 2022Updated 4 years ago
- HDLBoard - Write VHDL/Verilog and watch it run on a virtual board☆15Updated this week
- A wrapper for dasm and @bbcmicrobot☆10Mar 14, 2020Updated 6 years ago
- Simple distribute job scheduler for multiple servers with only SSH. No additions.☆10Dec 8, 2022Updated 3 years ago
- Chrome Extention to Recover streamed PDFs from web tabs☆14Jul 24, 2026Updated 3 months ago
- Collection of words to help with writing high level applications with Forth language.☆12Jun 27, 2021Updated 5 years ago
- ☆43Apr 26, 2026Updated 6 months ago
- Simulator of digirule 2A (https://bradsprojects.com/digirule2/) written in Python (by roro & wawa)☆12Jul 15, 2020Updated 6 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- An FT8 message logger that tracks, translates, and organizes CQs, QSOs, and Misc. messages from live WSJT-X packets.☆15Aug 17, 2025Updated last year
- ☆45Oct 9, 2025Updated last year
- Simple library to interface with Hitachi-compatible character LCDs for the Sipeed Tang Nano 4K Gowin FPGA board.☆10Aug 13, 2022Updated 4 years ago
- Reference FPGA designs for interfacing with the internal ARM Cortex M3 MCU of the GW1NSR-4C, modified for use with boards like the Tang N…☆12Aug 13, 2022Updated 4 years ago
- ☆48Updated this week
- Commodore VIC20 core for the Tang Nano 9K FPGA with LCD Output☆12Feb 16, 2025Updated last year
- Donkey, often known by its file name DONKEY.BAS, is a computer game written in 1981 by Microsoft co-founder Bill Gates and Neil Konzen. T…☆15Aug 13, 2026Updated 2 months ago
Are these results useful?