From-scratch C++/CUDA engine for Qwen3.8-27B on one RTX 4090: 3,600 tok/s prefill, 149 tok/s MTP decode, full 262K context. Works with any coding agent over OpenAI and Anthropic APIs, best with Caudra. Per-request LoRA adapters, plus OpenAI Decisions and TypeSafe System One on the same weights.
☆16Oct 22, 2026Updated 2 weeks ago
Alternatives and similar repositories for ninfer-4090
Users that are interested in ninfer-4090 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 开源知识付费平台☆11Jun 6, 2022Updated 4 years ago
- The web version of the Age of Empires 2 Definitive Edition Combat Simulator☆12Sep 13, 2023Updated 3 years ago
- 京东签到领京豆☆17Feb 15, 2022Updated 4 years ago
- Qwen3.8-27B on one RTX 4090: full native 262K context via E8 4-bit KV, up to 149 tok/s code decode with MTP3, sm_89-retuned attention pre…☆228Updated this week
- A Retail store management system - DBMS project (Sep 2015) written in Django (Python)☆11Aug 11, 2020Updated 6 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Deterministic decision-intelligence MCP server for AI agents — 17 tools (bandits/LinUCB, HiGHS LP/MIP, PageRank, Monte Carlo, CMA-ES, con…☆13Oct 21, 2026Updated 2 weeks ago
- ☆16Aug 6, 2021Updated 5 years ago
- 期权天眼 · Options Eye — Deribit 期权 IV 曲面异常扫描器（纯 WebSocket 推送，零轮询）+ 策略建议 + 测试网一键交易 | 打赏支持冰火岛社区 | EVM Wallet: 0x29f091DAA3dfee8100645ee24239bC…☆19Jul 26, 2026Updated 3 months ago
- 中文成语图谱，一个可以用来每天解谜汉兜 https://handle.antfu.me 的中文成语、汉字、读音图谱构建工具。☆27Jun 2, 2022Updated 4 years ago
- https://www.text-mining.ro/ demonstrates how to design & implement a Web Search Engine☆20Sep 13, 2026Updated last month
- ☆12Mar 23, 2026Updated 7 months ago
- Docker deployment of Qwen3.8-27B (NVFP4) on a single RTX 5090: Full native 256K-token context (FP8 KV) + MTP working at 120-170 tokens/s,…☆13Sep 5, 2026Updated 2 months ago
- ☆13Sep 14, 2021Updated 5 years ago
- Tesseract OCR Mac☆35Nov 28, 2017Updated 8 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Structural memory for coding agents — index your repo once, query symbols, callers, and call-edges over MCP.☆17Sep 10, 2026Updated last month
- 2024 南开大学信息检索系统大作业 从零实现一个搜索引擎☆11Dec 18, 2024Updated last year
- XDU-计科网安方向大数据安全与隐私实验三阶梯三-数据差分隐私处理☆13Jun 25, 2022Updated 4 years ago
- A simple node utility that converts an SVG file into an ICO file such as that used for favicon.ico☆26Jun 16, 2026Updated 4 months ago
- Collection of map tiles for SCS Software games.☆10Sep 24, 2024Updated 2 years ago
- ☆16Mar 5, 2026Updated 8 months ago
- 同济大学现代密码学课程设计，包含AES算法，CBC模式，RSA加密解密，RSA签名，基于RSA的证书以及基于RSA和AES算法的文件加密系统。☆15Sep 1, 2022Updated 4 years ago
- Remote control agent for macOS development☆18Sep 20, 2026Updated last month
- [ICLR'26] Official Repository for The Paper: Stop Tracking Me! Proactive Defense Against Attribute Inference Attack in LLMs☆26Apr 6, 2026Updated 7 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- 融合深度学习与人工智能技术，通过将加密流量转化为图像形式并使用神经网络进行特征提取，实现高效的恶 意加密流量检测和细粒度分类。系统具备流量上传、数据分析、异常告警、行为识别等多种功能，支持Pcap 类文件分析， 自动提取Web、邮件、Telnet 等内容，能够精准识别恶意攻…☆21Mar 15, 2025Updated last year
- ☆22Oct 29, 2023Updated 3 years ago
- Swift for TensorFlow / CoreML model generation and training test☆12Jan 24, 2020Updated 6 years ago
- 畅阳在线教育系统(Online Education)，适用于个人、企业或机构搭建自己的在线学习平台。它提供了完整的解决方案，满足网校搭建、在线教学、企业培训和知识付费等多种需求☆27Aug 22, 2024Updated 2 years ago
- Original PyTorch implementation of the AdversarialMask paper☆25Apr 16, 2023Updated 3 years ago
- ☆31May 17, 2024Updated 2 years ago
- API - a simple web search engine☆25Jul 19, 2017Updated 9 years ago
- ☆23May 23, 2025Updated last year
- dotfiles☆12Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Autonomous agent loop for Codex CLI powered by gpt-5.2. Port of burn-in-cceverywhere-ralph with enhancements for Codex.☆12Jan 26, 2026Updated 9 months ago
- Local BTC/ETH options research dashboard with Gamma, Skew, IV term structure and large trade radar | 打赏支持冰火岛社区 | EVM Wallet: 0x29f091DAA3…☆28Jun 14, 2026Updated 4 months ago
- 使用python的pycrypto、m2crypto模块完成AES、RSA加解密文件，实现文件安全传输☆27Aug 31, 2017Updated 9 years ago
- stracker is a service supporting Assetto Corsa servers with automatically generated statistics.☆22Apr 20, 2021Updated 5 years ago
- A telemetry plugin for ATS/ETS2 to use FMOD sound mods (to a limited extent) for example in TruckersMP☆22Sep 22, 2026Updated last month
- 零依赖本地代理，把B站Index-Translate免费翻译API包装成OpenAI兼容接口☆29Oct 21, 2026Updated 2 weeks ago
- 这是一个Steam 游戏价格 监控插件。☆17Jan 3, 2026Updated 10 months ago