High-performance single-GPU inference for RTX 5090 Mobile.
☆21Oct 4, 2026Updated last month
Alternatives and similar repositories for ninfer-rtx5090-mobile
Users that are interested in ninfer-rtx5090-mobile are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆16Sep 26, 2026Updated last month
- LLM inference in C/C++☆15Oct 30, 2026Updated 2 weeks ago
- Simple setup to self-host LLaMA3-70B model with an OpenAI API☆19Apr 24, 2024Updated 2 years ago
- A minimal Astro 7 blog theme in ink and washi paper, with dual light/dark palettes, zero client JavaScript on article pages, and a WebGL …☆16Aug 29, 2026Updated 2 months ago
- ☆12Jun 1, 2026Updated 5 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Fronius Symo Hybrid battery charging/discharging limits setting with Modbus TCP☆11Apr 1, 2021Updated 5 years ago
- Experimental implementation of DeepSeek v4 flaash in llama.cpp☆23Apr 30, 2026Updated 6 months ago
- C++/CUDA single-GPU inference engine for Qwen3.8 (incl. Qwen3.8-Flash-Next with offloaded experts) on the RTX 5090; grew from NInfer☆300Updated this week
- Protocol for Augmented Memory of Project Artifacts (MCP compatible) - extended☆23Jan 24, 2026Updated 9 months ago
- Implementation of BitNet-1.58 instruct tuning☆33Apr 14, 2024Updated 2 years ago
- ☆17Jun 10, 2026Updated 5 months ago
- A small, local-first AI chat workspace for any OpenAI-compatible model. Cache-efficient conversations, MCP tools, web search and persiste…☆40Updated this week
- An ultra-lightweight Agent kernel that makes integrating AI into your projects a breeze☆15Jun 22, 2026Updated 4 months ago
- ☆17Apr 15, 2026Updated 7 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 轻量、常驻、可贴边停靠的 Windows 便签与待办工具☆21Aug 24, 2026Updated 2 months ago
- One line of NInfer for the Blackwell, Ada Lovelace, Ampere, Turing and Volta NVIDIA GPUs, consolidated from the forks that carry it: GGUF…☆225Updated this week
- LLM inference in C/C++☆34Jan 27, 2026Updated 9 months ago
- 基于宝塔Linux面板的shadowsocks可视化管理插件☆20Apr 20, 2021Updated 5 years ago
- hadoop shell commands auto-complete script for Bash Completion☆11Dec 16, 2014Updated 11 years ago
- 在 8 GB 显存的显卡上跑 35B MoE(Cyber-Tiel-Coder-35B-A3B):专家权重流式上卡、未命中专家由 CPU 池就地计算。Strata 引擎的 fork(MIT)。RTX 4080S 实测 8 GB 档 57.7–63.5 tok/s、全常驻 1…☆28Oct 10, 2026Updated last month
- awesome keychains☆11Oct 27, 2014Updated 12 years ago
- Fast, accurate voice typing for Linux — IBus input method engine with streaming STT, Whisper refinement, and CUDA acceleration☆14May 1, 2026Updated 6 months ago
- Automatically exported from code.google.com/p/lawker☆12Mar 14, 2015Updated 11 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Awesome with LuaJIT-2.0.0 support.☆10Sep 7, 2011Updated 15 years ago
- ☆17Jun 12, 2025Updated last year
- Bonsai-27B x NInfer local deployment project (RTX 5080, ternary quantization)☆51Oct 6, 2026Updated last month
- A deep neural network package for R☆10Apr 11, 2016Updated 10 years ago
- Simple postgres schema builder for Node.JS leveraging Typescript's type system to enable typesafe queries☆14Mar 3, 2023Updated 3 years ago
- Retro TUI & CLI Developer Portfolio Template powered by Astro 7& Tailwind CSS v4.☆39Updated this week
- NInfer on Tesla V100 (sm_70): Qwen3.8-27B deployment, build/convert scripts, systemd service, and cross-engine benchmark (vs llama.cpp). …☆56Sep 15, 2026Updated 2 months ago
- Resources and documentation to get started with the SweetHome3D.online service☆12Apr 6, 2022Updated 4 years ago
- Everything you need to start building a scalable web application.☆14Nov 10, 2026Updated last week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆10Jan 8, 2023Updated 3 years ago
- Amadeus (AI assistant from Steins;Gate 0) for DeepSeek Harness☆49Nov 4, 2026Updated last week
- ☆18Jul 1, 2025Updated last year
- ☆15Nov 20, 2017Updated 8 years ago
- A low-latency GPU inference runtime for streaming GPT-SoVITS☆48Oct 21, 2026Updated 3 weeks ago
- Run rsync in parallel giving a large boost for long distance or slow networks☆11Jun 4, 2025Updated last year
- RCO: Optimization of Non-Decomposable Objectives under Exact Budget Constraints for LLM Quantization and Pruning☆78Jun 13, 2026Updated 5 months ago
Are these results useful?