Optimized NINFER runtime and reproducible Qwen3.8-27B true-128K inference for NVIDIA RTX 5080 16GB
☆51Oct 23, 2026Updated 2 weeks ago
Alternatives and similar repositories for ninfer-5080
Users that are interested in ninfer-5080 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆13May 20, 2026Updated 5 months ago
- Toolkit for optimizing or building inference engines tailored to your hardware and desired LLM.☆44Updated this week
- Huggingface but for inference engines.☆14Updated this week
- Self-hosted personal-finance dashboard: Plaid bank sync, categories, budgets and rules, with agent tools that stay read-only unless you a…☆65Updated this week
- Local First AI Operating System with Longterm Memory, MultiAgent Orchestration, Persona Switching and more.☆16Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Reed 一苇 — 一苇以航，轻渡学海。独立 Windows 学习 Agent，支持角色技能、记忆与 Obsidian 笔记库。☆18Oct 24, 2026Updated 2 weeks ago
- This Is Stick Figure Animation Theatre☆12Aug 31, 2012Updated 14 years ago
- Multimodal AI studio powered by Qwen3.6-35B-A3B. End-to-end web app exposing visual reasoning, image captioning, and document understandi…☆29Apr 23, 2026Updated 6 months ago
- One line of NInfer for the Blackwell, Ada Lovelace, Ampere, Turing and Volta NVIDIA GPUs, consolidated from the forks that carry it: GGUF…☆214Updated this week
- A template tool with no dependencies that works like Helm templates or Consul templates.☆17Jul 27, 2026Updated 3 months ago
- Gives access to Webmaster Tools Interface data programmatically which is not provided by the official API☆10May 2, 2013Updated 13 years ago
- LocusTether is a self-hosted replacement for the Omi wearable's normal cloud pipeline. Omi's official app streams your audio to Omi's ser…☆17Sep 1, 2026Updated 2 months ago
- Pi Skill Orchestrator is a Pi extension for people who use a lot of Agent Skills. It keeps Pi's normal skill autocomplete, but it stops t…☆20Sep 18, 2026Updated last month
- Alarm routing engine for security and platform incident response teams.☆13Oct 23, 2019Updated 7 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- NInfer-KVMem-Async☆11Updated this week
- A NPC AI Framework , based on character personalities, can be used for game NPC (extendable for Godot / Unity)☆23Sep 21, 2026Updated last month
- LLM code editor for backend services☆16Oct 19, 2024Updated 2 years ago
- the Awesome Enterprise Low Code Platform for PHP☆11Aug 24, 2026Updated 2 months ago
- A Collaborative Todo List application and MCP server using CRDTs and Multicast☆15Feb 14, 2026Updated 8 months ago
- Local AI tool routing for Sonarr, Radarr, qBittorrent and other self-hosted media apps, with explicit approval for writes.☆12Updated this week
- Durable local inference for Oh My Pi: NInfer + Qwen3.8 27B on one RTX 3090/4090/5090, with restart-resumable OpenAI Responses state.☆48Updated this week
- Local-first AI creative pipeline for persona-based image/video generation. Identity preservation, visual engines, quality scoring, autopi…☆18May 28, 2026Updated 5 months ago
- Qwen3.8-27B INT8 + DFlash2 on a rented CMP 170HX — failure analysis (private GHCR image prevented benchmark)☆17Aug 30, 2026Updated 2 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A lightweight and high-speed ComfyUI custom node for generating image captions using BLIP models. Optimized for both GPU and CPU environm…☆13Jun 14, 2025Updated last year
- A productized RAG app that turns documents and code files into a searchable wiki and AI Q&A workspace.☆14May 11, 2026Updated 6 months ago
- An OCR model for Telugu which beats Tesseract, PaddleOCR and SuryaOCR in Telugu.☆12Oct 12, 2026Updated 3 weeks ago
- Native desktop app for the pi coding agent, written in Rust with GPUI (Zed's UI framework). macOS for now, Linux next.☆19Updated this week
- ☆16Apr 26, 2026Updated 6 months ago
- Flexible and blazing-fast --bare checkout worktree support for the Pi agent harness☆14Oct 29, 2026Updated 2 weeks ago
- Open-source workflow for manju (漫剧) — AI-generated episodic animated shorts.☆19Sep 21, 2026Updated last month
- Visual drag-and-drop WinForms/WPF designer for VS Code (C# and VB.NET)☆17Sep 30, 2026Updated last month
- Create, organize, and manage your prompts all in one place, helping you stay creative and productive.☆18Aug 13, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Agent-native IDE extension for the Pi coding agent — guarded editing, search, LSP, terminals, debugging and observability.☆14Updated this week
- Direct model downloads to your Runod pod with blazing-fast multi-connection support. No more downloading models to your local machine and…☆15Sep 9, 2026Updated 2 months ago
- A tool that can be used to measure the sequential performance of any OpenAI-compatible LLM API☆28Aug 1, 2024Updated 2 years ago
- Windows本地bonsai模型部署启动器☆37Oct 20, 2026Updated 3 weeks ago
- Security-posture-first list of sandboxes for running AI coding agents' code, ranked by isolation, egress control and secrets handling☆28Nov 2, 2026Updated last week
- Find anything on your PC by what's in it: local, private semantic search for Windows. Photos, screenshots, PDFs, documents, recordings an…☆16Oct 25, 2026Updated 2 weeks ago
- ☆11Aug 31, 2026Updated 2 months ago
Are these results useful?