Durable local inference for Oh My Pi: NInfer + Qwen3.8 27B on one RTX 3090/4090/5090, with restart-resumable OpenAI Responses state.
☆48Nov 5, 2026Updated this week
Alternatives and similar repositories for omp-ninfer
Users that are interested in omp-ninfer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Qwen3.8-27B EXL3 + DFlash2 speculative decoding on an AMD RX 7900 XTX (exllamav3-rocm): recipe, patches, benchmarks☆21Updated this week
- NInfer port for Qwen 3.8 27B on RTX 4090☆184Sep 9, 2026Updated last month
- Operational Ontology public reference: principles, D+L+A, governance, and write-back for stateful AI operations. No production implementa…☆15Aug 6, 2026Updated 3 months ago
- Comfy ui for LLMs using ollama as a backend☆10Jul 15, 2024Updated 2 years ago
- Collection of tips for using textgen in various ways☆20Aug 30, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Optimized NINFER runtime and reproducible Qwen3.8-27B true-128K inference for NVIDIA RTX 5080 16GB☆49Oct 23, 2026Updated 2 weeks ago
- A task based orchestration TUI for oh-my-pi agent harness enabling highly parallel agentic development.☆26Feb 21, 2026Updated 8 months ago
- DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvature☆10May 31, 2023Updated 3 years ago
- Coding agent where a 0.8B decision model works alongside Qwen 3.8-27B: Jeff takes the routine steps itself and decides when Qwen should t…☆32Oct 7, 2026Updated last month
- 🐑 Make Claude Code source actually runnable — debug, explore, and hack it your way☆12Jun 4, 2026Updated 5 months ago
- Distributed LLM inference fabric for heterogeneous local clusters. Features zero-copy SPSC ring buffers, automated tuning, and an OpenAI-…☆84Updated this week
- ☆29Jun 8, 2026Updated 4 months ago
- Updated voice agent with Nemotron 3.5 ASR☆19Jun 4, 2026Updated 5 months ago
- 告别“红框”报错，一键修复 ComfyUI 模型路径验证☆13Oct 22, 2026Updated 2 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆11Aug 31, 2026Updated 2 months ago
- Hyper optimised Qwen3.8-27B inference on one RTX 3090: ReplaySSM, MTP3, reasoning effort, C1-C8 batching, and native Windows and Linux bu…☆502Oct 31, 2026Updated last week
- Native Swift macOS app for screen capture, annotation, redaction, and recording.☆20Sep 5, 2026Updated 2 months ago
- Open source primitives for agent context management☆18Dec 20, 2025Updated 10 months ago
- Common library for Eppo's JavaScript SDK☆12Oct 21, 2026Updated 2 weeks ago
- HDLBoard - Write VHDL/Verilog and watch it run on a virtual board☆12Updated this week
- Set or toggle multiple monitor's input sources via DDC/CI☆13Mar 1, 2019Updated 7 years ago
- Crusader 1+2 Modern☆20Oct 18, 2026Updated 2 weeks ago
- Pure-Rust MoE inference engine for Qwen3.5/3.6/3.8 GGUF. CPU+GPU hybrid experts, NVRTC CUDA kernels, OpenAI-compatible server. 2x llama.c…☆131Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Booking model context protocol server☆16Oct 27, 2025Updated last year
- TR069 based Auto Configuration Server (ACS) using CWMP☆17Feb 21, 2016Updated 10 years ago
- Various resources for working with Hitachi/LG DVD-ROM drives☆18Jul 6, 2025Updated last year
- DeepSeek Harness community plugin registry with evidence-based screening☆21Sep 11, 2026Updated last month
- Host-assisted low-poly wireframe 3D compiler/runtime for the Commodore 64, with Blender scene/animation/physics support, OBJ/MTL + SVG im…☆12Sep 26, 2026Updated last month
- Memory Ring v3.4.0 — Sovereign Identity Architecture☆14Aug 7, 2026Updated 3 months ago
- Aikeya is an open-source alternative to Grok Companion. This is a platform where you can have a virtual AI waifu that learns and grows wi…☆24Feb 14, 2026Updated 8 months ago
- Robin LLM is a Java-based service that crawls OpenRouter's website for free LLM models, continuously tests their performance, and provide…☆24May 17, 2026Updated 5 months ago
- On-device voice isolation, wake words, voice activity and voiceprints. In the browser (WebAssembly), Python, Android and iOS, with plugin…☆72Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- QEMU machine model and bare-metal emulator for Realtek RTD2841 / RTK284x SoCs (TCL RT41 chassis, tv030)☆13Updated this week
- A very low level language for microcontrollers, between assembler and C☆21Oct 31, 2026Updated last week
- Official plugin & skill development kit for DeepSeek Harness (DSH). Grounded in core runtime contracts for Claude Code, Codex, Antigravit…☆24Oct 24, 2026Updated 2 weeks ago
- Z80 CPU / SHARP PC-G815 Emulator on the Web☆13Sep 25, 2026Updated last month
- Based on the second development of the original project Text to Handwriting, more options were added and Chineseized（将你输入的文本转为手写体，以应对各种手写…☆11May 27, 2025Updated last year
- ☆13Oct 2, 2026Updated last month
- Strata for a PC with two NVIDIA GPUs and 32 GB of RAM: the low-RAM mode on a layer split, both cards working at the same time. 143 tok/s …☆84Oct 6, 2026Updated last month