High-performance single-GPU inference for selected model checkpoints and GPUs.
☆24Oct 13, 2026Updated 3 weeks ago
Alternatives and similar repositories for ninfer
Users that are interested in ninfer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆16Updated this week
- High-performance single-GPU inference for RTX 5090 Mobile.☆21Oct 4, 2026Updated last month
- Qwen3.8-Flash-Next 180B NVFP4 @ 231 tok/s on one RTX PRO 6000 Blackwell (sm120) - sglang patches, launchers, full optimization analysis☆30Aug 31, 2026Updated 2 months ago
- Quasar is an inference engine for Qwen3.6-27B-MTP / Qwen3.8-27B on consumer NVIDIA cards as well as Apple Silicon, in the spirit of antir…☆53Updated this week
- Qwen3.8-27B on a single RTX 4090 (sm_89): Cinference/NInfer port with MTP speculative decoding and K8V4 KV cache☆14Nov 1, 2026Updated last week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Pi extension for Cursor models via OAuth and local gRPC proxy☆14Sep 6, 2026Updated 2 months ago
- The hyperteacher, autoteaching in a metaharness.☆37Updated this week
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆16Oct 24, 2026Updated 2 weeks ago
- Context Window Analyzer CLI - Understand what fills your LLM context window☆14Feb 3, 2026Updated 9 months ago
- Real-world percentile benchmark for LLM inference servers: 1% A/B resolution, offline HTML reports. I am now on X also: https://x.com/bku…☆83Oct 9, 2026Updated last month
- Various LLM Benchmarks☆26Feb 20, 2026Updated 8 months ago
- This Android application is designed to read and display data from Japan’s popular transportation NFC cards, Suica and Pasmo. The app pro…☆16Dec 27, 2024Updated last year
- VecoLuc is a scalable vector search engine that leverages Apache Lucene and the JDK's incubator vector API for high-performance vector op…☆11Aug 22, 2024Updated 2 years ago
- "Functional Java by Example" articles, which you can find on my blog.☆11Nov 30, 2019Updated 6 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Tool-level guards and skill prompts for pi-mono, tuned for small local LLMs. Ports techniques from Itay Inbar's little-coder paper.☆17Oct 28, 2026Updated 2 weeks ago
- ☆43Jul 13, 2026Updated 3 months ago
- Standalone CLI tool to find company CEO names using SearXNG web search and LLM analysis (Gemini, OpenAI, Groq, Ollama).☆14Apr 25, 2025Updated last year
- Personal tuning for the LXQt desktop to make it more beautiful.☆11Oct 30, 2022Updated 4 years ago
- A fork of the Official implementation of AnimateDiff.☆29Aug 8, 2023Updated 3 years ago
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆3,310Updated this week
- Crazy Fast Qwen3.8–27b With a 420k Context on an RTX 5090☆27Sep 29, 2026Updated last month
- RocketLLama. Fork off LLama cpp that newly scales 2-20x now also on big models not fully fitting in vram on even just 2 gpus☆16Updated this week
- Provides AclService and MutableAclService implementations that enable usage of Spring Security ACLs with an Apache Cassandra database.☆11Sep 14, 2014Updated 12 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- llama.cpp fork: custom radix-select top-k kernel + CUDA graphs for prefill for fast prompt processing☆11Aug 16, 2026Updated 2 months ago
- Token-budgeted codebase discovery for agent shells and Pi: cross-language maps, focused navigation, and impact analysis.☆16Nov 2, 2026Updated last week
- Make your Hermes agent an Iron Man JARVIS: voice assistant for Home Assistant Voice PE, self-hosted.☆28Nov 4, 2026Updated last week
- Take back your LG webOS TV: one-click rooting (SlopBro) + persistent telemetry/ACR/voice/ads/update blocking via reversible userspace hoo…☆18Nov 2, 2026Updated last week
- Disciplined AI coding mode. Understand deeply, write minimally, never hallucinate, stay consistent. Based on Ponytail & LLM Wiki.☆16Nov 4, 2026Updated last week
- Validated recipe for serving Qwen3.6-27B on a single RTX 5090 — full OpenAI API, vision, tool calling, MTP spec-decode☆74Apr 29, 2026Updated 6 months ago
- Bounded rolling context and exact history recovery for Pi☆35Oct 31, 2026Updated last week
- Machine Learning framework built from scratch in CPP. Uses tensors for base operations.☆17Oct 19, 2026Updated 3 weeks ago
- ☆11Apr 13, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Patches to the standard Nook libraries☆15May 31, 2013Updated 13 years ago
- Empirical benchmarks and quality evaluations of Qwen3.8-27B with Multi-Token Prediction (MTP) across Splash, MTPLX, MLX, and llama.cpp on…☆21Sep 21, 2026Updated last month
- 🌑 Headless PKM server that turns any note folder into a programmable platform. Works with Obsidian, Logseq, and Zim out of the box. Zero…☆17Mar 24, 2026Updated 7 months ago
- Documentation for the on-premise version of PM2 Enterprise☆14Jan 14, 2026Updated 9 months ago
- NVIDIA Fan Control Service tested on Ubuntu providing more aggressive fan curves for RTX Pro 6000 GPUs☆20Jan 17, 2026Updated 9 months ago
- Claude Code skills for Indian stock market investors and traders — NSE/BSE analysis, F&O strategies, technical charting, fundamental scre…☆58Nov 2, 2026Updated last week
- A Fastify plugin to use authenticated Supabase clients in your API.☆30Updated this week
Are these results useful?