High-performance single-GPU inference for selected model checkpoints and GPUs.
☆24Oct 13, 2026Updated last week
Alternatives and similar repositories for ninfer
Users that are interested in ninfer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Docker images for LLM inference (SGLang + vLLM) on NVIDIA Blackwell GPUs (SM120, CUDA 13.2)☆91Updated this week
- This Android application is designed to read and display data from Japan’s popular transportation NFC cards, Suica and Pasmo. The app pro…☆15Dec 27, 2024Updated last year
- ☆21Aug 17, 2026Updated 2 months ago
- ☆31Aug 26, 2026Updated last month
- An independent Android client for Hermes Agent servers☆17Oct 13, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆72Sep 14, 2026Updated last month
- Besok3d is an app store and package manager for Klipper 3D printers. Install plugins, adapters, and features with one tap. No terminal, n…☆46Updated this week
- Caching experts made model agnostic for llama. Drastically speeds up generation speed on MoE models that fully fit in the RAM but partial…☆29Aug 6, 2026Updated 2 months ago
- Build AI teams that work alongside yours -- accessible from your phone.☆19Jun 20, 2026Updated 4 months ago
- Zero-dependency Web Bluetooth driver + reverse-engineered protocol docs to print Niimbot label printers straight from the browser — no ap…☆37Oct 7, 2026Updated last week
- Kotai is a fully local, zero-cost voice assistant that combines the power of Kyutai TTS/STT, LiveKit, and local LLMs to create natural co…☆10Jul 14, 2025Updated last year
- How to Transcribe and Search Audio and Video Files☆19Mar 14, 2016Updated 10 years ago
- ☆27Apr 30, 2026Updated 5 months ago
- Open source, enterprise-ready AI skills for Splunk use cases, built for secure discovery, consistent execution, and production-grade cust…☆61Sep 11, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- VecoLuc is a scalable vector search engine that leverages Apache Lucene and the JDK's incubator vector API for high-performance vector op…☆11Aug 22, 2024Updated 2 years ago
- PCG like for godot☆75Oct 8, 2026Updated last week
- "Functional Java by Example" articles, which you can find on my blog.☆11Nov 30, 2019Updated 6 years ago
- One backbone, many specialists. CMF is a self-describing, memory-mappable single-file format and a dependency-free runtime for quantized …☆33Updated this week
- A2UI React Native Renderer - Render Google's A2UI declarative UI specification in React Native☆30Jan 5, 2026Updated 9 months ago
- A Polly policy to collapse concurrent duplicate requests to a single execution.☆19Jul 21, 2025Updated last year
- the official MCP server for cal.com☆30May 22, 2025Updated last year
- Pi coding agent extension for focused code retrieval, grounded edits, safety checks, and language-server support.☆28Sep 23, 2026Updated 3 weeks ago
- Personal pi agent setup☆16Mar 16, 2026Updated 7 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆43Jul 13, 2026Updated 3 months ago
- The open-source management system built to stay alive, not rot after the audit. AI-first; documents in git, collaboration in PostgreSQL, …☆40Updated this week
- Validated recipe for serving Qwen3.6-27B on a single RTX 5090 — full OpenAI API, vision, tool calling, MTP spec-decode☆74Apr 29, 2026Updated 5 months ago
- Testing collaborative agents coordinated by a strict orchestrator. Includes role separation, retry logic, and standardized output generat…☆14Feb 23, 2026Updated 7 months ago
- Qwen3.8-Flash-Next 180B NVFP4 @ 231 tok/s on one RTX PRO 6000 Blackwell (sm120) - sglang patches, launchers, full optimization analysis☆30Aug 31, 2026Updated last month
- A local commit gate: runs the linters your repo configures, and sends changed code to an LLM for review☆13Updated this week
- WeaponSwingTimer addon for classic, modified by me to fix bugs and add features. Most of the credit goes to LeftHandedGlove for the major…☆14Sep 26, 2026Updated 3 weeks ago
- Kingroon KP5L Marlin Firmware☆14Sep 9, 2024Updated 2 years ago
- Free local guardrail for AI coding agents: every tool_call judged on-device (regex + Laya), allow/review/block☆31Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A Fastify plugin to use authenticated Supabase clients in your API.☆31Updated this week
- router firmwares, reverse engineering code snippets, mitm tools☆14Mar 20, 2020Updated 6 years ago
- A Rust harness for generating graded chain-of-thought reasoning traces as model fine-tuning data.☆36Oct 2, 2026Updated 2 weeks ago
- Machine Learning framework built from scratch in CPP. Uses tensors for base operations.☆17May 23, 2026Updated 4 months ago
- High performance, distributed unique thread-safe id generator for Azure.☆20Jul 17, 2026Updated 3 months ago
- A .NET client for Websockets without SignalR☆19Mar 23, 2020Updated 6 years ago
- WoW-TBC Hunter rotation tools and visualization☆15Mar 29, 2022Updated 4 years ago