ninfer-ext: Forked for speed.
☆26Oct 22, 2026Updated 2 weeks ago
Alternatives and similar repositories for ninfer-ext
Users that are interested in ninfer-ext are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Toolkit for optimizing or building inference engines tailored to your hardware and desired LLM.☆44Updated this week
- Huggingface but for inference engines.☆14Oct 31, 2026Updated last week
- The fastest inference engine for Qwen3.8-27B on the NVIDIA RTX 5090: up to 500 tokens/s for one agent and up to 2,000 tokens/s for many, …☆74Nov 4, 2026Updated last week
- Crazy Fast Qwen3.8–27b With a 420k Context on an RTX 5090☆27Sep 29, 2026Updated last month
- Merge multiple ePUBs into one volume, or split volumes produced by epub-merge☆15Sep 27, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- C++/CUDA single-GPU inference engine for Qwen3.8 (incl. Qwen3.8-Flash-Next with offloaded experts) on the RTX 5090; grew from NInfer☆286Updated this week
- A multi-interface (REST and MCP) server for automatic license plate recognition 🚗☆26Nov 2, 2026Updated last week
- A minimal and extensible agent server for building agent applications☆29Nov 4, 2026Updated last week
- Running encarta 95 on the web!☆26Oct 24, 2026Updated 2 weeks ago
- Sandbox-Here is a convenience script around bubblewrap to sandbox agents and similar semi-trusted processes☆12Nov 4, 2026Updated last week
- Fully local governed RAG for code, documents, and tables.☆42Sep 26, 2026Updated last month
- Exercise files for the book titled Functional Programming in PHP☆10Jun 11, 2022Updated 4 years ago
- Glyph3D but for the webbies☆13Nov 2, 2026Updated last week
- Connect AI agents to 1,400+ APIs across search, social, SEO, finance, and more. Automatic tool discovery, unified billing, zero subscript…☆13Oct 27, 2026Updated 2 weeks ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Event Engine Docs☆13Jan 2, 2022Updated 4 years ago
- ValueObjects toolkit, for making your own value objects quickly and easily☆10Nov 10, 2017Updated 9 years ago
- Agentic browser automation built from small, reusable pieces.☆13Oct 29, 2026Updated last week
- Markdown-based persistent memory for OpenCode. Store facts, identity, and daily logs with auto context injection.☆15Mar 4, 2026Updated 8 months ago
- 1.3B world model running at 16 FPS on an RTX 5090☆18Oct 29, 2026Updated last week
- A clean, fast, and beautiful tool to help you discover the perfect camera prompts for your AI image generation — no more guessing the rig…☆15Dec 4, 2025Updated 11 months ago
- DeepSeekCode☆14Oct 24, 2026Updated 2 weeks ago
- A collections package for various use cases (supports strict typing)☆17Jan 23, 2026Updated 9 months ago
- Build data-centric Hydra APIs☆13Apr 22, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Free MIDI Pattern Generator VST3 for Electronic Music Producers☆38Updated this week
- Local-first, LLM-agnostic memory system — hybrid retrieval (vector + lexical + graph), multi-signal ranking. Runs on 4GB RAM, CPU-only, n…☆18Oct 8, 2026Updated last month
- Epic is a framework designed to keep your domain model implementation fully focused on the enterprise business that your application targ…☆14Apr 19, 2013Updated 13 years ago
- 1.08M cannabis club members, 985K ID scans, no authentication required — CCS Nube / PuffPal disclosure☆22Jun 29, 2026Updated 4 months ago
- Local-first, LLM-guided, coverage-driven fuzzer for network protocols and binary formats. Single Rust binary. Zero signup.☆15Jul 14, 2026Updated 3 months ago
- Idol: a single image to 3D Gaussians. Inference SDK and demo.☆19Updated this week
- A custom fork for frontier-scale mixture-of-experts inference on an RTX 3060 with 12 GB VRAM, 16 GB system RAM and local NVMe.** Betelge…☆125Updated this week
- ☆18Aug 6, 2026Updated 3 months ago
- Deploy Nginx Ingress on an EKS cluster using Terraform & Helm.☆14Feb 11, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Audio Reactive Music GLSL Shader render program.☆12Apr 24, 2026Updated 6 months ago
- HDLBoard - Write VHDL/Verilog and watch it run on a virtual board☆14Updated this week
- Desktop UI for the NInfer local LLM inference engine☆33Nov 2, 2026Updated last week
- Rich development workflow with Clojure support, using AstroNvim 4 and selected plugins☆12Jan 21, 2026Updated 9 months ago
- ☆19Oct 18, 2025Updated last year
- Vite utility for vue3 server side rendering☆10Jul 21, 2026Updated 3 months ago
- A fullstack app to show the images within a local folder in a vertical list.☆15Dec 17, 2024Updated last year
Are these results useful?