Inferno aims to be a super lightweight, highly efficient Rust inference engine for running open weights models on Apple Silicon with Metal, targeting machines such as a MacBook Pro with 64 GB of unified memory.
☆45Oct 4, 2026Updated last month
Alternatives and similar repositories for inferno
Users that are interested in inferno are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Self-hostable MCP server for the Oxylabs Web API☆33Updated this week
- ☆38Aug 19, 2026Updated 2 months ago
- One serving daemon for local LLM inference — across runtimes and machines.☆22Updated this week
- Companion code for the HFT for dummies series: a SOL-USD market maker on Bullet, built up one post at a time☆30Updated this week
- Claude Code skill: turn your last AI coding session into a credibility-checked, quiz-placed reading path☆17Aug 1, 2026Updated 3 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- MCP server for Hono documentation☆11Mar 23, 2026Updated 7 months ago
- Idol: a single image to 3D Gaussians. Inference SDK and demo.☆19Updated this week
- GLM-5.3-Flash EXL3 K2 2.33bpw on ONE DGX Spark: native MTP (layer 45, 288 experts), CUDA graphs on, full 262,144 ctx. Measured ~19 tok/s …☆11Sep 19, 2026Updated last month
- lumen beat gpt-5.6 sol at html/react accessibility repair, with an estimated ~200× lower inference cost.☆24Aug 8, 2026Updated 2 months ago
- A tiny, declarative, agent-friendly library for your Git repositories.☆28Oct 19, 2026Updated 2 weeks ago
- ☆13Feb 15, 2025Updated last year
- The terminal your agent team lives in — run coding agents in panes on a shared bus, on a fast GPU-rendered terminal for macOS and Linux.☆14Updated this week
- ☆15Jan 8, 2025Updated last year
- ☆54Sep 13, 2026Updated last month
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Use PartyKit 🎉 with Nuxt 💚☆12Dec 30, 2024Updated last year
- Ask your friends' local agents questions — every reply approved by its human in Discord. Ephemeral, CLI-first.☆16Jul 21, 2026Updated 3 months ago
- ☆13Updated this week
- The home for Rust's governance documentation, such as team charters.☆14Jan 26, 2022Updated 4 years ago
- Brave Accounts backend☆14Updated this week
- Enhances Kokoro TTS output by merging segments with dynamic, programmable pauses for meditative or narrative flow.☆17Oct 16, 2025Updated last year
- Noir circuit that verifies Openbanking payments☆12Jun 7, 2025Updated last year
- ☆29Oct 31, 2026Updated last week
- Order tables for WooCommerce.☆12Jan 16, 2018Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A better way to handle errors. Both data and errors are declared with const, available at the top level, and non-nullable (once the other…☆11Sep 5, 2024Updated 2 years ago
- MCP server for Paperless-ngx — lets AI agents like Claude search, upload, tag, and organize your documents, with optional local semantic …☆21Updated this week
- Let's vibe hardware: create magical things by chatting with AI.☆48Jul 20, 2026Updated 3 months ago
- Learn cryptography with formal proofs☆12Jul 25, 2026Updated 3 months ago
- Host-assisted low-poly wireframe 3D compiler/runtime for the Commodore 64, with Blender scene/animation/physics support, OBJ/MTL + SVG im…☆12Sep 26, 2026Updated last month
- ☆13Jan 31, 2016Updated 10 years ago
- Experiments with LLMs, RAG and Agents to generate Nuxt code from the CLI.☆10Feb 17, 2025Updated last year
- Can LLMs be provable computers?☆65Apr 15, 2026Updated 6 months ago
- ☆12Apr 1, 2026Updated 7 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Live Kubernetes log analysis, contextual investigation, and agent handoff powered by Jev.☆15Updated this week
- In this repo I implement a stark prover for learning purposes☆14May 22, 2025Updated last year
- Rich text editor with AI text generation using TipTap project.☆11Nov 15, 2023Updated 2 years ago
- An in-app browser pane for DeepSeek Harness — real Chrome over CDP, plus rendered previews of local files, markdown and PDFs.☆15Sep 28, 2026Updated last month
- CSLA .NET public contribution project☆12Sep 8, 2022Updated 4 years ago
- ☆13Updated this week
- Starknet contract storage dumper☆13Aug 22, 2023Updated 3 years ago