Inferno aims to be a super lightweight, highly efficient Rust inference engine for running open weights models on Apple Silicon with Metal, targeting machines such as a MacBook Pro with 64 GB of unified memory.
☆44Aug 8, 2026Updated 3 weeks ago
Alternatives and similar repositories for inferno
Users that are interested in inferno are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Software Template for Openshift AI☆15Jul 8, 2026Updated last month
- Introduction to Red Hat OpenShift AI (RHOAI)☆14Apr 11, 2024Updated 2 years ago
- NuxtJS module for Nhost☆10Jan 26, 2022Updated 4 years ago
- Notebooks showing off LangChain.js v0.1.0 features.☆20Jan 8, 2024Updated 2 years ago
- A lab/workshop for Red Hat OpenShift Data Science using simple fraud detection as an example workload☆21Jul 18, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Kolu is an identification friend or foe (IFF) system for drones - European Defense Tech Hackathon 2025 LDN☆14Sep 28, 2025Updated 11 months ago
- Lightweight coding agent that runs in your terminal☆20Jun 23, 2026Updated 2 months ago
- A minimal implementation of ZKPs of Ethereum block execution using Reth. Supports both Ethereum and OP Stack.☆13Jul 2, 2025Updated last year
- A better way to handle errors. Both data and errors are declared with const, available at the top level, and non-nullable (once the other…☆11Sep 5, 2024Updated last year
- ☆12Jan 2, 2024Updated 2 years ago
- ☆27Updated this week
- ☆15Oct 19, 2024Updated last year
- A set of tools to use Ring Signatures everywhere☆22Mar 30, 2025Updated last year
- ☆56Dec 16, 2025Updated 8 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Simple end-to-end encryption for webapps☆16Jan 20, 2025Updated last year
- Bindings for o1js to lower layers of the proof system and the Mina transaction logic☆13Apr 25, 2025Updated last year
- Storybook for Agents☆22Jul 18, 2026Updated last month
- Train Embedding Models on MLX.☆17Jun 2, 2026Updated 2 months ago
- Identicon implementation in Rust☆11Aug 7, 2023Updated 3 years ago
- V1 of our repository to store historical, timestamped DKIM keys; and for anyone to upload their own. Basically https://archive.org for pu…☆19Jun 22, 2026Updated 2 months ago
- CLI reporting usage stats and cost estimates for Cloudflare compute and storage.☆16Mar 2, 2026Updated 5 months ago
- Bridge between Coz profiler and rust tracing☆14Sep 26, 2019Updated 6 years ago
- Implementing Bendersnatch curve using Arkwork's framework in Rust.☆14Oct 28, 2021Updated 4 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Example Cloudflare Worker for Facebook-based authorization and GraphQL proxy queries with Hasura☆17Nov 21, 2018Updated 7 years ago
- A Starknet toolkit☆15Mar 6, 2025Updated last year
- Love your errors☆14Oct 6, 2021Updated 4 years ago
- A modern Rust debugging library 🦀☆10May 15, 2022Updated 4 years ago
- ☆16May 31, 2025Updated last year
- ☆18May 27, 2025Updated last year
- Run tsc on files with tsconfig respected☆16Feb 14, 2025Updated last year
- A simple unit testing framework for Scheme that is slightly more featureful then my previous attempts to handroll a testing framework.☆10Feb 14, 2023Updated 3 years ago
- An attribution library for LLMs☆45Sep 17, 2024Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆20May 15, 2026Updated 3 months ago
- Handling Google Authenitcator codes.☆14May 1, 2021Updated 5 years ago
- zk-SNARK WASM circuit compiler☆15Jun 2, 2025Updated last year
- ☆13Jul 27, 2022Updated 4 years ago
- Descriptor is a spec-style test structuring library for rust☆11Jun 19, 2016Updated 10 years ago
- Learn what's changed on crates.io☆19Aug 11, 2026Updated 2 weeks ago
- ☆19Apr 3, 2024Updated 2 years ago