Local LLM inference engine written from scratch in Rust — hand-written AVX-512 assembly kernels, Metal & Vulkan compute shaders. Supports Qwen3, Mistral3, ... Q4/INT8/BF16 quantization.
☆44Nov 1, 2026Updated this week
Alternatives and similar repositories for herbert-rs
Users that are interested in herbert-rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Curated list of open-weight AI models with commercially exploitable licenses, verified benchmarks, and no EU restrictions.☆92Updated this week
- Tools for formatting large language model prompts.☆13Dec 19, 2023Updated 2 years ago
- Gnome extension to enable volume boost☆11May 5, 2026Updated 5 months ago
- ☆16Sep 26, 2026Updated last month
- ☆10Mar 5, 2024Updated 2 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Experience seamless inventory management in Minecraft with Inventive Inventory, your one-stop solution for sorting, auto-refilling, profi…☆14Oct 1, 2026Updated last month
- Deploy autonomous AI agents as your digital twins across 10 social platforms☆17Jul 17, 2026Updated 3 months ago
- Repository for DNN training, theory to practice, part of the Large Scale Machine Learning class at Mines Paritech☆11Mar 11, 2022Updated 4 years ago
- Learning High-Quality and General-Purpose Phrase Representations. Findings of EACL 2024☆17Feb 29, 2024Updated 2 years ago
- Minimal deployable endpoint with SAM3 via OpenAI-like API, works on CPU/GPU☆12Jan 17, 2026Updated 9 months ago
- ☆15May 3, 2025Updated last year
- This repository contains the metadata and data of different databases that we use for testing☆14Jan 29, 2025Updated last year
- A Rust rewrite of FastKMeans for CPU-based clustering☆17Jun 29, 2026Updated 4 months ago
- React SSR (Server Side Rendering) integration for Ruby on Rails and Webpacker☆15Jan 27, 2022Updated 4 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- [Interspeech 2026] Official Implementation of "ALARM: Audio–Language Alignment for Reasoning Models"☆16Jun 10, 2026Updated 4 months ago
- Complex Systems 530 - Computer Modeling of Complex Systems (Winter 2016)☆15Apr 15, 2016Updated 10 years ago
- TextGraphs + LLMs + graph ML for entity extraction, linking, ranking, and constructing a lemma graph☆25Feb 24, 2024Updated 2 years ago
- Deploy Qwen3.6-35B-A3B (Unsloth Dynamic Q4_K_XL) on a single GCP L4 24GB GPU with llama.cpp, Open WebUI, and nginx☆17Apr 16, 2026Updated 6 months ago
- Python object index for fast, declarative retrieval☆18Jul 21, 2024Updated 2 years ago
- ☆18Jun 11, 2023Updated 3 years ago
- GLiNER2 Rust support☆21Aug 29, 2026Updated 2 months ago
- Rust library for reading ext2/ext3/ext4 filesystems☆22Oct 26, 2026Updated last week
- ☆15Jul 10, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 🔭 interactively explore `onnx` networks in your CLI.☆27Jun 7, 2024Updated 2 years ago
- an interactive buntdb shell client☆12May 19, 2023Updated 3 years ago
- [ACL'26 Findings] Recovered in Translation: Efficient Pipeline for Automated Translation of Benchmarks and Datasets☆20Jun 27, 2026Updated 4 months ago
- Learning SIMD with Rust☆18Oct 8, 2026Updated 3 weeks ago
- Various implementation of byte matrix multiplication☆26Jan 10, 2025Updated last year
- Highly concurrent and fast content processing for Mighty Inference Server☆10Feb 6, 2023Updated 3 years ago
- ☆10Apr 14, 2026Updated 6 months ago
- Empowering everyone to create reliable and safety AI coding agent.☆12Sep 2, 2024Updated 2 years ago
- OpenAI compatible API for open source LLMs☆16Oct 30, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- clustering algorithm implementation☆13Oct 19, 2026Updated 2 weeks ago
- AI-powered terminal assistant for LaTeX academic papers — verifies, fixes, and polishes your paper for conference submission with reviewa…☆19Feb 14, 2026Updated 8 months ago
- ☆11Dec 21, 2019Updated 6 years ago
- A Structured Output Benchmark whose 'ground-truth' is actually right☆26Jul 24, 2026Updated 3 months ago
- inline output for the ivy array language☆13Apr 6, 2022Updated 4 years ago
- An overview talk on good (not necessarily best) practices for research software engineering☆21Jan 15, 2024Updated 2 years ago
- Repo for dataurl.app☆10Dec 8, 2020Updated 5 years ago