Local LLM inference engine written from scratch in Rust — hand-written AVX-512 assembly kernels, Metal & Vulkan compute shaders. Supports Qwen3, Mistral3, ... Q4/INT8/BF16 quantization.
☆34Mar 18, 2026Updated 4 months ago
Alternatives and similar repositories for herbert-rs
Users that are interested in herbert-rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🐼 Born of panda. Awakened as Anda. A copilot for your computer, powered by the Anda Brain.☆23Updated this week
- Mapping intelligence for enterprise data migrations: schema mapping, lineage, and transformation traceability that compounds across every…☆15May 7, 2026Updated 3 months ago
- The most advanced, lightweight, and undetectable C++ open-source utility client base for Minecraft. Built with ImGui and modular architec…☆25Mar 21, 2026Updated 4 months ago
- 🧠 A native graph-based memory system for autonomous AI agents, featuring bio-inspired sleep-based memory consolidation and powered by KI…☆71Updated this week
- Spanda is a high-performance animation engine in Rust for web (WASM), native apps, games, and TUIs. It features easing curves, spring phy…☆16May 7, 2026Updated 3 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Detect-Then-Explain Framework for Text-to-SQL task☆10Dec 6, 2023Updated 2 years ago
- ☆73Updated this week
- Repository for DNN training, theory to practice, part of the Large Scale Machine Learning class at Mines Paritech☆11Mar 11, 2022Updated 4 years ago
- Learning High-Quality and General-Purpose Phrase Representations. Findings of EACL 2024☆16Feb 29, 2024Updated 2 years ago
- PhysPatch performs physical memory scanning and patching of the entire Windows Kernel using DMA☆13Nov 10, 2024Updated last year
- A minimal hackable implementation of policy gradient methods (GRPO, PPO, REINFORCE)☆17Feb 20, 2026Updated 5 months ago
- Rust library for conversion to/from proquints☆13Feb 9, 2018Updated 8 years ago
- Meet Rustacean GPT, an experimental project transforming OpenAi's GPT into a helpful, autonomous software engineer to support senior deve…☆14May 10, 2023Updated 3 years ago
- A safe, performant Rust crate for determining the number of columns required to display an arbitrary string.☆24Jan 19, 2026Updated 6 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- This course is designed to provide a clear, intuitive, and practical introduction to the core mathematical concepts and pricing technique…☆49May 1, 2026Updated 3 months ago
- Enhancing Legal Case Retrieval via Scaling High-quality Synthetic Query-Candidate Pairs (EMNLP 2024)☆17Nov 17, 2024Updated last year
- 🐾 Complete REST API for ClawHub skills marketplace data☆15Apr 6, 2026Updated 4 months ago
- ☆17Apr 18, 2024Updated 2 years ago
- Stateless LLM runtime that dynamically routes, loads, executes, and unloads models per request with bounded VRAM caching and intelligent …☆41Apr 12, 2026Updated 3 months ago
- UnrealIRCD with Anope Services☆16Jun 3, 2018Updated 8 years ago
- A Multilingual Keyboard Layout-Based Typo Generator☆17Nov 23, 2025Updated 8 months ago
- A collection of papers and resources about knowledge graph enhanced large language models (KGLLM)☆14Jun 21, 2023Updated 3 years ago
- Automatically create and delete "hanging" OneToOne model instances☆16Jan 13, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A Rust rewrite of FastKMeans for CPU-based clustering☆17Jun 29, 2026Updated last month
- Sandboxed code execution for LLMs, powered by Nix☆16Jul 23, 2026Updated 2 weeks ago
- Lightweight social media monitoring tool built with Rust☆16Jun 10, 2026Updated 2 months ago
- The world's first AI-native systems programming language. Zero keywords, pattern matching, UFC. Following Cursed Lang (first AI esoteric …☆15Jun 3, 2026Updated 2 months ago
- A kubernetes multi type authentication provider using webhook token auth☆17Jun 3, 2023Updated 3 years ago
- Backup btrfs snapshots made by snapper / timeshift to external storage☆11Apr 26, 2025Updated last year
- A tool to archive Stack Exchange sites posts for offline browsing.☆12Nov 9, 2018Updated 7 years ago
- Seed-Coder is a family of lightweight open-source code LLMs comprising base, instruct and reasoning models, developed by ByteDance Seed.☆15Jun 6, 2025Updated last year
- a lightning-fast, crash-proof search engine aggregator built in Rust. Focused on memory efficiency, safe character slicing, and high-per…☆14Jun 3, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- The ultimate desktop GUI app combining the convenience of Croc with the high speeds and resilience (across the network changes) features …☆13Updated this week
- A lightweight, secure AI agent harness for your entire development lifecycle, fully written in Rust☆15Mar 3, 2026Updated 5 months ago
- Decision orchestration and reconciliation for AI changes.☆44Mar 30, 2026Updated 4 months ago
- A sandboxed bash interpreter for AI Agents, built in Rust☆23Apr 5, 2026Updated 4 months ago
- Odoo addon for draw.io, aka diagram.net☆18Jul 18, 2025Updated last year
- A workload orchestration platform designed to replace Kubernetes and Nomad for developers that demand simplicity, security, and efficienc…☆14Aug 2, 2026Updated last week
- EdgeCrab 🦀 A Super Powerful Personal Assistant inspired by NousHermes and OpenClaw — Rust-native, blazing-fast terminal UI, ReAct tool l…☆80Jul 24, 2026Updated 2 weeks ago