aha model inference library, now supports Qwen(2.5VL/3/3VL/3.5/ASR/3Embedding/3Reranker), MiniCPM(4/5), VoxCPM(0.5B/1.5/2), DeepSeek-OCR/2, Hunyuan-OCR, PaddleOCR-VL/1.5/1.6, RMBG2.0, GLM(ASR-Nano-2512/OCR), Fun-ASR-Nano-2512, LFM(2/2.5/2VL/2.5VL)
☆381Jun 7, 2026Updated last month
Alternatives and similar repositories for aha
Users that are interested in aha are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆31Sep 1, 2025Updated 10 months ago
- ☆15Aug 25, 2025Updated 11 months ago
- ☆20May 2, 2026Updated 2 months ago
- Bare-Metal Rust Audio AI Framework☆174Jun 13, 2026Updated last month
- Pure-Rust inference engine for Qwen3-ASR speech recognition models (0.6B & 1.7B) using candle with Metal/CUDA acceleration☆25Mar 17, 2026Updated 4 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Tool for speech recognition using sensevoice-small☆32Jun 11, 2026Updated last month
- A Pure Rust based LLM, VLM, VLA, TTS, OCR Inference Engine, powering by Candle & Rust. Alternate to your llama.cpp but much more simpler …☆427Updated this week
- A high-performance Rust implementation of llama.cpp - LLM inference engine with full GGUF support☆20Apr 7, 2026Updated 3 months ago
- Standalone C++ inference project for VoxCPM models built on top of ggml.☆86Jul 14, 2026Updated last week
- Fast ML inference & training for ONNX models in Rust☆2,417Updated this week
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆701Updated this week
- Reusable UI components and widgets built on top of gpui.☆340Jul 16, 2026Updated last week
- Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime.☆293Updated this week
- Implementation of Qwen3-ASR-0.6B in GGML☆101Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Video creation tool: Video editing (with extensive AI-assisted features), screen recording, streaming, and screen sharing. 视频编辑（大量AI辅助功能…☆21Updated this week
- Rust bindings to https://github.com/k2-fsa/sherpa-onnx☆311Mar 8, 2026Updated 4 months ago
- Rust Agent Development Kit (ADK-Rust): Build AI agents in Rust with modular components for models, tools, memory, realtime voice, and mor…☆564Updated this week
- 高性能OCR识别库，支持上百种语言，提供命令行、图形界面及C API多种调用方式，使用便捷高效。 High-performance OCR library powered by PaddleOCR v4/v5/v6 with MNN backend. Supports 1…☆291Updated this week
- ☆25Jan 29, 2026Updated 5 months ago
- 阿里云物联网设备端 Rust SDK / Alink 协议☆11Apr 23, 2023Updated 3 years ago
- Cross-platform abstractions for GPU compute☆47Jul 4, 2026Updated 2 weeks ago
- ☆49Mar 18, 2026Updated 4 months ago
- ☆617Updated this week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Utilizes ONNX Runtime for TTS model.☆65Jul 13, 2026Updated last week
- GenUI is an innovative SFP front-end framework developed in the Rust language, was originally inspired by Vue3 and Makepad. Intended to h…☆90May 7, 2026Updated 2 months ago
- An ecosystem framework for Rust. IoC/Context/Config/Web/ORM☆51Aug 15, 2025Updated 11 months ago
- 将 Qwen3-ASR 的 LLM 部分导出为 GGUF，用 llama.cpp 进行加速推理。后者支持 Vulkan 和 Cuda 加速。☆196Apr 29, 2026Updated 2 months ago
- A Rust library integrated with ONNXRuntime, providing a collection of Computer Vison and Vision-Language models such as YOLO, FastVLM, an…☆432Updated this week
- Build a Web Application Template for the Generalized Rust Axum Library☆31Jun 19, 2026Updated last month
- ☆25Updated this week
- Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2☆577Updated this week
- ☆34Aug 7, 2025Updated 11 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆13Nov 4, 2023Updated 2 years ago
- Rust library for generating vector embeddings, reranking locally!☆973Jul 15, 2026Updated last week
- A Rust library designed to facilitate the conversion of various document formats into markdown text.☆69Apr 22, 2026Updated 3 months ago
- An animation engine implemented in rust, inspired by manim and JAnim☆624Updated this week
- An educational Rust project for exporting and running inference on Qwen3 LLM family☆44Aug 3, 2025Updated 11 months ago
- A native Rust toolkit for OCR, document layout analysis, and vision-language document understanding.☆133Updated this week
- Compile Time Async Dynamic SQL ORM☆2,479Updated this week