aha model inference library, now supports Qwen(2.5VL/3/3VL/3.5/ASR/3Embedding/3Reranker), MiniCPM(4/5), VoxCPM(0.5B/1.5/2), DeepSeek-OCR/2, Hunyuan-OCR, PaddleOCR-VL/1.5/1.6, RMBG2.0, GLM(ASR-Nano-2512/OCR), Fun-ASR-Nano-2512, LFM(2/2.5/2VL/2.5VL)
☆392Jun 7, 2026Updated 4 months ago
Alternatives and similar repositories for aha
Users that are interested in aha are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆32Sep 1, 2025Updated last year
- ☆15Aug 25, 2025Updated last year
- Rust (using burn) implementation of VoxCPM☆22Apr 9, 2026Updated 6 months ago
- ☆21May 2, 2026Updated 5 months ago
- Bare-Metal Rust Audio AI Framework☆182Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Pure-Rust inference engine for Qwen3-ASR speech recognition models (0.6B & 1.7B) using candle with Metal/CUDA acceleration☆27Mar 17, 2026Updated 6 months ago
- Tool for speech recognition using sensevoice-small☆34Jun 11, 2026Updated 4 months ago
- A Pure Rust based LLM, VLM, VLA, TTS, OCR Inference Engine, powering by Candle & Rust. Alternate to your llama.cpp but much more simpler …☆502Updated this week
- A high-performance Rust implementation of llama.cpp - LLM inference engine with full GGUF support☆21Apr 7, 2026Updated 6 months ago
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆733Sep 17, 2026Updated 3 weeks ago
- Standalone C++ inference project for VoxCPM models built on top of ggml.☆94Jul 14, 2026Updated 2 months ago
- Fast ML inference & training for ONNX models in Rust☆2,559Updated this week
- Reusable UI components and widgets built on top of gpui.☆349Sep 10, 2026Updated last month
- Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime.☆334Sep 9, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Implementation of Qwen3-ASR-0.6B in GGML☆116Jul 28, 2026Updated 2 months ago
- Rust bindings to https://github.com/k2-fsa/sherpa-onnx☆314Mar 8, 2026Updated 7 months ago
- Rust Agent Development Kit (ADK-Rust): Build AI agents in Rust with modular components for models, tools, memory, realtime voice, and mor…☆702Updated this week
- 高性能OCR识别库，支持上百种语言，提供命令行、图形界面及C API多种调用方式，使用便捷高效。 High-performance OCR library powered by PaddleOCR v4/v5/v6 with MNN backend. Supports 1…☆332Sep 11, 2026Updated last month
- ☆27Jan 29, 2026Updated 8 months ago
- A wrapper around the llama-cpp library for rust, including new Sampler API from llama-cpp.☆51Updated this week
- 阿里云物联网设备端 Rust SDK / Alink 协议☆11Apr 23, 2023Updated 3 years ago
- Cross-platform abstractions for GPU compute☆58Oct 4, 2026Updated last week
- ☆53Mar 18, 2026Updated 6 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2☆719Updated this week
- ☆657Updated this week
- Utilizes ONNX Runtime for TTS model.☆70Updated this week
- GenUI is an innovative SFP front-end framework developed in the Rust language, was originally inspired by Vue3 and Makepad. Intended to h…☆89May 7, 2026Updated 5 months ago
- An ecosystem framework for Rust. IoC/Context/Config/Web/ORM☆51Aug 15, 2025Updated last year
- A Rust library integrated with ONNXRuntime, providing a collection of Computer Vison and Vision-Language models such as YOLO, FastVLM, an…☆444Jul 30, 2026Updated 2 months ago
- 将 Qwen3-ASR 的 LLM 部分导出为 GGUF，用 llama.cpp 进行加速推理。后者支持 Vulkan 和 Cuda 加速。☆239Apr 29, 2026Updated 5 months ago
- ☆33Jul 20, 2026Updated 2 months ago
- ☆34Aug 7, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆13Nov 4, 2023Updated 2 years ago
- Rust library for generating vector embeddings and reranking locally!☆1,036Updated this week
- A Rust library designed to facilitate the conversion of various document formats into markdown text.☆75Apr 22, 2026Updated 5 months ago
- An animation engine implemented in rust, inspired by manim and JAnim☆653Sep 21, 2026Updated 3 weeks ago
- A native Rust toolkit for OCR, document layout analysis, and vision-language document understanding.☆179Updated this week
- 用 onnx 和 gguf 格式混合运行 Fun-ASR-Nano 模型全流程☆161May 5, 2026Updated 5 months ago
- The Rust SDK library supports the call of Hikvision network cameras and MVS industrial cameras☆14Dec 21, 2024Updated last year