aha model inference library, now supports Qwen(2.5VL/3/3VL/3.5/ASR/3Embedding/3Reranker), MiniCPM(4/5), VoxCPM(0.5B/1.5/2), DeepSeek-OCR/2, Hunyuan-OCR, PaddleOCR-VL/1.5/1.6, RMBG2.0, GLM(ASR-Nano-2512/OCR), Fun-ASR-Nano-2512, LFM(2/2.5/2VL/2.5VL)
☆395Jun 7, 2026Updated 4 months ago
Alternatives and similar repositories for aha
Users that are interested in aha are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆34Sep 1, 2025Updated last year
- ☆15Aug 25, 2025Updated last year
- Rust (using burn) implementation of VoxCPM☆23Apr 9, 2026Updated 6 months ago
- Bare-Metal Rust Audio AI Framework☆183Oct 20, 2026Updated 2 weeks ago
- High-quality Chinese Text-to-Speech engine. Rust implementation of Kokoro TTS with ONNX Runtime inference. CLI tool, HTTP API server, Ope…☆19Aug 7, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆21Oct 27, 2026Updated last week
- A high-performance Rust implementation of llama.cpp - LLM inference engine with full GGUF support☆21Apr 7, 2026Updated 6 months ago
- Video creation tool: Video editing (with extensive AI-assisted features), screen recording, streaming, and screen sharing. 视频编辑（大量AI辅助功能…☆66Updated this week
- A Pure Rust based LLM, VLM, VLA, TTS, OCR Inference Engine, powering by Candle & Rust. Alternate to your llama.cpp but much more simpler …☆520Updated this week
- Tool for speech recognition using sensevoice-small☆34Jun 11, 2026Updated 4 months ago
- Standalone C++ inference project for VoxCPM models built on top of ggml.☆97Jul 14, 2026Updated 3 months ago
- 高性能OCR识别库，支持上百种语言，提供命令行、图形界面及C API多种调用方式，使用便捷高效。 High-performance OCR library powered by PaddleOCR v4/v5/v6 with MNN backend. Supports 1…☆346Sep 11, 2026Updated last month
- Fast ML inference & training for ONNX models in Rust☆2,605Updated this week
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆741Oct 18, 2026Updated 2 weeks ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Reusable UI components and widgets built on top of gpui.☆348Updated this week
- Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime.☆345Updated this week
- Minimalist ML framework for Rust☆21,273Updated this week
- statsrust is a high-performance statistical analysis library for Rust developers☆14Sep 30, 2025Updated last year
- Rust bindings to https://github.com/k2-fsa/sherpa-onnx☆313Mar 8, 2026Updated 7 months ago
- FlashFunAsr: A lightweight vLLM implementation built from scratch for FunASR nano☆12Jan 5, 2026Updated 9 months ago
- ☆55Mar 18, 2026Updated 7 months ago
- 阿里云物联网设备端 Rust SDK / Alink 协议☆11Apr 23, 2023Updated 3 years ago
- A native Windows desktop client for OpenCode 2 (Rust + GPUI). GPL-3.0.☆32Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆27Jan 29, 2026Updated 9 months ago
- ☆142Updated this week
- Utilizes ONNX Runtime for TTS model.☆70Oct 11, 2026Updated 3 weeks ago
- Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2☆733Updated this week
- chew through any source into clean datasets! a fast ingestion, RAG & fine-tuning toolkit☆14Aug 18, 2026Updated 2 months ago
- Rust Agent Development Kit (ADK-Rust): Build AI agents in Rust with modular components for models, tools, memory, realtime voice, and mor…☆740Updated this week
- ☆665Updated this week
- deepseek-harness-rs☆22Oct 19, 2026Updated 2 weeks ago
- Use Rust to call Paddle OCR models via ONNX Runtime for image text recognition.☆98Jul 25, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- LLM Connector - A unified interface for connecting to various Large Language Model providers☆20May 7, 2026Updated 5 months ago
- Rust library for generating vector embeddings and reranking locally!☆1,051Oct 26, 2026Updated last week
- An ecosystem framework for Rust. IoC/Context/Config/Web/ORM☆51Aug 15, 2025Updated last year
- A SIP/WebRTC voice agent☆192Updated this week
- GenUI is an innovative SFP front-end framework developed in the Rust language, was originally inspired by Vue3 and Makepad. Intended to h…☆89May 7, 2026Updated 5 months ago
- ☆13Nov 4, 2023Updated 3 years ago
- 用 onnx 和 gguf 格式混合运行 Fun-ASR-Nano 模型全流程☆161May 5, 2026Updated 6 months ago