vitoplantamura / OnnxStreamLinks
Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK.
☆1,975Updated this week
Alternatives and similar repositories for OnnxStream
Users that are interested in OnnxStream are comparing it to the libraries listed below
Sorting:
- Llama 2 Everywhere (L2E)☆1,523Updated last week
- Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)☆568Updated 2 years ago
- ☆1,277Updated last year
- This repository contains a pure C++ ONNX implementation of multiple offline AI models, such as StableDiffusion (1.5 and XL), ControlNet, …☆622Updated 3 months ago
- Stable Diffusion and Flux in pure C/C++☆4,354Updated this week
- ☆1,029Updated last year
- C++ implementation for BLOOM☆809Updated 2 years ago
- Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.☆3,681Updated last year
- Suno AI's Bark model in C/C++ for fast text-to-speech generation☆836Updated 9 months ago
- Fast stable diffusion on CPU and AI PC☆1,774Updated this week
- CLIP inference in plain C/C++ with no extra dependencies☆517Updated 2 months ago
- An extensible, easy-to-use, and portable diffusion web UI 👨🎨☆1,675Updated 2 years ago
- INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model☆1,540Updated 5 months ago
- Fork of Facebooks LLaMa model to run on CPU☆772Updated 2 years ago
- MiniLLM is a minimal system for running modern LLMs on consumer-grade GPUs☆922Updated 2 years ago
- BentoDiffusion: A collection of diffusion models served with BentoML☆374Updated 4 months ago
- Simple UI for LLM Model Finetuning☆2,065Updated last year
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆2,896Updated last year
- A diffusion model to colorize black and white images☆779Updated 2 years ago
- A "large" language model running on a microcontroller☆533Updated last year
- Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.☆2,351Updated last week
- Explore large language models in 512MB of RAM☆1,196Updated last month
- A fast inference library for running LLMs locally on modern consumer-class GPUs☆4,290Updated 2 weeks ago
- A simple "Be My Eyes" web app with a llama.cpp/llava backend☆491Updated last year
- Instruct-tune LLaMA on consumer hardware☆362Updated 2 years ago
- How to run Stable Diffusion on Raspberry Pi 4☆92Updated 2 years ago
- Raspberry Pi Voice Assistant☆798Updated 8 months ago
- ☆1,542Updated last year
- ggml implementation of BERT☆492Updated last year
- Finetune llama2-70b and codellama on MacBook Air without quantization☆448Updated last year