Apsu / flueLinks
Fast, Lightweight, Unified Engine for Text2Image Diffusion Models
☆20Updated 5 months ago
Alternatives and similar repositories for flue
Users that are interested in flue are comparing it to the libraries listed below
Sorting:
- Transformers provides a simple, intuitive interface for Rust developers who want to work with Large Language Models locally, powered by t…☆18Updated 2 months ago
- Low rank adaptation (LoRA) for Candle.☆162Updated 5 months ago
- ☆33Updated 10 months ago
- Blazingly fast inference of diffusion models.☆115Updated 6 months ago
- A collection of optimisers for use with candle☆40Updated last month
- Rust Workspace Bootstrapper☆18Updated last week
- Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package☆226Updated 3 months ago
- Experimental compiler for deep learning models☆67Updated 2 weeks ago
- ☆20Updated 11 months ago
- Unofficial Rust bindings to Apple's mlx framework☆192Updated this week
- Sampling techniques for Candle.☆18Updated last year
- High-level, optionally asynchronous Rust bindings to llama.cpp☆229Updated last year
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆235Updated last month
- A Fish Speech implementation in Rust, with Candle.rs☆98Updated 3 months ago
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle☆75Updated last year
- Rust standalone inference of Namo-500M series models. Extremly tiny, runing VLM on CPU.☆24Updated 6 months ago
- LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!☆109Updated 2 years ago
- Democratizing large model inference and training on any device.☆151Updated 3 weeks ago
- Run Generative AI models directly on your hardware☆36Updated last year
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆39Updated last year
- ☆133Updated last year
- Fast serverless LLM inference, in Rust.☆93Updated 7 months ago
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆39Updated last year
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆473Updated last week
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆79Updated last year
- Tutorial for Porting PyTorch Transformer Models to Candle (Rust)☆319Updated last year
- Graph model execution API for Candle☆16Updated 2 months ago
- A lightweight, high-performance text embedding model implemented in Rust.☆69Updated 4 months ago
- LLM Orchestrator built in Rust☆284Updated last year
- A powerful Rust library and CLI tool to unify and orchestrate multiple LLM, Agent and voice backends (OpenAI, Claude, Gemini, Ollama, Ele…☆225Updated 3 weeks ago