pixelspark / polyLinks
A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust
β79Updated last year
Alternatives and similar repositories for poly
Users that are interested in poly are comparing it to the libraries listed below
Sorting:
- Low rank adaptation (LoRA) for Candle.β168Updated 7 months ago
- Inference Llama 2 in one file of pure Rust π¦β235Updated 2 years ago
- OpenAI compatible API for serving LLAMA-2 modelβ218Updated 2 years ago
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Faceβ46Updated last year
- Rust implementation of Suryaβ63Updated 9 months ago
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.β47Updated 10 months ago
- High-level, optionally asynchronous Rust bindings to llama.cppβ239Updated last year
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candleβ77Updated last year
- LLM Orchestrator built in Rustβ284Updated last year
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibesβ240Updated 4 months ago
- A Fish Speech implementation in Rust, with Candle.rsβ106Updated 6 months ago
- A collection of optimisers for use with candleβ44Updated last week
- Approx nearest neighbor search in Rustβ165Updated 2 years ago
- LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!β110Updated 2 years ago
- auto-rust is an experimental project that automatically generate Rust code with LLM (Large Language Models) during compilation, utilizingβ¦β45Updated last year
- Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python packageβ244Updated this week
- An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Wasβ¦β138Updated last year
- Rust port of sentence-transformers (https://github.com/UKPLab/sentence-transformers)β122Updated last year
- An extension library to Candle that provides PyTorch functions not currently available in Candleβ40Updated last year
- Example of tch-rs on M1β55Updated last year
- Library for doing RAGβ79Updated this week
- Extract core logic from qdrant and make it available as a library.β61Updated last year
- Llama2 LLM ported to Rust burnβ278Updated last year
- Unofficial Rust bindings to Apple's mlx frameworkβ216Updated last week
- A Rust implementation of OpenAI's Whisper model using the burn frameworkβ335Updated last year
- Rust client for txtaiβ113Updated 3 weeks ago
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.β64Updated last year
- A simplified example in Rust of training a neural network and then using it based on the Candle Framework by Hugging Face.β39Updated 2 years ago
- Stable Diffusion v1.4 ported to Rust's burn frameworkβ343Updated last year
- Blazingly fast inference of diffusion models.β116Updated 8 months ago