gabrielmbmb / candle-holderLinks
A Rust crate offering similar functionality to the Python transformers package using Candle.
☆13Updated 7 months ago
Alternatives and similar repositories for candle-holder
Users that are interested in candle-holder are comparing it to the libraries listed below
Sorting:
- Automatically derive Python dunder methods for your Rust code☆19Updated 2 months ago
- Low rank adaptation (LoRA) for Candle.☆150Updated 2 months ago
- CLI utility to inspect and explore .safetensors and .gguf files☆20Updated 2 weeks ago
- Rust implementation of Huggingface transformers pipelines using onnxruntime backend with bindings to C# and C.☆39Updated 2 years ago
- Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package☆209Updated last week
- Cookbook to build Rust Candle models☆79Updated last year
- Your one stop CLI for ONNX model analysis.☆47Updated 2 years ago
- Rust crate for some audio utilities☆24Updated 3 months ago
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆75Updated last year
- implement llava using candle☆15Updated last year
- oclean is a bio inspired solution to help clean up the ocean☆9Updated 2 years ago
- A collection of optimisers for use with candle☆36Updated last month
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- ☆130Updated last year
- Inference engine for GLiNER models, in Rust☆60Updated last week
- ☆11Updated 5 months ago
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆137Updated last month
- ☆155Updated 2 years ago
- 🛠️ Tools for Transformers compression using PyTorch Lightning ⚡☆83Updated 7 months ago
- Transformers provides a simple, intuitive interface for Rust developers who want to work with Large Language Models locally, powered by t…☆16Updated this week
- ☆30Updated 7 months ago
- ☆26Updated 6 months ago
- Command Line Interface for Hugging Face Inference Endpoints☆66Updated last year
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆380Updated this week
- High-performance MinHash implementation in Rust with Python bindings for efficient similarity estimation and deduplication of large datas…☆179Updated last week
- Modular Rust transformer/LLM library using Candle☆36Updated last year
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆33Updated last month
- Rust library for whisper.cpp compatible Mel spectrograms☆70Updated last month
- A client library in Rust for Nvidia Triton.☆30Updated last year
- Minimal implementation of a Byte Pair Encoding (BPE) tokenizer in Zig☆12Updated 2 months ago