gabrielmbmb / candle-holder
A Rust crate offering similar functionality to the Python transformers package using Candle.
☆13Updated 5 months ago
Alternatives and similar repositories for candle-holder:
Users that are interested in candle-holder are comparing it to the libraries listed below
- Automatically derive Python dunder methods for your Rust code☆17Updated 2 weeks ago
- Low rank adaptation (LoRA) for Candle.☆143Updated last week
- Cookbook to build Rust Candle models☆79Updated last year
- Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package☆198Updated 2 months ago
- Rust crate for some audio utilities☆22Updated last month
- A collection of optimisers for use with candle☆34Updated 5 months ago
- Rust implementation of Huggingface transformers pipelines using onnxruntime backend with bindings to C# and C.☆38Updated 2 years ago
- An example of using Torch rust bindings to serve trained machine learning models via Actix Web☆14Updated 3 years ago
- Rust library for whisper.cpp compatible Mel spectrograms☆66Updated this week
- Rust-tokenizer offers high-performance tokenizers for modern language models, including WordPiece, Byte-Pair Encoding (BPE) and Unigram (…☆309Updated last year
- Demos using Rust Candle☆75Updated 3 months ago
- Using short models to classify long texts☆21Updated 2 years ago
- Sampling techniques for Candle.☆15Updated last year
- oclean is a bio inspired solution to help clean up the ocean☆9Updated last year
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆131Updated 4 months ago
- ☆11Updated 2 months ago
- implement llava using candle☆14Updated 10 months ago
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆39Updated last year
- ☆137Updated last year
- ☆155Updated 2 years ago
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆75Updated last year
- Proof of concept for running moshi/hibiki using webrtc☆18Updated 2 months ago
- ☆28Updated 5 months ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆34Updated 4 months ago
- Inference engine for GLiNER models, in Rust☆45Updated 3 weeks ago
- Neural syntax annotator, supporting sequence labeling, lemmatization, and dependency parsing.☆75Updated last year
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆352Updated this week
- ☆128Updated last year
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- Tutorial for Porting PyTorch Transformer Models to Candle (Rust)☆289Updated 9 months ago