gabrielmbmb / candle-holderLinks
A Rust crate offering similar functionality to the Python transformers package using Candle.
☆14Updated 11 months ago
Alternatives and similar repositories for candle-holder
Users that are interested in candle-holder are comparing it to the libraries listed below
Sorting:
- Automatically derive Python dunder methods for your Rust code☆20Updated 6 months ago
- CLI utility to inspect and explore .safetensors and .gguf files☆32Updated 3 months ago
- Rust crate for some audio utilities☆25Updated 7 months ago
- Rust implementation of Huggingface transformers pipelines using onnxruntime backend with bindings to C# and C.☆39Updated 2 years ago
- Cookbook to build Rust Candle models☆81Updated last year
- Inference engine for GLiNER models, in Rust☆74Updated this week
- Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package☆236Updated last month
- Demos using Rust Candle☆79Updated 9 months ago
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆151Updated 3 months ago
- ☆139Updated last year
- ☆157Updated 2 years ago
- Rust-tokenizer offers high-performance tokenizers for modern language models, including WordPiece, Byte-Pair Encoding (BPE) and Unigram (…☆328Updated 2 years ago
- ☆134Updated last year
- Low rank adaptation (LoRA) for Candle.☆163Updated 6 months ago
- LLM Orchestrator built in Rust☆284Updated last year
- implement llava using candle☆15Updated last year
- Rust library for whisper.cpp compatible Mel spectrograms☆75Updated 5 months ago
- An example of using Torch rust bindings to serve trained machine learning models via Actix Web☆16Updated 4 years ago
- Tutorial for Porting PyTorch Transformer Models to Candle (Rust)☆325Updated last year
- Your one stop CLI for ONNX model analysis.☆47Updated 2 years ago
- ☆124Updated last year
- ☆25Updated 10 months ago
- Simply, faster, sentence-transformers☆143Updated last year
- Inference Llama 2 in one file of pure Rust 🦀☆233Updated 2 years ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆33Updated last month
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆76Updated 2 years ago
- 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.☆140Updated last year
- A collection of optimisers for use with candle☆43Updated 2 months ago
- This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resultin…☆23Updated last year
- Efficiently find the best-suited language model (LM) for your NLP task☆127Updated 3 months ago