gabrielmbmb / candle-holderLinks
A Rust crate offering similar functionality to the Python transformers package using Candle.
☆13Updated 8 months ago
Alternatives and similar repositories for candle-holder
Users that are interested in candle-holder are comparing it to the libraries listed below
Sorting:
- Automatically derive Python dunder methods for your Rust code☆19Updated 3 months ago
- Rust crate for some audio utilities☆26Updated 4 months ago
- Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package☆219Updated last month
- An example of using Torch rust bindings to serve trained machine learning models via Actix Web☆16Updated 3 years ago
- Cookbook to build Rust Candle models☆81Updated last year
- Inference engine for GLiNER models, in Rust☆64Updated last month
- Rust implementation of Huggingface transformers pipelines using onnxruntime backend with bindings to C# and C.☆39Updated 2 years ago
- ☆155Updated 2 years ago
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆142Updated 3 weeks ago
- Low rank adaptation (LoRA) for Candle.☆152Updated 3 months ago
- oclean is a bio inspired solution to help clean up the ocean☆9Updated 2 years ago
- Rust-tokenizer offers high-performance tokenizers for modern language models, including WordPiece, Byte-Pair Encoding (BPE) and Unigram (…☆323Updated last year
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆33Updated 2 months ago
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆401Updated last week
- LLM Orchestrator built in Rust☆281Updated last year
- ☆130Updated last year
- CLI utility to inspect and explore .safetensors and .gguf files☆24Updated last week
- Demos using Rust Candle☆77Updated 6 months ago
- implement llava using candle☆15Updated last year
- Tutorial for Porting PyTorch Transformer Models to Candle (Rust)☆308Updated last year
- ☆19Updated 2 years ago
- MAFAND-MT☆57Updated last year
- ☆124Updated 9 months ago
- Using short models to classify long texts☆21Updated 2 years ago
- 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.☆137Updated last year
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- The pipeline for the OSCAR corpus☆171Updated last year
- A collection of optimisers for use with candle☆37Updated last week
- Exploring finetuning public checkpoints on filter 8K sequences on Pile☆116Updated 2 years ago
- ☆138Updated last year