gabrielmbmb / candle-holder
A Rust crate offering similar functionality to the Python transformers package using Candle.
☆13Updated this week
Related projects ⓘ
Alternatives and complementary repositories for candle-holder
- Automatically derive Python dunder methods for your Rust code☆13Updated 3 months ago
- Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package☆155Updated 2 months ago
- Low rank adaptation (LoRA) for Candle.☆127Updated 3 months ago
- Experimental compiler for deep learning models☆14Updated this week
- A collection of optimisers for use with candle☆31Updated this week
- Structured generation in Rust☆130Updated this week
- Cookbook to build Rust Candle models☆75Updated 11 months ago
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆265Updated this week
- Rust implementation of Huggingface transformers pipelines using onnxruntime backend with bindings to C# and C.☆34Updated last year
- NLP with Rust for Python 🦀🐍☆59Updated 5 months ago
- ☆123Updated 6 months ago
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆23Updated 8 months ago
- Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust☆37Updated last year
- ☆57Updated last year
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Updated this week
- implement llava using candle☆13Updated 5 months ago
- Demos using Rust Candle☆71Updated last year
- Run Generative AI models directly on your hardware☆22Updated 3 months ago
- ☆112Updated this week
- Port of Andrej Karpathy's minbpe to Rust☆19Updated 6 months ago
- A text embedding extension for the Polars Dataframe library.☆23Updated this week
- Lightweight tools for quick and easy LLM demo's☆26Updated 2 months ago
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆37Updated 8 months ago
- ☆25Updated 10 months ago
- ☆153Updated last year
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆73Updated last year
- Your one stop CLI for ONNX model analysis.☆45Updated 2 years ago
- ☆15Updated last week
- ☆19Updated 4 months ago
- An example of using Torch rust bindings to serve trained machine learning models via Actix Web☆13Updated 3 years ago