gabrielmbmb / candle-holder
A Rust crate offering similar functionality to the Python transformers package using Candle.
☆13Updated 5 months ago
Alternatives and similar repositories for candle-holder
Users that are interested in candle-holder are comparing it to the libraries listed below
Sorting:
- Automatically derive Python dunder methods for your Rust code☆18Updated last month
- Low rank adaptation (LoRA) for Candle.☆146Updated last month
- Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package☆204Updated 2 months ago
- Inference engine for GLiNER models, in Rust☆58Updated last month
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆34Updated last week
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆134Updated 5 months ago
- Rust-tokenizer offers high-performance tokenizers for modern language models, including WordPiece, Byte-Pair Encoding (BPE) and Unigram (…☆313Updated last year
- Rust crate for some audio utilities☆23Updated 2 months ago
- Simply, faster, sentence-transformers☆142Updated 8 months ago
- oclean is a bio inspired solution to help clean up the ocean☆9Updated 2 years ago
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆75Updated last year
- Rust implementation of Huggingface transformers pipelines using onnxruntime backend with bindings to C# and C.☆39Updated 2 years ago
- ☆155Updated 2 years ago
- NLP with Rust for Python 🦀🐍☆62Updated this week
- Your one stop CLI for ONNX model analysis.☆47Updated 2 years ago
- Cookbook to build Rust Candle models☆79Updated last year
- C++ inference engine for running GLiNER (Generalist and Lightweight Named Entity Recognition) models☆31Updated 5 months ago
- A complete(grpc service and lib) Rust inference with multilingual embedding support. This version leverages the power of Rust for both GR…☆39Updated 8 months ago
- ☆129Updated last year
- ☆11Updated 3 months ago
- This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resultin…☆23Updated last year
- 🤝 Trade any tensors over the network☆30Updated last year
- Transformers provides a simple, intuitive interface for Rust developers who want to work with Large Language Models locally, powered by t…☆16Updated this week
- 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.☆136Updated 9 months ago
- An example of using Torch rust bindings to serve trained machine learning models via Actix Web☆15Updated 3 years ago
- Generalist and Lightweight Model for Text Classification☆128Updated 2 weeks ago
- ☆136Updated last year
- A client library in Rust for Nvidia Triton.☆29Updated last year
- Chunk your text using gpt4o-mini more accurately☆44Updated 9 months ago
- Tutorial for Porting PyTorch Transformer Models to Candle (Rust)☆294Updated 9 months ago