huggingface / pyo3-special-method-derive
Automatically derive Python dunder methods for your Rust code
☆14Updated 6 months ago
Alternatives and similar repositories for pyo3-special-method-derive:
Users that are interested in pyo3-special-method-derive are comparing it to the libraries listed below
- implement llava using candle☆14Updated 8 months ago
- ☆12Updated last year
- A high-performance constrained decoding engine based on context free grammar in Rust☆46Updated last month
- A collection of optimisers for use with candle☆34Updated 3 months ago
- Low rank adaptation (LoRA) for Candle.☆142Updated 6 months ago
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆306Updated this week
- Super-fast Structured Outputs☆114Updated this week
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆121Updated 2 months ago
- ☆28Updated 3 months ago
- Faster structured generation☆177Updated this week
- Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust☆37Updated last year
- Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package☆181Updated this week
- ☆125Updated 9 months ago
- ☆19Updated 2 years ago
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated 11 months ago
- A comprehensive Rust translation of the code from Sebastian Raschka's Build an LLM from Scratch book.☆110Updated this week
- Modular Rust transformer/LLM library using Candle☆36Updated 9 months ago
- ☆37Updated 2 years ago
- Inference engine for GLiNER models, in Rust☆40Updated this week
- vLLM adapter for a TGIS-compatible gRPC server.☆21Updated this week
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆34Updated 2 months ago
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆63Updated last month
- A Rust crate offering similar functionality to the Python transformers package using Candle.☆13Updated 3 months ago
- A fast implementation of T5/UL2 in PyTorch using Flash Attention☆82Updated 3 weeks ago
- Tutorial for Porting PyTorch Transformer Models to Candle (Rust)☆281Updated 6 months ago
- Library for fast text representation and classification.☆28Updated last year
- Pre-train Static Word Embeddings☆47Updated 3 weeks ago
- some common Huggingface transformers in maximal update parametrization (µP)☆78Updated 2 years ago
- ☆21Updated 7 months ago
- ☆57Updated last year