michaelfeil / candle-flash-attn-v3
☆11Updated 2 months ago
Alternatives and similar repositories for candle-flash-attn-v3:
Users that are interested in candle-flash-attn-v3 are comparing it to the libraries listed below
- implement llava using candle☆14Updated 9 months ago
- Learn CUDA with PyTorch☆19Updated 2 months ago
- This repository has code for fine-tuning LLMs with GRPO specifically for Rust Programming using cargo as feedback☆75Updated 3 weeks ago
- GPU based FFT written in Rust and CubeCL☆21Updated 2 weeks ago
- A high-performance constrained decoding engine based on context free grammar in Rust☆48Updated 3 months ago
- ☆12Updated last year
- ☆12Updated last year
- Proof of concept for running moshi/hibiki using webrtc☆18Updated last month
- Fast and versatile tokenizer for language models, compatible with SentencePiece, Tokenizers, Tiktoken and more. Supports BPE, Unigram and…☆19Updated last week
- Binary vector search example using Unum's USearch engine and pre-computed Wikipedia embeddings from Co:here and MixedBread☆18Updated 11 months ago
- ☆28Updated 4 months ago
- A collection of optimisers for use with candle☆34Updated 4 months ago
- Rust Implementation of micrograd☆51Updated 8 months ago
- Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust☆37Updated last year
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆34Updated 3 months ago
- Rust crate for some audio utilities☆22Updated 3 weeks ago
- ☆19Updated 5 months ago
- ☆37Updated 2 years ago
- Efficient encoder-decoder architecture for small language models (≤1B parameters) with cross-architecture knowledge distillation and visi…☆23Updated last month
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- NLP with Rust for Python 🦀🐍☆61Updated 10 months ago
- Make triton easier☆47Updated 9 months ago
- ☆126Updated 11 months ago
- Inference engine for GLiNER models, in Rust☆44Updated this week
- A miniature version of Modal☆20Updated 9 months ago
- 8-bit floating point types for Rust☆46Updated 2 weeks ago
- ☆21Updated 3 weeks ago
- ☆25Updated 3 months ago
- 🤝 Trade any tensors over the network☆30Updated last year
- "PyTorch in Rust"☆16Updated last year