michaelfeil / candle-flash-attn-v3Links
β12Updated 8 months ago
Alternatives and similar repositories for candle-flash-attn-v3
Users that are interested in candle-flash-attn-v3 are comparing it to the libraries listed below
Sorting:
- implement llava using candleβ15Updated last year
- π· Build compute kernelsβ149Updated this week
- Rust crate for some audio utilitiesβ26Updated 6 months ago
- This repository has code for fine-tuning LLMs with GRPO specifically for Rust Programming using cargo as feedbackβ105Updated 6 months ago
- Simple high-throughput inference libraryβ139Updated 4 months ago
- Proof of concept for running moshi/hibiki using webrtcβ20Updated 7 months ago
- A high-performance constrained decoding engine based on context free grammar in Rustβ55Updated 4 months ago
- Inference Llama 2 in one file of zero-dependency, zero-unsafe Rustβ39Updated 2 years ago
- High-performance MinHash implementation in Rust with Python bindings for efficient similarity estimation and deduplication of large datasβ¦β204Updated 2 months ago
- Read and write tensorboard data using Rustβ23Updated last year
- β133Updated last year
- β21Updated 7 months ago
- vLLM adapter for a TGIS-compatible gRPC server.β41Updated this week
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.β33Updated 2 weeks ago
- CLI utility to inspect and explore .safetensors and .gguf filesβ30Updated 2 months ago
- β12Updated last year
- Make triton easierβ47Updated last year
- GPU based FFT written in Rust and CubeCLβ23Updated 3 months ago
- Inference engine for GLiNER models, in Rustβ71Updated 3 months ago
- β25Updated this week
- A collection of reproducible inference engine benchmarksβ33Updated 5 months ago
- GPTQ and efficient search for GGUFβ49Updated 2 weeks ago
- A collection of optimisers for use with candleβ40Updated last month
- Write a fast kernel and run it on Discord. See how you compare against the best!β57Updated last week
- Rust Implementation of microgradβ52Updated last year
- β53Updated 11 months ago
- Cray-LM unified training and inference stack.β22Updated 8 months ago
- β24Updated 5 months ago
- Automatically derive Python dunder methods for your Rust codeβ20Updated 5 months ago
- DPO, but faster πβ44Updated 10 months ago