huggingface / candle-paged-attention
☆12Updated last year
Alternatives and similar repositories for candle-paged-attention:
Users that are interested in candle-paged-attention are comparing it to the libraries listed below
- ☆19Updated 6 months ago
- implement llava using candle☆14Updated 10 months ago
- A collection of optimisers for use with candle☆34Updated 5 months ago
- Read and write tensorboard data using Rust☆20Updated last year
- Rust crate for some audio utilities☆22Updated last month
- GPU based FFT written in Rust and CubeCL☆21Updated last month
- Experimental compiler for deep learning models☆62Updated last week
- Sample Python extension using Rust/PyO3/tch to interact with PyTorch☆34Updated last year
- Tensor library for Zig☆11Updated 5 months ago
- A high-performance constrained decoding engine based on context free grammar in Rust☆50Updated 3 months ago
- Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust☆38Updated last year
- Graph model execution API for Candle☆13Updated 5 months ago
- ☆11Updated 2 months ago
- A small rust-based data loader☆24Updated 4 months ago
- Load compute kernels from the Hub☆115Updated this week
- ☆26Updated last year
- ☆23Updated last week
- ☆13Updated 5 months ago
- A small python library to run iterators in a separate process☆10Updated last year
- ☆28Updated 5 months ago
- 8-bit floating point types for Rust☆46Updated last month
- python bindings for symphonia/opus - read various audio formats from python and write opus files☆58Updated 2 weeks ago
- Experimental GPU language with meta-programming☆22Updated 7 months ago
- ☆21Updated last month
- JAX bindings for the flash-attention3 kernels☆11Updated 8 months ago
- ☆17Updated 3 weeks ago
- A diffusers API in Burn (Rust)☆19Updated 9 months ago
- Learn CUDA with PyTorch☆20Updated 2 months ago
- Fast, Lightweight, Unified Engine for Text2Image Diffusion Models☆20Updated last week
- 👷 Build compute kernels☆35Updated this week