Alternatives and similar repositories for candle-paged-attention:

Users that are interested in candle-paged-attention are comparing it to the libraries listed below

• LaurentMazare / glim
  ☆17Updated 3 months ago
• KGrewal1 / candle-optimisers
  A collection of optimisers for use with candle
  ☆31Updated 2 months ago
• chenwanqq / candle-llava
  implement llava using candle
  ☆13Updated 7 months ago
• LaurentMazare / tboard-rs
  Read and write tensorboard data using Rust
  ☆19Updated 11 months ago
• Narsil / ggblas
  ☆25Updated last year
• EricLBuehler / candle_graphs
  Graph model execution API for Candle
  ☆12Updated last month
• EricLBuehler / zig_ml
  Tensor library for Zig
  ☆10Updated 2 months ago
• kyutai-labs / sphn
  python bindings for symphonia/opus - read various audio formats from python and write opus files
  ☆25Updated 3 weeks ago
• sarah-quinones / gemm
  ☆77Updated last week
• oxideai / diffusers-burn
  A diffusers API in Burn (Rust)
  ☆18Updated 6 months ago
• Dan-wanna-M / kbnf
  A high-performance constrained decoding engine based on context free grammar in Rust
  ☆44Updated 2 weeks ago
• huggingface / pyo3-special-method-derive
  Automatically derive Python dunder methods for your Rust code
  ☆13Updated 5 months ago
• leo-du / llama2.rs
  Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust
  ☆37Updated last year
• EricLBuehler / candle-lora
  Low rank adaptation (LoRA) for Candle.
  ☆134Updated 4 months ago
• LaurentMazare / tch-ext
  Sample Python extension using Rust/PyO3/tch to interact with PyTorch
  ☆34Updated 11 months ago
• EricLBuehler / float8
  8-bit floating point types for Rust
  ☆41Updated last week
• Narsil / bindgen_cuda
  ☆20Updated 6 months ago
• LaurentMazare / hojo
  A small python library to run iterators in a separate process
  ☆10Updated 9 months ago
• coreylowman / llama-dfdx
  LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!
  ☆102Updated last year
• tomsanbear / candle-einops
  ☆26Updated 2 months ago
• smpanaro / ModernBERT-AppleNeuralEngine
  ModernBERT model optimized for Apple Neural Engine.
  ☆17Updated last week
• Chillee / lit-llama
  Simple (fast) transformer inference in PyTorch with torch.compile + lit-llama code
  ☆10Updated last year
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆74Updated 11 months ago
• herrmann / rustorch
  "PyTorch in Rust"
  ☆16Updated 11 months ago
• Narsil / smelte-rs
  ☆57Updated last year
• FL33TW00D / coremlprofiler
  Profile your CoreML models directly from Python 🐍
  ☆25Updated 3 months ago
• kyutai-labs / yomikomi
  A small rust-based data loader
  ☆19Updated last month
• aredden / torch-cublas-hgemm
  PyTorch half precision gemm lib w/ fused optional bias + optional relu/gelu
  ☆47Updated last month
• ethansmith2000 / TransformerExperiments
  ☆19Updated 3 months ago