huggingface / candle-paged-attention

Related projects ⓘ

Alternatives and complementary repositories for candle-paged-attention

• LaurentMazare / glim
  ☆17Updated last month
• chenwanqq / candle-llava
  implement llava using candle
  ☆13Updated 5 months ago
• KGrewal1 / candle-optimisers
  A collection of optimisers for use with candle
  ☆31Updated this week
• Narsil / bindgen_cuda
  ☆19Updated 4 months ago
• tomsanbear / candle-einops
  ☆22Updated this week
• LaurentMazare / tboard-rs
  Read and write tensorboard data using Rust
  ☆17Updated 9 months ago
• Narsil / ggblas
  ☆25Updated last year
• sarah-quinones / gemm
  ☆76Updated 5 months ago
• huggingface / pyo3-special-method-derive
  Automatically derive Python dunder methods for your Rust code
  ☆13Updated 3 months ago
• Dan-wanna-M / kbnf
  A high-performance constrained decoding engine based on context free grammar in Rust
  ☆41Updated 2 weeks ago
• LaurentMazare / tch-ext
  Sample Python extension using Rust/PyO3/tch to interact with PyTorch
  ☆32Updated 9 months ago
• aredden / torch-cublas-hgemm
  PyTorch half precision gemm lib w/ fused optional bias + optional relu/gelu
  ☆39Updated 2 months ago
• kyutai-labs / sphn
  python bindings for symphonia/opus - read various audio formats from python and write opus files
  ☆22Updated 2 months ago
• leo-du / llama2.rs
  Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust
  ☆37Updated last year
• LaurentMazare / hojo
  A small python library to run iterators in a separate process
  ☆10Updated 8 months ago
• EricLBuehler / candle-lora
  Low rank adaptation (LoRA) for Candle.
  ☆127Updated 3 months ago
• gnp / minbpe-rs
  Port of Andrej Karpathy's minbpe to Rust
  ☆19Updated 6 months ago
• mokeyish / candle-ext
  An extension library to Candle that provides PyTorch functions not currently available in Candle
  ☆37Updated 8 months ago
• lianakoleva / no-libtorch-compile
  ☆17Updated last month
• oxideai / diffusers-burn
  A diffusers API in Burn (Rust)
  ☆16Updated 4 months ago
• joeyballentine / ESRGAN-candle-rs
  ESRGAN implemented in rust with candle
  ☆14Updated 11 months ago
• Chillee / lit-llama
  Simple (fast) transformer inference in PyTorch with torch.compile + lit-llama code
  ☆10Updated last year
• coreylowman / llama-dfdx
  LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!
  ☆101Updated last year
• LaurentMazare / xla-rs
  Experimentation using the xla compiler from rust
  ☆89Updated 3 months ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆72Updated 10 months ago
• tomsanbear / bitnet-rs
  Implementing the BitNet model in Rust
  ☆29Updated 7 months ago
• huggingface / hf-hub
  Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package
  ☆155Updated 2 months ago
• LaurentMazare / mamba.rs
  ☆123Updated 6 months ago
• SunDoge / dlpark
  A Rust Library for High-Performance Tensor Exchange with Python
  ☆39Updated last week
• FL33TW00D / steelix
  Your one stop CLI for ONNX model analysis.
  ☆45Updated 2 years ago