Alternatives and similar repositories for candle-cublaslt

Users that are interested in candle-cublaslt are comparing it to the libraries listed below

• kyutai-labs / moshi-webrtc
  Proof of concept for running moshi/hibiki using webrtc
  ☆19Updated 3 months ago
• LaurentMazare / hojo
  A small python library to run iterators in a separate process
  ☆10Updated last year
• kyutai-labs / kaudio
  Rust crate for some audio utilities
  ☆23Updated 2 months ago
• eugenehp / gpu-fft
  GPU based FFT written in Rust and CubeCL
  ☆22Updated 2 months ago
• chenwanqq / candle-llava
  implement llava using candle
  ☆15Updated 11 months ago
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆44Updated this week
• LaurentMazare / tboard-rs
  Read and write tensorboard data using Rust
  ☆21Updated last year
• michaelfeil / candle-flash-attn-v3
  ☆11Updated 4 months ago
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆25Updated 6 months ago
• LaurentMazare / glim
  ☆19Updated 7 months ago
• EricLBuehler / zig_ml
  Tensor library for Zig
  ☆11Updated 6 months ago
• joeyballentine / ESRGAN-candle-rs
  ESRGAN implemented in rust with candle
  ☆16Updated last year
• EricLBuehler / candle_graphs
  Graph model execution API for Candle
  ☆13Updated 6 months ago
• tomsanbear / bitnet-rs
  Implementing the BitNet model in Rust
  ☆37Updated last year
• EricLBuehler / float8
  8-bit floating point types for Rust
  ☆45Updated 2 months ago
• oxidized-transformers / oxidized-transformers
  Modular Rust transformer/LLM library using Candle
  ☆35Updated last year
• philschmid / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆11Updated 8 months ago
• huggingface / candle-paged-attention
  ☆12Updated last year
• kyutai-labs / yomikomi
  A small rust-based data loader
  ☆24Updated 5 months ago
• leo-du / llama2.rs
  Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust
  ☆38Updated last year
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆19Updated 5 months ago
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆21Updated 4 months ago
• mokeyish / candle-ext
  An extension library to Candle that provides PyTorch functions not currently available in Candle
  ☆39Updated last year
• wdoppenberg / polars-candle
  A text embedding extension for the Polars Dataframe library.
  ☆24Updated 6 months ago
• ljt019 / transformers
  Transformers provides a simple, intuitive interface for Rust developers who want to work with Large Language Models locally, powered by t…
  ☆16Updated this week
• inferless / triton-co-pilot
  Generate Glue Code in seconds to simplify your Nvidia Triton Inference Server Deployments
  ☆20Updated 11 months ago
• Narsil / bloomserver
  ☆39Updated 2 years ago
• kyutai-labs / jax-flash-attn3
  JAX bindings for the flash-attention3 kernels
  ☆11Updated 9 months ago
• jquesnelle / ctranslate2-rs
  Rust bindings for CTranslate2
  ☆14Updated last year
• Dan-wanna-M / kbnf
  A high-performance constrained decoding engine based on context free grammar in Rust
  ☆52Updated last week