Alternatives and similar repositories for candle-cublaslt

Users that are interested in candle-cublaslt are comparing it to the libraries listed below

• LaurentMazare / hojo
  A small python library to run iterators in a separate process
  ☆10Updated last year
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆27Updated 8 months ago
• kyutai-labs / kaudio
  Rust crate for some audio utilities
  ☆26Updated 4 months ago
• guidance-ai / llgtrt
  TensorRT-LLM server with Structured Outputs (JSON) built with Rust
  ☆55Updated 2 months ago
• kyutai-labs / moshi-webrtc
  Proof of concept for running moshi/hibiki using webrtc
  ☆20Updated 4 months ago
• chenwanqq / candle-llava
  implement llava using candle
  ☆15Updated last year
• georgesheth / swarms-rust
  Rust SDK and CLI for Swarm Framework with Multi-Agent Orchestration
  ☆15Updated 3 months ago
• EricLBuehler / zig_ml
  Tensor library for Zig
  ☆11Updated 7 months ago
• kanpuriyanawab / picograd
  Rust Implementation of micrograd
  ☆52Updated last year
• charlesfrye / cuda-substrings
  Because it's there.
  ☆16Updated 9 months ago
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆25Updated 5 months ago
• wdoppenberg / polars-candle
  A text embedding extension for the Polars Dataframe library.
  ☆25Updated 7 months ago
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆24Updated 7 months ago
• huggingface / dedupe_estimator
  Chunk Dedupe Estimation
  ☆14Updated 8 months ago
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆74Updated last week
• LaurentMazare / tboard-rs
  Read and write tensorboard data using Rust
  ☆21Updated last year
• danielgrittner / llama2-rs
  LLaMA2 + Rust
  ☆12Updated last year
• eugenehp / gpu-fft
  GPU based FFT written in Rust and CubeCL
  ☆23Updated last month
• EricLBuehler / candle_graphs
  Graph model execution API for Candle
  ☆13Updated 7 months ago
• thisishugow / create-llama-ollama
  a simple create-llama template using llama-index v0.10 and integrated with Ollama
  ☆10Updated last year
• oxideai / diffusers-burn
  A diffusers API in Burn (Rust)
  ☆20Updated last year
• pixelspark / poly
  A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust
  ☆80Updated last year
• tairov / lamatune
  LLama implementations benchmarking framework
  ☆12Updated last year
• TextGeneratorio / text-generator.io
  Run Vision LLMs, TTS and STT APIs. Website and API for https://text-generator.io
  ☆35Updated this week
• Vaibhavs10 / fast-llm.rs
  ☆138Updated last year
• leo-du / llama2.rs
  Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust
  ☆38Updated last year
• prem-research / prem-operator
  📡 Deploy AI models and apps to Kubernetes without developing a hernia
  ☆32Updated last year
• SamsungSAILMontreal / ByteCraft
  ☆31Updated 3 months ago
• kyutai-labs / yomikomi
  A small rust-based data loader
  ☆30Updated last month
• cocoindex-io / patient-intake-extraction
  Patient Intake Form Extraction using llm
  ☆12Updated last month