Alternatives and similar repositories for candle-cublaslt:

Users that are interested in candle-cublaslt are comparing it to the libraries listed below

• EricLBuehler / zig_ml
  Tensor library for Zig
  ☆12Updated 5 months ago
• kyutai-labs / kaudio
  Rust crate for some audio utilities
  ☆23Updated 2 months ago
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆26Updated 5 months ago
• kyutai-labs / moshi-webrtc
  Proof of concept for running moshi/hibiki using webrtc
  ☆18Updated 2 months ago
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆37Updated last week
• EricLBuehler / float8
  8-bit floating point types for Rust
  ☆47Updated last month
• LaurentMazare / hojo
  A small python library to run iterators in a separate process
  ☆10Updated last year
• inferless / triton-co-pilot
  Generate Glue Code in seconds to simplify your Nvidia Triton Inference Server Deployments
  ☆20Updated 10 months ago
• eugenehp / gpu-fft
  GPU based FFT written in Rust and CubeCL
  ☆22Updated last month
• wdoppenberg / polars-candle
  A text embedding extension for the Polars Dataframe library.
  ☆24Updated 5 months ago
• dwarvesf / llm-hosting
  This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Larg…
  ☆22Updated 2 months ago
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆20Updated 3 months ago
• EricLBuehler / candle_graphs
  Graph model execution API for Candle
  ☆14Updated 5 months ago
• huggingface / dedupe_estimator
  Chunk Dedupe Estimation
  ☆14Updated 6 months ago
• philschmid / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆11Updated 7 months ago
• michaelfeil / candle-flash-attn-v3
  ☆11Updated 3 months ago
• leo-du / llama2.rs
  Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust
  ☆38Updated last year
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆30Updated 4 months ago
• guidance-ai / llgtrt
  TensorRT-LLM server with Structured Outputs (JSON) built with Rust
  ☆52Updated last week
• charlesfrye / cuda-substrings
  Because it's there.
  ☆16Updated 7 months ago
• tomsanbear / candle-einops
  ☆29Updated 5 months ago
• LaurentMazare / tboard-rs
  Read and write tensorboard data using Rust
  ☆21Updated last year
• KGrewal1 / candle-optimisers
  A collection of optimisers for use with candle
  ☆34Updated last week
• ShelbyJenkins / candle_embed
  A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face
  ☆36Updated last year
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆19Updated 4 months ago
• dylibso / chainsocket
  Proof of concept for a generative AI application framework powered by WebAssembly and Extism
  ☆14Updated last year
• kyutai-labs / yomikomi
  A small rust-based data loader
  ☆24Updated 4 months ago
• kyutai-labs / dactory
  ☆19Updated last week
• morgangiraud / text-to-sql-proto
  A text-to-SQL prototype on the northwind sqlite dataset
  ☆12Updated 7 months ago
• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆30Updated last year