Alternatives and similar repositories for dataflow

Users that are interested in dataflow are comparing it to the libraries listed below

• mokeyish / candle-ext
  An extension library to Candle that provides PyTorch functions not currently available in Candle
  ☆40Updated last year
• epwalsh / rust-dl-webserver
  🦀 Example of serving deep learning models in Rust with batched prediction
  ☆34Updated 2 years ago
• oddity-ai / async-cuda
  Asynchronous CUDA for Rust.
  ☆34Updated 8 months ago
• neuml / txtai.rs
  Rust client for txtai
  ☆111Updated last month
• oxidized-transformers / oxidized-transformers
  Modular Rust transformer/LLM library using Candle
  ☆36Updated last year
• coreylowman / llama-dfdx
  LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!
  ☆107Updated last year
• julianbuettner / swapvec
  A Rust Vector which swaps to disk based on given parameters
  ☆44Updated last year
• vertexclique / orkhon
  Orkhon: ML Inference Framework and Server Runtime
  ☆150Updated 4 years ago
• pixelspark / poly
  A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust
  ☆80Updated last year
• EricLBuehler / float8
  8-bit floating point types for Rust
  ☆47Updated 4 months ago
• jeroenvlek / gpt-from-scratch-rs
  Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle
  ☆73Updated last year
• drbh / simd-alphatensor-rs
  🧮 alphatensor matrix breakthrough algorithms + simd + rust.
  ☆61Updated 2 years ago
• atoma-network / atoma-infer
  Fast serverless LLM inference, in Rust.
  ☆88Updated 4 months ago
• SamKG / iree-rs
  Rustic bindings for IREE
  ☆18Updated 2 years ago
• KarelPeeters / Kyanite
  A neural network inference library, written in Rust.
  ☆63Updated last year
• infinyon / fluvio-demo-apps-rust
  Mysql Change Data Capture Demo App for Fluvio Streaming Platform
  ☆14Updated 2 years ago
• haixuanTao / bert-onnx-rs-server
  A Demo server serving Bert through ONNX with GPU written in Rust with <3
  ☆40Updated 3 years ago
• EricLBuehler / candle-lora
  Low rank adaptation (LoRA) for Candle.
  ☆151Updated 2 months ago
• lerouxrgd / ngt-rs
  Rust wrappers for NGT approximate nearest neighbor search
  ☆38Updated last year
• LaurentMazare / ug
  Experimental compiler for deep learning models
  ☆68Updated last month
• Narsil / bindgen_cuda
  ☆23Updated 3 months ago
• eugenehp / gpu-fft
  GPU based FFT written in Rust and CubeCL
  ☆23Updated last month
• oxideai / diffusers-burn
  A diffusers API in Burn (Rust)
  ☆20Updated last year
• SunDoge / dlpark
  A Rust Library for High-Performance Tensor Exchange with Python
  ☆47Updated last week
• ShelbyJenkins / llm_utils
  llm_utils: Basic LLM tools, best practices, and minimal abstraction.
  ☆46Updated 4 months ago
• haixuanTao / onnxruntime-rs
  Rust wrapper for Microsoft's ONNX Runtime with CUDA support (version 1.7)
  ☆23Updated 3 years ago
• sarah-quinones / gemm
  ☆89Updated 6 months ago
• ahirner / infur
  image segmentation on video and images
  ☆47Updated last year
• sachaarbonel / reefdb
  ReefDB is a minimalistic, in-memory and on-disk database management system written in Rust, implementing basic SQL query capabilities and…
  ☆89Updated 5 months ago
• Tudyx / ai-dataloader
  A rust port of pytorch dataloader
  ☆27Updated 6 months ago