Alternatives and similar repositories for InfiniLM-Rust

Users that are interested in InfiniLM-Rust are comparing it to the libraries listed below

• LearningInfiniTensor / learning-lm-rs
  ☆67Updated last year
• InfiniTensor / InfiniTensor
  ☆281Updated 2 months ago
• InfiniTensor / operators
  算子库
  ☆17Updated 6 months ago
• YdrMaster / notebook
  笔记
  ☆49Updated 5 months ago
• LearningInfiniTensor / TinyInfiniTensor
  ☆41Updated last year
• xgqdut2016 / cuda_code
  easy cuda code
  ☆93Updated last year
• InfiniTensor / ninetoothed
  A domain-specific language (DSL) based on Triton but providing higher-level abstractions.
  ☆39Updated this week
• YdrMaster / operators-rs
  算子库（Rust）
  ☆14Updated 5 months ago
• LearningInfiniTensor / learning-cxx
  ☆68Updated 11 months ago
• YdrMaster / llama2.rs
  实验：rust 实现 llama2 推理
  ☆16Updated last year
• xgqdut2016 / hpc2torch
  ☆30Updated last week
• interestingLSY / CUDA-From-Correctness-To-Performance-Code
  Codes & examples for "CUDA - From Correctness to Performance"
  ☆120Updated last year
• InfiniTensor / RefactorGraph
  分层解耦的深度学习推理引擎
  ☆79Updated 10 months ago
• LearningInfiniTensor / handout
  训练营讲义
  ☆21Updated 11 months ago
• sonnyli / flash_attention_from_scratch
  Flash Attention from Scratch on CUDA Ampere
  ☆115Updated 4 months ago
• Sunt-ing / stick
  A PyTorch-like deep learning framework. Just for fun.
  ☆157Updated 2 years ago
• apache / tvm-ffi
  Open ABI and FFI for Machine Learning Systems
  ☆293Updated this week
• hyperai / triton-cn
  Triton Documentation in Chinese Simplified / Triton 中文文档
  ☆97Updated 3 weeks ago
• dsl-learn / LeetGPU
  LeetGPU Solutions
  ☆95Updated 3 months ago
• alexshuang / write-your-own-ai-compiler
  《自己动手写AI编译器》
  ☆32Updated last year
• array2d / deepx
  Large-scale Auto-Distributed Training/Inference Unified Framework | Memory-Compute-Control Decoupled Architecture | Multi-language SDK & …
  ☆55Updated 5 months ago
• YangLinzhuo / cuda-sgemm-optimization
  CUDA SGEMM optimization note
  ☆15Updated 2 years ago
• flagos-ai / FlagTree
  FlagTree is a unified compiler supporting multiple AI chip backends for custom Deep Learning operations, which is forked from triton-lang…
  ☆155Updated last week
• rustsbi / Agent
  RustSBI Specialized Domain Knowledge Quiz LLM
  ☆104Updated 2 months ago
• toyaix / TritonLLM
  LLM Inference via Triton (Flexible & Modular): Focused on Kernel Optimization using CUBIN binaries, Starting from gpt-oss Model
  ☆63Updated 2 months ago
• ArthurinRUC / cutlass-notes
  From Minimal GEMM to Everything
  ☆95Updated 2 weeks ago
• caiwanxianhust / FasterLLaMA
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆63Updated last year
• LDLINGLINGLING / nano_vllm_note
  注释的nano_vllm仓库，并且完成了MiniCPM4的适配以及注册新模型的功能
  ☆139Updated 5 months ago
• infinigence / Semi-PD
  A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.
  ☆123Updated 3 weeks ago
• scPointer / maturin
  ☆13Updated last year