Alternatives and similar repositories for InfiniLM-Rust

Users that are interested in InfiniLM-Rust are comparing it to the libraries listed below

• LearningInfiniTensor / learning-lm-rs
  ☆65Updated last year
• InfiniTensor / operators
  算子库
  ☆17Updated 4 months ago
• InfiniTensor / InfiniTensor
  ☆274Updated last month
• YdrMaster / notebook
  笔记
  ☆47Updated 3 months ago
• xgqdut2016 / cuda_code
  easy cuda code
  ☆90Updated 11 months ago
• xgqdut2016 / hpc2torch
  ☆29Updated last month
• LearningInfiniTensor / TinyInfiniTensor
  ☆37Updated 10 months ago
• InfiniTensor / ninetoothed
  A domain-specific language (DSL) based on Triton but providing higher-level abstractions.
  ☆36Updated this week
• LearningInfiniTensor / learning-cxx
  ☆63Updated 10 months ago
• YdrMaster / llama2.rs
  实验：rust 实现 llama2 推理
  ☆16Updated last year
• interestingLSY / CUDA-From-Correctness-To-Performance-Code
  Codes & examples for "CUDA - From Correctness to Performance"
  ☆117Updated last year
• InfiniTensor / RefactorGraph
  分层解耦的深度学习推理引擎
  ☆76Updated 9 months ago
• YdrMaster / operators-rs
  算子库（Rust）
  ☆14Updated 4 months ago
• hyperai / triton-cn
  Triton Documentation in Chinese Simplified / Triton 中文文档
  ☆91Updated last week
• LearningInfiniTensor / handout
  训练营讲义
  ☆21Updated 10 months ago
• Sunt-ing / stick
  A PyTorch-like deep learning framework. Just for fun.
  ☆156Updated 2 years ago
• alexshuang / write-your-own-ai-compiler
  《自己动手写AI编译器》
  ☆31Updated last year
• toyaix / TritonLLM
  LLM Inference via Triton (Flexible & Modular): Focused on Kernel Optimization using CUBIN binaries, Starting from gpt-oss Model
  ☆56Updated last month
• sonnyli / flash_attention_from_scratch
  Flash Attention from Scratch on CUDA Ampere
  ☆76Updated 3 months ago
• tongzhou80 / nanoPyC
  ☆70Updated 2 years ago
• array2d / deepx
  Large-scale Auto-Distributed Training/Inference Unified Framework | Memory-Compute-Control Decoupled Architecture | Multi-language SDK & …
  ☆55Updated 4 months ago
• SJTU-IPADS / PhoenixOS
  Fast OS-level support for GPU checkpoint and restore
  ☆257Updated 2 months ago
• rustsbi / Agent
  RustSBI Specialized Domain Knowledge Quiz LLM
  ☆104Updated last month
• infinigence / Semi-PD
  A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.
  ☆116Updated 6 months ago
• flagos-ai / flagtree
  FlagTree is a unified compiler for multiple AI chips, which is forked from triton-lang/triton.
  ☆137Updated this week
• YuxueYang1204 / CudaDemo
  Implement custom operators in PyTorch with cuda/c++
  ☆74Updated 2 years ago
• caiwanxianhust / FasterLLaMA
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆62Updated last year
• YangLinzhuo / cuda-sgemm-optimization
  CUDA SGEMM optimization note
  ☆15Updated 2 years ago
• LearningOS / oscomp-kernel-training
  ☆48Updated 3 years ago
• hpcgame / hpc-wiki
  Wiki fo HPC
  ☆123Updated 4 months ago