InfiniTensor / InfiniLM-RustLinks
☆125Updated 2 months ago
Alternatives and similar repositories for InfiniLM-Rust
Users that are interested in InfiniLM-Rust are comparing it to the libraries listed below
Sorting:
- ☆66Updated last year
- 算子库☆17Updated 5 months ago
- 笔记☆47Updated 4 months ago
- ☆276Updated last month
- ☆39Updated 11 months ago
- 算子库(Rust)☆14Updated 5 months ago
- easy cuda code☆92Updated last year
- A domain-specific language (DSL) based on Triton but providing higher-level abstractions.☆38Updated last week
- ☆64Updated 11 months ago
- ☆30Updated last week
- 实验:rust 实现 llama2 推理☆16Updated last year
- 分层解耦的深度学习推理引擎☆78Updated 10 months ago
- Codes & examples for "CUDA - From Correctness to Performance"☆118Updated last year
- A PyTorch-like deep learning framework. Just for fun.☆157Updated 2 years ago
- Wiki fo HPC☆123Updated 5 months ago
- Large-scale Auto-Distributed Training/Inference Unified Framework | Memory-Compute-Control Decoupled Architecture | Multi-language SDK & …☆55Updated 5 months ago
- Triton Documentation in Chinese Simplified / Triton 中文文档☆96Updated last week
- 《自己动手写AI编译器》☆31Updated last year
- RustSBI Specialized Domain Knowledge Quiz LLM☆104Updated 2 months ago
- 训练营讲义☆21Updated 11 months ago
- 🌈 Solutions of LeetGPU☆59Updated last month
- Flash Attention from Scratch on CUDA Ampere☆96Updated 3 months ago
- 注释的nano_vllm仓库,并且完成了MiniCPM4的适配以及注册新模型的功能☆123Updated 4 months ago
- gLLM: Global Balanced Pipeline Parallelism System for Distributed LLM Serving with Token Throttling☆51Updated last week
- FlagTree is a unified compiler supporting multiple AI chip backends for custom Deep Learning operations, which is forked from triton-lang…☆146Updated this week
- ☆69Updated 2 years ago
- Source-level operating system debugging tool that supports debugging kernel and multiple user processes synchronously. VSCode integration…☆37Updated 2 months ago
- deep learning framework from scratch☆32Updated 3 years ago
- Fast OS-level support for GPU checkpoint and restore☆264Updated 2 months ago
- CUDA SGEMM optimization note☆15Updated 2 years ago