dlsyscourse / hw1
☆7Updated 8 months ago
Alternatives and similar repositories for hw1
Users that are interested in hw1 are comparing it to the libraries listed below
Sorting:
- ☆32Updated last year
- A simple calculation for LLM MFU.☆38Updated 2 months ago
- Simple PyTorch graph capturing.☆19Updated last year
- A minimal implementation of vllm.☆40Updated 9 months ago
- Machine Learning Compiler Road Map☆44Updated last year
- A lightweight design for computation-communication overlap.☆113Updated last week
- Summary of some awesome work for optimizing LLM inference☆73Updated last month
- GPTQ inference TVM kernel☆38Updated last year
- ☆20Updated 8 months ago
- Implement Flash Attention using Cute.☆82Updated 5 months ago
- Stateful LLM Serving☆67Updated 2 months ago
- A practical way of learning Swizzle☆19Updated 3 months ago
- ☆36Updated 9 months ago
- SOTA Learning-augmented Systems☆36Updated 2 years ago
- ☆7Updated 7 months ago
- Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.☆36Updated last month
- ☆94Updated 8 months ago
- 方便扩展的Cuda算子理解和优化框架,仅用在学习使用☆15Updated 11 months ago
- DeeperGEMM: crazy optimized version☆69Updated last week
- ☆79Updated 6 months ago
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆76Updated last week
- [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable☆155Updated 7 months ago
- TensorRT LLM Benchmark Configuration☆13Updated 9 months ago
- PyTorch bindings for CUTLASS grouped GEMM.☆121Updated 4 months ago
- A resilient distributed training framework☆95Updated last year
- ☆24Updated 10 months ago
- ring-attention experiments☆142Updated 6 months ago
- High performance RDMA-based distributed feature collection component for training GNN model on EXTREMELY large graph☆53Updated 2 years ago
- FlexFlow Serve: Low-Latency, High-Performance LLM Serving☆39Updated last week
- llm theoretical performance analysis tools and support params, flops, memory and latency analysis.☆88Updated 4 months ago