dlsyscourse / lecture13
☆9Updated last month
Related projects ⓘ
Alternatives and complementary repositories for lecture13
- GPTQ inference TVM kernel☆35Updated 6 months ago
- Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …☆63Updated 2 years ago
- ☆55Updated 5 months ago
- Benchmarks to capture important workloads.☆28Updated 5 months ago
- Standalone Flash Attention v2 kernel without libtorch dependency☆98Updated 2 months ago
- APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…☆20Updated this week
- ☆22Updated 4 years ago
- Distributed DataLoader For Pytorch Based On Ray☆24Updated 3 years ago
- Memory Optimizations for Deep Learning (ICML 2023)☆59Updated 8 months ago
- Inference framework for MoE layers based on TensorRT with Python binding☆41Updated 3 years ago
- benchmarking some transformer deployments☆26Updated last year
- A Python library transfers PyTorch tensors between CPU and NVMe☆96Updated this week
- study of cutlass☆19Updated this week
- OneFlow->ONNX☆42Updated last year
- ☆67Updated last year
- ☆57Updated last week
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆85Updated 8 months ago
- play gemm with tvm☆84Updated last year
- ☆18Updated 2 years ago
- High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.☆87Updated 4 months ago
- Odysseus: Playground of LLM Sequence Parallelism☆55Updated 4 months ago
- Distributed ML Optimizer☆31Updated 3 years ago
- Performance benchmarking with ColossalAI☆39Updated 2 years ago
- ☆23Updated 8 months ago
- ☆48Updated 8 months ago
- llama INT4 cuda inference with AWQ☆47Updated 4 months ago
- Yet another Polyhedra Compiler for DeepLearning☆19Updated last year
- ☆79Updated 2 months ago
- (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.☆34Updated 2 years ago