gpu-mode / lecture2Links
Obsolete version of CUDA-mode repo -- use cuda-mode/lectures instead
☆26Updated last year
Alternatives and similar repositories for lecture2
Users that are interested in lecture2 are comparing it to the libraries listed below
Sorting:
- ☆214Updated 6 months ago
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆310Updated last week
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆393Updated 5 months ago
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆191Updated 3 months ago
- Alex Krizhevsky's original code from Google Code☆196Updated 9 years ago
- ☆163Updated last year
- GPU Kernels☆193Updated 4 months ago
- Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O☆481Updated this week
- A set of scripts and notebooks on LLM finetunning and dataset creation☆110Updated 11 months ago
- Notes on "Programming Massively Parallel Processors" by Hwu, Kirk, and Hajj (4th ed.)☆53Updated last year
- An extension of the nanoGPT repository for training small MOE models.☆181Updated 5 months ago
- An implementation of the transformer architecture onto an Nvidia CUDA kernel☆189Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆267Updated 10 months ago
- Fine-tune an LLM to perform batch inference and online serving.☆112Updated 3 months ago
- Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines☆197Updated last year
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆214Updated 3 months ago
- ☆192Updated 7 months ago
- Learnings and programs related to CUDA☆415Updated 2 months ago
- Best practices & guides on how to write distributed pytorch training code☆470Updated 6 months ago
- Learn CUDA with PyTorch☆67Updated this week
- Notes on quantization in neural networks☆97Updated last year
- Distributed training (multi-node) of a Transformer model☆80Updated last year
- Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)☆156Updated last year
- LoRA and DoRA from Scratch Implementations☆210Updated last year
- Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024☆331Updated 3 months ago
- coding CUDA everyday!☆57Updated 4 months ago
- A easy, reliable, fluid template for python packages complete with docs, testing suites, readme's, github workflows, linting and much muc…☆187Updated 3 weeks ago
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆261Updated 3 weeks ago
- Project 2 (Building Large Language Models) for Stanford CS324: Understanding and Developing Large Language Models (Winter 2022)☆105Updated 2 years ago
- Slides, notes, and materials for the workshop☆331Updated last year