stanford-cs336 / assignment2-systemsLinks
Student version of Assignment 2 for Stanford CS336 - Language Modeling From Scratch
☆58Updated last month
Alternatives and similar repositories for assignment2-systems
Users that are interested in assignment2-systems are comparing it to the libraries listed below
Sorting:
- making the official triton tutorials actually comprehensible☆53Updated last week
- ☆39Updated 5 months ago
- ☆163Updated last year
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆261Updated 3 weeks ago
- ring-attention experiments☆149Updated 10 months ago
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Updated 5 months ago
- An extension of the nanoGPT repository for training small MOE models.☆181Updated 5 months ago
- ☆214Updated 6 months ago
- ☆240Updated 2 months ago
- ☆192Updated 7 months ago
- Dion optimizer algorithm☆318Updated last week
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆174Updated 2 months ago
- Simple & Scalable Pretraining for Neural Architecture Research☆290Updated last week
- Efficient LLM Inference over Long Sequences☆390Updated 2 months ago
- [ICLR2025 Spotlight] MagicPIG: LSH Sampling for Efficient LLM Generation☆232Updated 8 months ago
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆191Updated 2 months ago
- Normalized Transformer (nGPT)☆187Updated 9 months ago
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆214Updated 3 months ago
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆129Updated 8 months ago
- The evaluation framework for training-free sparse attention in LLMs☆91Updated 2 months ago
- ☆405Updated last week
- ☆217Updated 7 months ago
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆393Updated 5 months ago
- coding CUDA everyday!☆57Updated 4 months ago
- Learning about CUDA by writing PTX code.☆135Updated last year
- ☆27Updated last month
- Official PyTorch implementation for Hogwild! Inference: Parallel LLM Generation with a Concurrent Attention Cache☆121Updated 2 weeks ago
- Samples of good AI generated CUDA kernels☆89Updated 3 months ago
- Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024☆331Updated 3 months ago
- ☆85Updated last week