hkproj / quantization-notesLinks
Notes on quantization in neural networks
☆105Updated last year
Alternatives and similar repositories for quantization-notes
Users that are interested in quantization-notes are comparing it to the libraries listed below
Sorting:
- ☆216Updated 10 months ago
- making the official triton tutorials actually comprehensible☆61Updated 2 months ago
- GPU Kernels☆206Updated 6 months ago
- 100 days of building GPU kernels!☆531Updated 6 months ago
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆195Updated 5 months ago
- LLaMA 2 implemented from scratch in PyTorch☆358Updated 2 years ago
- LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch☆117Updated 2 years ago
- ☆177Updated last year
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆428Updated 8 months ago
- LoRA and DoRA from Scratch Implementations☆211Updated last year
- ☆45Updated 5 months ago
- Learn CUDA with PyTorch☆104Updated last week
- coding CUDA everyday!☆69Updated last week
- Distributed training (multi-node) of a Transformer model☆86Updated last year
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆242Updated 6 months ago
- An extension of the nanoGPT repository for training small MOE models.☆210Updated 8 months ago
- Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)☆160Updated last year
- ☆397Updated 7 months ago
- This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…☆91Updated 2 years ago
- Slides, notes, and materials for the workshop☆334Updated last year
- This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…☆74Updated 2 years ago
- Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)☆321Updated 2 years ago
- From scratch implementation of a vision language model in pure PyTorch☆248Updated last year
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆302Updated 2 weeks ago
- A Simplified PyTorch Implementation of Vision Transformer (ViT)☆219Updated last year
- Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024☆346Updated 6 months ago
- Reference implementation of Mistral AI 7B v0.1 model.☆28Updated last year
- Complete implementation of Llama2 with/without KV cache & inference 🚀☆48Updated last year
- Load compute kernels from the Hub☆326Updated last week
- Notes about LLaMA 2 model☆69Updated 2 years ago