hkproj / quantization-notes
Notes on quantization in neural networks
☆79Updated last year
Alternatives and similar repositories for quantization-notes:
Users that are interested in quantization-notes are comparing it to the libraries listed below
- ☆153Updated 3 months ago
- Distributed training (multi-node) of a Transformer model☆64Updated last year
- Complete implementation of Llama2 with/without KV cache & inference 🚀☆47Updated 10 months ago
- GPU Kernels☆160Updated last week
- ☆153Updated last year
- LoRA and DoRA from Scratch Implementations☆200Updated last year
- 100 days of building GPU kernels!☆336Updated this week
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆173Updated this week
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆332Updated last month
- making the official triton tutorials actually comprehensible☆26Updated 3 weeks ago
- LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch☆101Updated last year
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆156Updated 3 weeks ago
- Mixed precision training from scratch with Tensors and CUDA☆22Updated 11 months ago
- Prune transformer layers☆68Updated 10 months ago
- Reference implementation of Mistral AI 7B v0.1 model.☆28Updated last year
- An implementation of the transformer architecture onto an Nvidia CUDA kernel☆179Updated last year
- This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…☆63Updated last year
- This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…☆91Updated last year
- All Homeworks for TinyML and Efficient Deep Learning Computing 6.5940 • Fall • 2023 • https://efficientml.ai☆165Updated last year
- RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems☆100Updated 2 months ago
- Unofficial implementation of https://arxiv.org/pdf/2407.14679☆44Updated 7 months ago
- Fast low-bit matmul kernels in Triton☆288Updated this week
- ☆166Updated 2 months ago
- E2E AutoML Model Compression Package☆47Updated last month
- Fine-tune an LLM to perform batch inference and online serving.☆109Updated this week
- ☆232Updated last week
- Slides, notes, and materials for the workshop☆323Updated 10 months ago
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆530Updated this week
- Code for studying the super weight in LLM☆97Updated 4 months ago
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆65Updated 3 weeks ago