linkedin / Liger-KernelLinks
Efficient Triton Kernels for LLM Training
☆5,246Updated last week
Alternatives and similar repositories for Liger-Kernel
Users that are interested in Liger-Kernel are comparing it to the libraries listed below
Sorting:
- A PyTorch native platform for training generative AI models☆3,953Updated this week
- Minimalistic 4D-parallelism distributed training framework for education purpose☆1,554Updated 3 weeks ago
- FlashInfer: Kernel Library for LLM Serving☆3,239Updated this week
- Minimalistic large language model 3D-parallelism training☆1,942Updated this week
- PyTorch native quantization and sparsity for training and inference☆2,125Updated this week
- PyTorch native post-training library☆5,287Updated this week
- Puzzles for learning Triton☆1,708Updated 7 months ago
- Tile primitives for speedy kernels☆2,478Updated this week
- NanoGPT (124M) in 3 minutes☆2,699Updated last week
- 🚀 Efficient implementations of state-of-the-art linear attention models in Torch and Triton☆2,753Updated this week
- verl: Volcano Engine Reinforcement Learning for LLMs☆9,958Updated this week
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper, Ada and Bla…☆2,507Updated last week
- Implementing DeepSeek R1's GRPO algorithm from scratch☆1,438Updated 2 months ago
- SGLang is a fast serving framework for large language models and vision language models.☆15,421Updated this week
- Tools for merging pretrained large language models.☆5,853Updated last week
- Code for BLT research paper☆1,686Updated last month
- Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM☆1,518Updated this week
- Simple RL training for reasoning☆3,635Updated 2 months ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,641Updated this week
- Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.☆4,622Updated last week
- A Datacenter Scale Distributed Inference Serving Framework☆4,326Updated this week
- [MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration☆3,101Updated 2 weeks ago
- The simplest, fastest repository for training/finetuning small-sized VLMs.☆3,418Updated last week
- Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels☆1,314Updated this week
- GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection☆1,572Updated 7 months ago
- Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.☆3,459Updated this week
- Implementation for MatMul-free LM.☆3,010Updated 7 months ago
- AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:☆2,196Updated last month
- Run PyTorch LLMs locally on servers, desktop and mobile☆3,596Updated last month
- Material for gpu-mode lectures☆4,636Updated last week