Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.
☆1,376Jul 6, 2026Updated this week
Alternatives and similar repositories for AngelSlim
Users that are interested in AngelSlim are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- On Policy Distillation Build on top of Verl☆89May 25, 2026Updated last month
- ☆708Dec 30, 2025Updated 6 months ago
- mechanical stage☆11Aug 6, 2023Updated 2 years ago
- Multiple GEMM operators are constructed with cutlass to support LLM inference.☆20Aug 3, 2025Updated 11 months ago
- ☆11Dec 11, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆13Oct 14, 2025Updated 8 months ago
- This repository provides the code for applying Contrastive Learning Penalty Loss (CLPL) and Mixture of Experts (MoE) to the BGE-M3 text e…☆11Dec 27, 2024Updated last year
- An efficient multi-modal instruction-following data synthesis tool and the official implementation of Oasis https://arxiv.org/abs/2503.08…☆40Jun 4, 2025Updated last year
- An acceleration library that supports arbitrary bit-width combinatorial quantization operations☆246Sep 30, 2024Updated last year
- [EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.☆731May 14, 2026Updated last month
- ☆30May 24, 2025Updated last year
- PyTorch implementation of "Deep Transferring Quantization" (ECCV2020)☆18Jun 22, 2022Updated 4 years ago
- Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and EAGLE-3 (NeurIPS'25).☆2,440Feb 20, 2026Updated 4 months ago
- ☆15Jun 22, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Tencent Hunyuan 7B (short as Hunyuan-7B) is one of the large language dense models of Tencent Hunyuan☆71Aug 11, 2025Updated 10 months ago
- Multiplex Thinking: Reasoning via Token-wise Branch-and-Merge☆131May 24, 2026Updated last month
- Reading notes on Speculative Decoding papers☆38Jun 2, 2026Updated last month
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆156May 10, 2025Updated last year
- RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.☆1,264Updated this week
- This is the codebase for pre-training, compressing, extending, and distilling LLMs with Megatron-LM.☆12Mar 11, 2024Updated 2 years ago
- C++ implementation of "Mobile Vision Transformer-based Visual Object Tracking" (BMVC2023) and "Separable Self and Mixed Attention Transf…☆13Apr 23, 2024Updated 2 years ago
- An algorithm for weight-activation quantization (W4A4, W4A8) of LLMs, supporting both static and dynamic quantization☆176Nov 26, 2025Updated 7 months ago
- DiTAS: Quantizing Diffusion Transformers via Enhanced Activation Smoothing (WACV 2025)☆13Feb 7, 2026Updated 5 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [ICLR'25] ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generation☆163Mar 21, 2025Updated last year
- [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding☆1,339Mar 6, 2025Updated last year
- Keyformer proposes KV Cache reduction through key tokens identification and without the need for fine-tuning☆57Mar 26, 2024Updated 2 years ago
- ☆173Mar 9, 2023Updated 3 years ago
- This repository contains integer operators on GPUs for PyTorch.☆235Sep 29, 2023Updated 2 years ago
- [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training☆264Aug 9, 2025Updated 11 months ago
- ☆106Sep 9, 2024Updated last year
- [MLSys'25] QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving; [MLSys'25] LServe: Efficient Long-sequence LLM Se…☆845Mar 6, 2025Updated last year
- ☆543Apr 1, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ScrollNet for Continual Learning☆11Sep 11, 2023Updated 2 years ago
- collab-dev - Collaboration Metrics for Code Reviews☆23May 12, 2025Updated last year
- Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.☆47Jun 11, 2025Updated last year
- ☆43Jan 30, 2024Updated 2 years ago
- [ACL 2024] A novel QAT with Self-Distillation framework to enhance ultra low-bit LLMs.☆139May 16, 2024Updated 2 years ago
- 3x Faster Inference; Unofficial implementation of EAGLE Speculative Decoding☆85Jul 3, 2025Updated last year
- A Knowledge-grounded framework for Autonomous ML/AI Program Synthesis and Optimization☆92Feb 20, 2026Updated 4 months ago