The official implementation of "SDMPrune: Self-Distillation MLP Pruning for Efficient Large Language Models"
☆22Jun 11, 2025Updated last year
Alternatives and similar repositories for SDMPrune
Users that are interested in SDMPrune are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The official implementation of "Diversity-Guided MLP Reduction for Efficient Large Vision Transformers"☆21Jun 12, 2025Updated last year
- Demo for Qwen2.5-VL-3B-Instruct on Axera device.☆16Sep 3, 2025Updated last year
- This is a web project about auto-matting with deep learning tech, which can be used in image merge, poster generate, video editing etc.☆26Mar 24, 2023Updated 3 years ago
- ☆23May 5, 2025Updated last year
- ☆23Nov 6, 2025Updated 11 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆26Sep 4, 2025Updated last year
- NCU-driven iterative optimization workflow for CUDA/CUTLASS/Triton/CuTe DSL kernels.☆25Apr 10, 2026Updated 6 months ago
- LoRAFusion: Efficient LoRA Fine-Tuning for LLMs☆30Jul 2, 2026Updated 3 months ago
- 🎬 3.7× faster video generation E2E 🖼️ 1.6× faster image generation E2E ⚡ ColumnSparseAttn 9.3× vs FlashAttn‑3 💨 ColumnSparseGEMM 2.5× …☆114Sep 8, 2025Updated last year
- An experimental communicating attention kernel based on DeepEP.☆34Jul 29, 2025Updated last year
- Autonomous GPU kernel optimization system driven by AI agents.☆32Mar 29, 2026Updated 6 months ago
- 很好用的tnn classify demo☆11Mar 24, 2021Updated 5 years ago
- patches for huggingface transformers to save memory☆37May 9, 2026Updated 5 months ago
- MSLK (Meta Superintelligence Labs Kernels) is a collection of PyTorch GPU operator libraries that are designed and optimized for GenAI tr…☆155Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- RACE is a multi-dimensional benchmark for code generation that focuses on Readability, mAintainability, Correctness, and Efficiency.☆15Oct 12, 2024Updated last year
- Quantized Attention on GPU☆45Nov 22, 2024Updated last year
- ☆15May 13, 2024Updated 2 years ago
- ☆15Dec 20, 2024Updated last year
- 下载emotioNet_URLs的Python脚本，实现异步并行下载。☆10Dec 22, 2017Updated 8 years ago
- My attempt to improve the speed of the newton schulz algorithm, starting from the dion implementation.☆42Apr 30, 2026Updated 5 months ago
- ☆37Dec 31, 2025Updated 9 months ago
- ☆36Mar 25, 2024Updated 2 years ago
- ☆54May 19, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Community maintained hardware plugin for vLLM on AWS Neuron☆52Aug 17, 2026Updated last month
- use yolov3 onnx model to implement object detection☆10Apr 25, 2019Updated 7 years ago
- ONNX Runtime tiny wrapper for openFrameworks☆15Jan 21, 2022Updated 4 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆17Jun 3, 2024Updated 2 years ago
- Learning to Copy for Automatic Post-Editing (EMNLP 2019)☆11May 6, 2021Updated 5 years ago
- Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference☆172Oct 13, 2025Updated 11 months ago
- ☆19Dec 11, 2023Updated 2 years ago
- [ECCV24] MixDQ: Memory-Efficient Few-Step Text-to-Image Diffusion Models with Metric-Decoupled Mixed Precision Quantization☆50Nov 27, 2024Updated last year
- Dockerized container for MODNet - a Real-Time Portrait Matting solution☆13Mar 27, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆13Jan 7, 2025Updated last year
- Implemetation of "Pixel-In-Pixel Net: Towards Efficient Facial Landmark Detection in the Wild"☆11Jul 6, 2023Updated 3 years ago
- sherpa with mlx☆15Aug 2, 2025Updated last year
- Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.☆48Jun 11, 2025Updated last year
- ☆13Mar 12, 2022Updated 4 years ago
- Windows 💻 RobustVideoMatting with ONNXRuntime/MNN/TNN C++/Python☆12Mar 10, 2022Updated 4 years ago
- CUDA Embedding Lookup Kernel Library☆50Jun 26, 2026Updated 3 months ago