CUDA MoE kernels.
☆12Sep 21, 2024Updated 2 years ago
Alternatives and similar repositories for MoE_inference
Users that are interested in MoE_inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Implementation and analysis using CUDA and openMP☆11Dec 14, 2016Updated 9 years ago
- Efficient and unified implementations for TopK-based sparse attention☆41Jul 10, 2026Updated 3 months ago
- NCU-driven iterative optimization workflow for CUDA/CUTLASS/Triton/CuTe DSL kernels.☆25Apr 10, 2026Updated 6 months ago
- ☆123May 16, 2025Updated last year
- a simple API to use CUPTI☆10Aug 19, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- SGLang is a fast serving framework for large language models and vision language models.☆35Updated this week
- A skill for automatically optimizing CUDA code.☆46Mar 26, 2026Updated 6 months ago
- High Performance FP8 GEMM Kernels for SM89 and later GPUs.☆21Jan 24, 2025Updated last year
- Assignments of the dragon book, 2nd☆11Jan 18, 2018Updated 8 years ago
- ☆42Sep 21, 2026Updated last month
- Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.☆77Sep 8, 2024Updated 2 years ago
- GEMV implementation with CUTLASS☆21Aug 21, 2025Updated last year
- Some funny cute/cuteDSL code snippets☆35Mar 2, 2026Updated 7 months ago
- High-performance GEMM implementation optimized for NVIDIA H100 GPUs, leveraging Hopper architecture's TMA, WGMMA, and Thread Block Cluste…☆11Aug 25, 2026Updated last month
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆17Apr 16, 2026Updated 6 months ago
- ☆23Dec 12, 2024Updated last year
- docker images for training, mining and infer for ymir☆12Apr 26, 2023Updated 3 years ago
- Code Repository for the NeurIPS 2024 Paper "Toward Efficient Inference for Mixture of Experts".☆19Oct 30, 2024Updated last year
- ☆16Sep 25, 2025Updated last year
- Visualize expert firing frequencies across sentences in the Mixtral MoE model☆18Dec 22, 2023Updated 2 years ago
- Official repository for the paper "Fast Predictive Uncertainty for Classification with Bayesian Deep Networks". Accepted at UAI 2022. htt…☆13May 25, 2022Updated 4 years ago
- llama INT4 cuda inference with AWQ☆54Jan 20, 2025Updated last year
- Image Classification and Feature Extraction with ConvNeXt☆11Nov 14, 2022Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Learning problem-solving, logic/set, math, physics, economics through functional programming using Haskell☆19Oct 16, 2015Updated 11 years ago
- Make FP4 on 5090 Great Again☆24Jul 20, 2026Updated 3 months ago
- ☆49Apr 15, 2024Updated 2 years ago
- Inference Llama 2 in one file of pure Cuda☆17Aug 20, 2023Updated 3 years ago
- ☆15Oct 10, 2026Updated last week
- ☆19Jan 8, 2026Updated 9 months ago
- Multi-view hierarchical clustering in R☆12Apr 24, 2024Updated 2 years ago
- Adaptive Message Quantization and Parallelization for Distributed Full-graph GNN Training☆24Mar 1, 2024Updated 2 years ago
- Automated CUDA kernel performance diagnostics from NVIDIA Nsight Compute (NCU) CSV exports.☆35Mar 18, 2026Updated 7 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Breakable CUDA graph capture for PyTorch - capture compatible regions as CUDA graphs while running incompatible operations eagerly betwee…☆29Oct 8, 2026Updated 2 weeks ago
- Official codebase for the MLSys 2026 paper "IntAttention: A Fully Integer Attention Pipeline for Efficient Edge Inference". It enables hi…☆23May 29, 2026Updated 4 months ago
- Label Enhancement for Label Distribution Learning. IEEE Transactions on Knowledge and Data Engineering (IEEE TKDE)/IJCAI 2018☆10Mar 21, 2022Updated 4 years ago
- Awesome MoE Diffusion Models☆21Mar 25, 2026Updated 6 months ago
- matlab code for AAAI16 ：Multiple Kernel k-Means Clustering with Matrix-Induced Regularization☆11Sep 18, 2019Updated 7 years ago
- FlashRT-HF-kernels contains standalone FlashRT CUDA/CUTLASS kernels prepared for the Hugging Face kernels community, focusing on small-ba…☆24Aug 21, 2026Updated 2 months ago
- Flash-Flash KDA: H100-optimized Flash Kimi Delta Attention kernels☆24Jul 24, 2026Updated 2 months ago