CUDA MoE kernels.
☆12Sep 21, 2024Updated 2 years ago
Alternatives and similar repositories for MoE_inference
Users that are interested in MoE_inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Some funny cute/cuteDSL code snippets☆35Mar 2, 2026Updated 8 months ago
- Multiple GEMM operators are constructed with cutlass to support LLM inference.☆20Aug 3, 2025Updated last year
- Implementation and analysis using CUDA and openMP☆11Dec 14, 2016Updated 9 years ago
- ☆123May 16, 2025Updated last year
- (TGRS2025) Efficient Fourier Filtering Network with Contrastive Learning for AAV-based Unaligned Bimodal Salient Object Detection☆12Nov 10, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- a simple API to use CUPTI☆10Aug 19, 2025Updated last year
- NCU-driven iterative optimization workflow for CUDA/CUTLASS/Triton/CuTe DSL kernels.☆25Apr 10, 2026Updated 7 months ago
- LiteRAG 是一个基于 langchain + OPEA 打造的轻量化支持中英文多知识库智能客服系统。☆14Feb 18, 2025Updated last year
- A LaTeX beamer theme template for UCAS students.☆12Apr 21, 2024Updated 2 years ago
- A skill for automatically optimizing CUDA code.☆47Mar 26, 2026Updated 7 months ago
- High Performance FP8 GEMM Kernels for SM89 and later GPUs.☆21Jan 24, 2025Updated last year
- SGLang is a fast serving framework for large language models and vision language models.☆46Updated this week
- GEMV implementation with CUTLASS☆21Aug 21, 2025Updated last year
- ☆43Sep 21, 2026Updated last month
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- High-performance GEMM implementation optimized for NVIDIA H100 GPUs, leveraging Hopper architecture's TMA, WGMMA, and Thread Block Cluste…☆11Aug 25, 2026Updated 2 months ago
- Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.☆77Sep 8, 2024Updated 2 years ago
- Assignments of the dragon book, 2nd☆11Jan 18, 2018Updated 8 years ago
- SGLang is a fast serving framework for large language models and vision language models.☆11Dec 15, 2025Updated 10 months ago
- ☆17Updated this week
- ☆14Dec 22, 2024Updated last year
- Learning problem-solving, logic/set, math, physics, economics through functional programming using Haskell☆19Oct 16, 2015Updated 11 years ago
- ☆48Nov 1, 2025Updated last year
- Official repository for paper Routing-Free Mixture-of-Experts.☆20Oct 31, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆23Dec 12, 2024Updated last year
- CUDA+PTX Microbenchmark for RTX 4070 GPU☆11Mar 9, 2026Updated 8 months ago
- Efficient and unified implementations for TopK-based sparse attention☆41Jul 10, 2026Updated 4 months ago
- Official repository for the paper "Fast Predictive Uncertainty for Classification with Bayesian Deep Networks". Accepted at UAI 2022. htt…☆13May 25, 2022Updated 4 years ago
- Visualize expert firing frequencies across sentences in the Mixtral MoE model☆18Dec 22, 2023Updated 2 years ago
- ☆49Apr 15, 2024Updated 2 years ago
- llama INT4 cuda inference with AWQ☆55Jan 20, 2025Updated last year
- docker images for training, mining and infer for ymir☆12Apr 26, 2023Updated 3 years ago
- ☆17Sep 25, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆15Jul 10, 2026Updated 4 months ago
- Inference Llama 2 in one file of pure Cuda☆17Aug 20, 2023Updated 3 years ago
- Multi-view hierarchical clustering in R☆12Apr 24, 2024Updated 2 years ago
- Image Classification and Feature Extraction with ConvNeXt☆11Nov 14, 2022Updated 3 years ago
- A novel and efficient post-training INT6 quantization framework tailored for LLM inference.☆11Aug 29, 2026Updated 2 months ago
- learning nano-vllm 0.11.2☆43Dec 28, 2025Updated 10 months ago
- biology☆30Jul 28, 2019Updated 7 years ago
Are these results useful?