Fused Qwen3 MoE layer for faster training, compatible with Transformers, LoRA, bnb 4-bit quant, Unsloth. Also possible to train LoRA over GGUF
☆241Feb 19, 2026Updated last month
Alternatives and similar repositories for transformers-qwen3-moe-fused
Users that are interested in transformers-qwen3-moe-fused are comparing it to the libraries listed below
Sorting:
- Auto Thinking Mode switch for Qwen3 in Open webui☆70May 8, 2025Updated 10 months ago
- Recursive Self-Aggregation evals on ARC-AGI☆28Jan 26, 2026Updated last month
- Official Code for "Seed-Free Synthetic Data Generation Framework for Instruction-Tuning LLMs: A Case Study in Thai"☆22May 9, 2025Updated 10 months ago
- ☆18Sep 29, 2024Updated last year
- unsloth-5090-multiple☆61May 21, 2025Updated 9 months ago
- Authenticated Knowledge & Trust Architecture for AI Agents☆30Dec 17, 2025Updated 3 months ago
- The official repository for the paper “NonVerbalSpeech-38K: A Scalable Pipeline for Enabling Non-Verbal Speech Generation and Understandi…☆63Dec 26, 2025Updated 2 months ago
- Benchmarking Deepseek R1 API response speeds across different providers for performance comparison.☆10Feb 15, 2025Updated last year
- patches for huggingface transformers to save memory☆35Jun 2, 2025Updated 9 months ago
- Inference RWKV with multiple supported backends.☆81Mar 11, 2026Updated last week
- Various test models in WNNX format. It can view with `pip install wnetron && wnetron`☆12Jun 22, 2022Updated 3 years ago
- Muon fsdp 2☆55Aug 8, 2025Updated 7 months ago
- Repository for Skill Set Optimization☆14Jul 26, 2024Updated last year
- ☆13Nov 4, 2025Updated 4 months ago
- ☆13Apr 15, 2024Updated last year
- A repository aimed at pruning DeepSeek V3, R1 and R1-zero to a usable size☆84Sep 5, 2025Updated 6 months ago
- LoRA-One: One-Step Full Gradient Could Suffice for Fine-Tuning Large Language Models, Provably and Efficiently (ICML2025 Oral)☆29Oct 22, 2025Updated 4 months ago
- RADLADS training code☆37May 7, 2025Updated 10 months ago
- ☆21Jun 16, 2022Updated 3 years ago
- A simple one file python script that executes AI processes defined in YML.☆14Mar 26, 2023Updated 2 years ago
- The official repo for the DanQing dataset.☆31Jan 16, 2026Updated 2 months ago
- Youtu-Parsing: Perception, Structuring and Recognition via High-Parallelism Decoding☆59Feb 10, 2026Updated last month
- ☆17Jan 1, 2025Updated last year
- ☆10Feb 2, 2023Updated 3 years ago
- ☆35Mar 22, 2025Updated 11 months ago
- LLM手撕代码合集☆21Mar 25, 2025Updated 11 months ago
- Local LLM Agent with Guidance☆13May 26, 2023Updated 2 years ago
- ☆64Jul 10, 2025Updated 8 months ago
- Direct Preference Optimization for RWKV, aiming for RWKV-5 and 6.☆11Mar 1, 2024Updated 2 years ago
- An MCP-enabled Qwen3 0.6B demo with adjustable thinking budget, all in your browser!☆29Jun 2, 2025Updated 9 months ago
- Our library for RL environments + evals☆3,899Updated this week
- Spherical Merge Pytorch/HF format Language Models with minimal feature loss.☆146Sep 10, 2023Updated 2 years ago
- ☆17Apr 10, 2024Updated last year
- A 20M RWKV v6 can do nonogram☆14Oct 18, 2024Updated last year
- Official Chinese documentation for RWKV | RWKV官方中文文档☆15Feb 20, 2026Updated last month
- High performance pytorch modules☆17Jan 14, 2023Updated 3 years ago
- Model Context Protocol Server for Apache OpenDAL™☆34Apr 10, 2025Updated 11 months ago
- A subset of YFCC100M. Tools, checking scripts and links of web drive to download datasets(uncompressed).☆19Nov 13, 2024Updated last year
- coze api to openai☆15Sep 1, 2024Updated last year