Demonstration of MoE distributed training using various techniques
☆11Oct 31, 2024Updated last year
Alternatives and similar repositories for moe-distributed-training
Users that are interested in moe-distributed-training are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Show the time in Roman Numerals☆12Jan 23, 2020Updated 6 years ago
- ☆10Apr 27, 2025Updated last year
- ☆16Mar 18, 2025Updated last year
- MLCommons Science benchmarking working group☆15Apr 17, 2026Updated 6 months ago
- 使用trl、peft、transformers等库，实现对huggingface上模型的微调。☆10Mar 21, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A distilled DeepSeek-R1 variant built on Qwen2.5-32B, fine-tuned with curated data for enhanced performance and efficiency. <metadata> gp…☆14Mar 11, 2025Updated last year
- Artifacts of VLDB'22 paper "COMET: A Novel Memory-Efficient Deep Learning TrainingFramework by Using Error-Bounded Lossy Compression"☆10Aug 2, 2022Updated 4 years ago
- Rucio K8s tutorial☆12Jul 24, 2026Updated 3 months ago
- So, I trained a MoE based a 124M (8x12M) architecture I coded from ground up to build a small instruct model, going through the below-men…☆14Jul 18, 2025Updated last year
- ☆13Jul 27, 2026Updated 3 months ago
- Книга "Графовые нейронные сети на Python"☆10Aug 31, 2024Updated 2 years ago
- Phony News Classifier is a repository which contains analysis of a natural language processing application i.e fake news classifier with …☆10May 27, 2020Updated 6 years ago
- ☆25Aug 20, 2025Updated last year
- Custom triton kernels for training Karpathy's nanoGPT.☆19Oct 21, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- This repository contains code used for our Multi Sentence Inference NAACL'22 paper.☆12Mar 6, 2023Updated 3 years ago
- Official Repo of "CIBench: Evaluation of LLMs as Code Interpreter "☆15Jul 19, 2024Updated 2 years ago
- RuCLIP-SB (Russian Contrastive Language–Image Pretraining SWIN-BERT) is a multimodal model for obtaining images and text similarities and…☆15Jan 25, 2022Updated 4 years ago
- RL a search agent on SEC filings with Tinker (Dr. GRPO, gpt-oss-20b)☆24Sep 17, 2026Updated last month
- Evaluate Transformers from the Hub 🔥☆14Sep 24, 2026Updated last month
- Lorentzian Distance Learning for Hyperbolic Representations: Retrieval experiments☆13May 28, 2019Updated 7 years ago
- Distributed lbfgs on Apache Spark☆10Sep 25, 2020Updated 6 years ago
- A series of dockerfiles templates with poetry support as dependency manager☆10Apr 15, 2022Updated 4 years ago
- ☆12Sep 11, 2020Updated 6 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- WIPE implementation☆12Nov 26, 2023Updated 2 years ago
- A portable implementation of SZ lossy compression for AMD GPUs and Hygon DCUs.☆13Feb 26, 2025Updated last year
- Jubatus Toolkit☆12May 16, 2019Updated 7 years ago
- Our solution to ML Talent Match hackathon☆10Mar 22, 2024Updated 2 years ago
- PyTorch implementation of GRPO.☆16Apr 21, 2025Updated last year
- HDF5 Cache VOL connector for caching data on fast storage layers and moving data asynchronously to the parallel file system to hide I/O o…☆22Feb 10, 2026Updated 8 months ago
- ☆11Dec 12, 2021Updated 4 years ago
- Extract text information from warc files☆12Sep 1, 2022Updated 4 years ago
- ☆18Feb 22, 2022Updated 4 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Stock prediction using RWKV NN. Until now most of the usage done with RWKV was for LM.☆12Jul 3, 2023Updated 3 years ago
- Image captioning using CNN and RNN☆11Mar 24, 2025Updated last year
- Classify documents using Python based on SVM and TF-IDF.☆15Nov 19, 2019Updated 6 years ago
- A set of utilities to turn Dataclasses into useful configuration managers.☆11Mar 27, 2024Updated 2 years ago
- 利用强化学习的Q价值迭代,Q学习以及SARSA方法解决小车爬山以及倒立摆的控制问题☆15Jul 25, 2019Updated 7 years ago
- Курс дата-инженера на Karpov Courses☆18Apr 22, 2023Updated 3 years ago
- ☆16Jun 4, 2024Updated 2 years ago