Demonstration of MoE distributed training using various techniques
☆11Oct 31, 2024Updated 2 years ago
Alternatives and similar repositories for moe-distributed-training
Users that are interested in moe-distributed-training are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Show the time in Roman Numerals☆12Jan 23, 2020Updated 6 years ago
- ☆16Mar 18, 2025Updated last year
- MLCommons Science benchmarking working group☆15Apr 17, 2026Updated 7 months ago
- A distilled DeepSeek-R1 variant built on Qwen2.5-32B, fine-tuned with curated data for enhanced performance and efficiency. <metadata> gp…☆14Mar 11, 2025Updated last year
- ☆13Jul 27, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- So, I trained a MoE based a 124M (8x12M) architecture I coded from ground up to build a small instruct model, going through the below-men…☆14Jul 18, 2025Updated last year
- Книга "Графовые нейронные сети на Python"☆10Aug 31, 2024Updated 2 years ago
- Different post-training techniques for LLMs, including: SFT, DPO and Online RL☆10Sep 5, 2025Updated last year
- Rucio K8s tutorial☆12Jul 24, 2026Updated 3 months ago
- 使用trl、peft、transformers等库,实现对huggingface上模型的微调。☆10Mar 21, 2025Updated last year
- Artifacts of VLDB'22 paper "COMET: A Novel Memory-Efficient Deep Learning TrainingFramework by Using Error-Bounded Lossy Compression"☆10Aug 2, 2022Updated 4 years ago
- Phony News Classifier is a repository which contains analysis of a natural language processing application i.e fake news classifier with …☆10May 27, 2020Updated 6 years ago
- ☆25Aug 20, 2025Updated last year
- ☆10Jul 20, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Custom triton kernels for training Karpathy's nanoGPT.☆19Oct 21, 2024Updated 2 years ago
- Official Repo of "CIBench: Evaluation of LLMs as Code Interpreter "☆15Jul 19, 2024Updated 2 years ago
- This repository contains code used for our Multi Sentence Inference NAACL'22 paper.☆12Mar 6, 2023Updated 3 years ago
- ☆19Updated this week
- Evaluate Transformers from the Hub 🔥☆14Sep 24, 2026Updated last month
- RuCLIP-SB (Russian Contrastive Language–Image Pretraining SWIN-BERT) is a multimodal model for obtaining images and text similarities and…☆15Jan 25, 2022Updated 4 years ago
- Lorentzian Distance Learning for Hyperbolic Representations: Retrieval experiments☆13May 28, 2019Updated 7 years ago
- Distributed lbfgs on Apache Spark☆10Sep 25, 2020Updated 6 years ago
- A series of dockerfiles templates with poetry support as dependency manager☆10Apr 15, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- WIPE implementation☆12Nov 26, 2023Updated 2 years ago
- Jubatus Toolkit☆12May 16, 2019Updated 7 years ago
- Our solution to ML Talent Match hackathon☆10Mar 22, 2024Updated 2 years ago
- PyTorch implementation of GRPO.☆16Apr 21, 2025Updated last year
- ☆11Dec 12, 2021Updated 4 years ago
- ☆12Sep 11, 2020Updated 6 years ago
- RL a search agent on SEC filings with Tinker (Dr. GRPO, gpt-oss-20b)☆24Sep 17, 2026Updated 2 months ago
- Image captioning using CNN and RNN☆11Mar 24, 2025Updated last year
- A portable implementation of SZ lossy compression for AMD GPUs and Hygon DCUs.☆13Feb 26, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆31Updated this week
- A set of utilities to turn Dataclasses into useful configuration managers.☆11Mar 27, 2024Updated 2 years ago
- Classify documents using Python based on SVM and TF-IDF.☆15Nov 19, 2019Updated 7 years ago
- HDF5 Cache VOL connector for caching data on fast storage layers and moving data asynchronously to the parallel file system to hide I/O o…☆22Feb 10, 2026Updated 9 months ago
- ☆16Jun 4, 2024Updated 2 years ago
- Simplify usage of Snackbar with Android Data Binding.☆13Sep 22, 2016Updated 10 years ago
- Translation demonstrator☆37May 12, 2020Updated 6 years ago
Are these results useful?