PyTorch distributed training from scratch (for educational purposes only)
☆22Apr 12, 2025Updated last year
Alternatives and similar repositories for distributed_pytorch_from_scratch
Users that are interested in distributed_pytorch_from_scratch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Cut2Next: Generating Next Shot via In-Context Tuning☆33Aug 21, 2025Updated 9 months ago
- A specialized RWKV-7 model for Othello(a.k.a. Reversi) that predicts legal moves, evaluates positions, and performs in-context search. It…☆44Jan 25, 2025Updated last year
- Clone of the mp3gain sources from svn on sourceforge (http://mp3gain.sourceforge.net/)☆11Jan 3, 2013Updated 13 years ago
- Implementation of End-to-End YOLO Models☆10Dec 30, 2025Updated 5 months ago
- ☆12Jun 11, 2021Updated 5 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- https://x.com/BlinkDL_AI/status/1884768989743882276☆28May 4, 2025Updated last year
- Official implementation for the paper Lancet: Accelerating Mixture-of-Experts Training via Whole Graph Computation-Communication Overlapp…☆14May 20, 2026Updated 3 weeks ago
- an implementation of parallel skills like amp, ddp, pp, tp for learning purposes☆14Nov 18, 2023Updated 2 years ago
- Self implementation of course projects for Computer Architecture 2022 Spring☆11Sep 17, 2022Updated 3 years ago
- DRAM/SSD hybrid caching system☆15Mar 13, 2025Updated last year
- ☆30Feb 27, 2025Updated last year
- ☆15Jun 14, 2022Updated 4 years ago
- LLM training parallelisms (DP, FSDP, TP, PP) in pure C☆29Jan 27, 2026Updated 4 months ago
- ☆12Mar 26, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A record of reading list on some MLsys popular topic☆25Mar 20, 2025Updated last year
- RISC-V SingleCycle/Pipeline CPU (lab of ZJU Computer System Series)☆16Jul 6, 2023Updated 2 years ago
- 清华大学电子工程系数字逻辑与处理器基础实验大作业——流水线 CPU☆12Aug 8, 2021Updated 4 years ago
- Tiny-Megatron, a minimalistic re-implementation of the Megatron library☆27Sep 1, 2025Updated 9 months ago
- Some microbenchmarks and design docs before commencement☆11Feb 1, 2021Updated 5 years ago
- 数据结构与算法课的实验、作业代码，以及课堂ppt☆16Jan 10, 2019Updated 7 years ago
- QTK 是一套基于HTML5 Canvas实现的, 专注于桌面/移动应用程序开发的框架。☆11Jul 30, 2017Updated 8 years ago
- 一个基于FFmpeg、libtorrent的P2P播放器实现☆11Jul 18, 2014Updated 11 years ago
- Beyond KV Caching: Shared Attention for Efficient LLMs☆20Jul 19, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- My QEMU for linux kernel test☆11Nov 10, 2019Updated 6 years ago
- Mobile Federated Learning development kit for FedCampus☆19Feb 3, 2024Updated 2 years ago
- The Android media codec video sink for GStreamer 1.0☆10Oct 31, 2020Updated 5 years ago
- STONNE Simulator integrated into SST Simulator☆22Apr 5, 2024Updated 2 years ago
- LLMem: GPU Memory Estimation for Fine-Tuning Pre-Trained LLMs☆30May 31, 2025Updated last year
- 用户友好、开箱即用的 RWKV Prompts 示例，适用于所有用户。Awesome RWKV Prompts for general users, more user-friendly, ready-to-use prompt examples.☆35Apr 13, 2026Updated 2 months ago
- ☆23Mar 18, 2024Updated 2 years ago
- CFR implementation of a poker bot.☆12Feb 17, 2023Updated 3 years ago
- A 2-Way Super-Scalar OoO RISC-V Core Based on Intel P6 Microarchitecture.☆17Sep 27, 2022Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆16Jan 30, 2020Updated 6 years ago
- A single-file educational implementation for understanding vLLM's core concepts and running LLM inference.☆44Apr 7, 2026Updated 2 months ago
- KFunca: A minimalist, high-performance GPU-based automatic differentiation framework☆31Aug 14, 2025Updated 10 months ago
- Parendi: Thousand-way Parallel RTL Simulation on the Graphcore IPU☆27Nov 26, 2025Updated 6 months ago
- USTC 体系结构 资料☆14Jul 17, 2022Updated 3 years ago
- 🌿快速生成文件夹目录结构，支持定义目录层级，支持生成到 markdown 文件。☆13Oct 19, 2022Updated 3 years ago
- PyTorch code for our paper "Resource-Adaptive Federated Learning with All-In-One Neural Composition" (NeurIPS2022)☆19Dec 4, 2022Updated 3 years ago